2024-05-03T16:19:00.997 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-03T16:19:00.997 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687374 --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/iozone}} --owner scheduled_rishabh@teuthology --name rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi -- /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687374/orig.config.yaml 2024-05-03T16:19:01.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-03T16:19:01.142 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687374 branch: wip-rishabh-testing-20240501.193033 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/iozone}} email: null first_in_suite: false job_id: '7687374' kernel: flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240501.193033 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow metadata IO - SLOW_OPS - slow request sha1: 9a047fe7599a549042d06a3fb5b6813a203eabea subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt dry_run: true install: ceph: flavor: default sha1: 9a047fe7599a549042d06a3fb5b6813a203eabea kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240501.193033 sha1: 9a047fe7599a549042d06a3fb5b6813a203eabea owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1698 sha1: 9a047fe7599a549042d06a3fb5b6813a203eabea sleep_before_teardown: 0 subset: 434/512 suite: fs suite_branch: wip-rishabh-testing-20240501.193033 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_9a047fe7599a549042d06a3fb5b6813a203eabea/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 9a047fe7599a549042d06a3fb5b6813a203eabea syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJZ6FdJN/cxQ5MKeTV+PaoSj/YASSLnUoe9r0XsLLyspJggfqzhg8Vb9AKeZrmaeBJxSa/R6PyvaafT1FbVaF08= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI22p8p89Zf4Kq+S4EWyJQW5Qh8VyQqCiTQob+SO5MJtzAuAXHeAi+45eZ5zqzWnLSl+wSSp2yI+XknDmk0X9xw= smithi146.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOJ9ViaEeEGhkMhYgWxwgHuSc05P5AzSeN9EHAsG9CdOowf+KH2BgU9sYCXXO4xYypajb/lJ1V+jzW8SWQYkOD0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-03_13:56:19 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-03T16:19:01.143 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_9a047fe7599a549042d06a3fb5b6813a203eabea/qa; will attempt to use it 2024-05-03T16:19:01.143 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_9a047fe7599a549042d06a3fb5b6813a203eabea/qa/tasks 2024-05-03T16:19:01.143 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-03T16:19:01.145 INFO:teuthology.task.internal:Checking packages... 2024-05-03T16:19:01.169 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '9a047fe7599a549042d06a3fb5b6813a203eabea' 2024-05-03T16:19:01.169 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-03T16:19:01.169 INFO:teuthology.packaging:ref: None 2024-05-03T16:19:01.169 INFO:teuthology.packaging:tag: None 2024-05-03T16:19:01.169 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240501.193033 2024-05-03T16:19:01.169 INFO:teuthology.packaging:sha1: 9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T16:19:01.170 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240501.193033 2024-05-03T16:19:01.320 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3450.g9a047fe7 2024-05-03T16:19:01.321 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-03T16:19:01.328 INFO:teuthology.task.internal:no buildpackages task found 2024-05-03T16:19:01.328 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-03T16:19:01.371 INFO:teuthology.task.internal:Saving configuration 2024-05-03T16:19:01.391 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-03T16:19:01.413 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-03T16:19:01.434 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687374', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-03 16:14:05.382537', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJZ6FdJN/cxQ5MKeTV+PaoSj/YASSLnUoe9r0XsLLyspJggfqzhg8Vb9AKeZrmaeBJxSa/R6PyvaafT1FbVaF08='} 2024-05-03T16:19:01.456 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687374', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-03 16:14:05.384839', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI22p8p89Zf4Kq+S4EWyJQW5Qh8VyQqCiTQob+SO5MJtzAuAXHeAi+45eZ5zqzWnLSl+wSSp2yI+XknDmk0X9xw='} 2024-05-03T16:19:01.473 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687374', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-03 16:14:05.383799', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOJ9ViaEeEGhkMhYgWxwgHuSc05P5AzSeN9EHAsG9CdOowf+KH2BgU9sYCXXO4xYypajb/lJ1V+jzW8SWQYkOD0='} 2024-05-03T16:19:01.474 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-03T16:19:01.481 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-03T16:19:01.482 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-03T16:19:01.482 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-03T16:19:01.482 INFO:teuthology.run_tasks:Running task console_log... 2024-05-03T16:19:01.607 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa209c31160>, signals=[15]) 2024-05-03T16:19:01.607 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-03T16:19:01.615 INFO:teuthology.task.internal:Opening connections... 2024-05-03T16:19:01.615 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-05-03T16:19:01.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T16:19:01.697 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-05-03T16:19:01.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T16:19:01.772 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2024-05-03T16:19:01.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T16:19:01.848 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-03T16:19:01.860 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-05-03T16:19:01.877 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-05-03T16:19:01.878 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-05-03T16:19:01.935 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-05-03T16:19:01.935 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-05-03T16:19:01.935 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-05-03T16:19:01.935 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-05-03T16:19:01.935 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-05-03T16:19:01.935 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-05-03T16:19:01.935 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-03T16:19:01.935 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-05-03T16:19:01.935 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-05-03T16:19:01.935 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-03T16:19:01.935 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-05-03T16:19:01.935 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-03T16:19:01.936 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-03T16:19:01.936 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-03T16:19:01.936 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-05-03T16:19:01.952 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-05-03T16:19:01.970 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-05-03T16:19:01.970 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-05-03T16:19:02.027 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-05-03T16:19:02.027 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-05-03T16:19:02.027 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-05-03T16:19:02.027 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-05-03T16:19:02.027 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-05-03T16:19:02.027 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-05-03T16:19:02.027 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-03T16:19:02.027 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-05-03T16:19:02.028 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-05-03T16:19:02.028 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-03T16:19:02.028 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-05-03T16:19:02.028 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-03T16:19:02.028 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-03T16:19:02.028 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-03T16:19:02.028 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-05-03T16:19:02.052 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2024-05-03T16:19:02.070 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2024-05-03T16:19:02.070 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2024-05-03T16:19:02.128 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2024-05-03T16:19:02.128 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9" 2024-05-03T16:19:02.128 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2024-05-03T16:19:02.128 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2024-05-03T16:19:02.128 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9" 2024-05-03T16:19:02.128 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9" 2024-05-03T16:19:02.128 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-03T16:19:02.128 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2024-05-03T16:19:02.128 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon" 2024-05-03T16:19:02.128 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-03T16:19:02.128 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2024-05-03T16:19:02.128 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-03T16:19:02.129 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-03T16:19:02.129 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-03T16:19:02.129 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2024-05-03T16:19:02.144 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-03T16:19:02.154 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-03T16:19:02.200 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-03T16:19:02.200 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-05-03T16:19:02.202 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-05-03T16:19:02.205 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2024-05-03T16:19:02.220 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-03T16:19:02.266 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-03T16:19:02.266 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-05-03T16:19:02.269 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-05-03T16:19:02.271 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2024-05-03T16:19:02.305 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-03T16:19:02.378 INFO:teuthology.run_tasks:Running task kernel... 2024-05-03T16:19:02.396 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-05-03T16:19:02.396 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'mon.c': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, timeout 300 2024-05-03T16:19:02.397 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-03T16:19:02.397 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-03T16:19:02.397 DEBUG:teuthology.orchestra.run.smithi146:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-03T16:19:02.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T16:19:02.414 DEBUG:teuthology.task.kernel:sha1 for mon.c is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T16:19:02.414 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-03T16:19:02.414 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2024-05-03T16:19:02.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T16:19:02.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T16:19:02.416 DEBUG:teuthology.task.kernel:sha1 for mon.a is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T16:19:02.416 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-03T16:19:02.416 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-05-03T16:19:02.416 DEBUG:teuthology.task.kernel:sha1 for mon.b is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T16:19:02.417 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-03T16:19:02.417 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-05-03T16:19:02.470 INFO:teuthology.orchestra.run.smithi146.stdout:5.14.0-437.el9.x86_64 2024-05-03T16:19:02.470 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T16:19:02.471 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-03T16:19:02.471 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T16:19:02.475 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-437.el9.x86_64 2024-05-03T16:19:02.475 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-437.el9.x86_64 2024-05-03T16:19:02.475 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T16:19:02.475 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-03T16:19:02.475 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T16:19:02.476 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T16:19:02.476 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-03T16:19:02.476 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T16:19:02.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum upgrade -y linux-firmware 2024-05-03T16:19:02.624 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum upgrade -y linux-firmware 2024-05-03T16:19:02.700 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum upgrade -y linux-firmware 2024-05-03T16:19:04.852 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-05-03T16:19:04.886 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-05-03T16:19:05.300 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 7.3 MB/s | 8.0 MB 00:01 2024-05-03T16:19:06.947 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:01 2024-05-03T16:19:07.152 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-05-03T16:19:07.223 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-05-03T16:19:11.153 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 6.2 MB 00:00 2024-05-03T16:19:11.161 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-05-03T16:19:12.179 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 6.2 MB 00:01 2024-05-03T16:19:12.770 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-05-03T16:19:13.628 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-05-03T16:19:13.963 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 16 kB 00:00 2024-05-03T16:19:14.213 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-05-03T16:19:15.525 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-05-03T16:19:15.996 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 9.4 MB/s | 21 MB 00:02 2024-05-03T16:19:19.248 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-05-03T16:19:20.648 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-05-03T16:19:21.121 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2024-05-03T16:19:21.289 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-05-03T16:19:21.290 INFO:teuthology.orchestra.run.smithi146.stdout:Nothing to do. 2024-05-03T16:19:21.290 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-05-03T16:19:21.403 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.c... 2024-05-03T16:19:21.403 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T16:19:21.644 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-03T16:19:21.644 DEBUG:teuthology.orchestra.run.smithi146:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-03T16:19:21.647 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi146.front.sepia.ceph.com to complete... 2024-05-03T16:19:22.601 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-05-03T16:19:22.602 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-05-03T16:19:22.602 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-05-03T16:19:22.729 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-05-03T16:19:22.729 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T16:19:22.874 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-03T16:19:22.874 DEBUG:teuthology.orchestra.run.smithi134:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-03T16:19:22.877 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi134.front.sepia.ceph.com to complete... 2024-05-03T16:19:23.095 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-05-03T16:19:23.096 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-05-03T16:19:23.096 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-05-03T16:19:23.218 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-05-03T16:19:23.218 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T16:19:23.360 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-03T16:19:23.360 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-03T16:19:23.363 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi081.front.sepia.ceph.com to complete... 2024-05-03T16:19:46.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03 16:19:46 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-03T16:19:46.650 INFO:teuthology.orchestra.run.smithi146.stderr:FINISHED --2024-05-03 16:19:46-- 2024-05-03T16:19:46.650 INFO:teuthology.orchestra.run.smithi146.stderr:Total wall clock time: 25s 2024-05-03T16:19:46.650 INFO:teuthology.orchestra.run.smithi146.stderr:Downloaded: 1 files, 341M in 25s (13.8 MB/s) 2024-05-03T16:19:46.653 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.c... 2024-05-03T16:19:46.653 DEBUG:teuthology.orchestra.run.smithi146:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-03T16:19:48.796 INFO:teuthology.orchestra.run.smithi146.stdout:Verifying... ######################################## 2024-05-03T16:19:49.009 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing... ######################################## 2024-05-03T16:19:49.196 INFO:teuthology.orchestra.run.smithi146.stdout:Updating / installing... 2024-05-03T16:19:57.184 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-03T16:19:59.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03 16:19:59 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-03T16:19:59.456 INFO:teuthology.orchestra.run.smithi134.stderr:FINISHED --2024-05-03 16:19:59-- 2024-05-03T16:19:59.456 INFO:teuthology.orchestra.run.smithi134.stderr:Total wall clock time: 37s 2024-05-03T16:19:59.456 INFO:teuthology.orchestra.run.smithi134.stderr:Downloaded: 1 files, 341M in 36s (9.45 MB/s) 2024-05-03T16:19:59.458 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-05-03T16:19:59.459 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-03T16:20:01.615 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying... ######################################## 2024-05-03T16:20:01.771 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing... ######################################## 2024-05-03T16:20:01.881 INFO:teuthology.orchestra.run.smithi134.stdout:Updating / installing... 2024-05-03T16:20:08.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03 16:20:08 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-03T16:20:08.756 INFO:teuthology.orchestra.run.smithi081.stderr:FINISHED --2024-05-03 16:20:08-- 2024-05-03T16:20:08.756 INFO:teuthology.orchestra.run.smithi081.stderr:Total wall clock time: 45s 2024-05-03T16:20:08.756 INFO:teuthology.orchestra.run.smithi081.stderr:Downloaded: 1 files, 341M in 45s (7.61 MB/s) 2024-05-03T16:20:08.759 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-05-03T16:20:08.759 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-03T16:20:09.949 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-03T16:20:10.882 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying... ######################################## 2024-05-03T16:20:11.076 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing... ######################################## 2024-05-03T16:20:11.191 INFO:teuthology.orchestra.run.smithi081.stdout:Updating / installing... 2024-05-03T16:20:19.130 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-03T16:20:33.926 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi146.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-03T16:20:33.926 DEBUG:teuthology.orchestra.run.smithi146:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-03T16:20:34.007 INFO:teuthology.orchestra.run.smithi146.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:34.007 INFO:teuthology.orchestra.run.smithi146.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:34.007 INFO:teuthology.orchestra.run.smithi146.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:34.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-03T16:20:34.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-03T16:20:34.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-03T16:20:34.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-03T16:20:34.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-03T16:20:34.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-03T16:20:34.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-03T16:20:34.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-03T16:20:34.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-03T16:20:34.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-03T16:20:34.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-03T16:20:34.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-03T16:20:34.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-03T16:20:34.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-03T16:20:34.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-03T16:20:34.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-03T16:20:34.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-03T16:20:34.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-03T16:20:34.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-03T16:20:34.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-03T16:20:34.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-03T16:20:34.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-03T16:20:34.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-03T16:20:34.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-03T16:20:34.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-03T16:20:34.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-03T16:20:34.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-03T16:20:34.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-03T16:20:34.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-03T16:20:34.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-03T16:20:34.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-03T16:20:34.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-03T16:20:34.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-03T16:20:34.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-03T16:20:34.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-03T16:20:34.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-03T16:20:34.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-03T16:20:34.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-03T16:20:34.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-03T16:20:34.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-03T16:20:34.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-03T16:20:34.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-03T16:20:34.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-03T16:20:34.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-03T16:20:34.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-03T16:20:34.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-03T16:20:34.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-03T16:20:34.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-03T16:20:34.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-03T16:20:34.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-03T16:20:34.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-03T16:20:34.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-03T16:20:34.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-03T16:20:34.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-03T16:20:34.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-03T16:20:34.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-03T16:20:34.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-03T16:20:34.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-03T16:20:34.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-03T16:20:34.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-03T16:20:34.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-03T16:20:34.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-03T16:20:34.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-03T16:20:34.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-03T16:20:34.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-03T16:20:34.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-03T16:20:34.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-03T16:20:34.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-03T16:20:34.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-03T16:20:34.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-03T16:20:34.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-03T16:20:34.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-03T16:20:34.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-03T16:20:34.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-03T16:20:34.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-03T16:20:34.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-03T16:20:34.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-03T16:20:34.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-03T16:20:34.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-03T16:20:34.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-03T16:20:34.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-03T16:20:34.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-03T16:20:34.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-03T16:20:34.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-03T16:20:34.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-03T16:20:34.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-03T16:20:34.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-03T16:20:34.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-03T16:20:34.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-03T16:20:34.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-03T16:20:34.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-03T16:20:34.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-03T16:20:34.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-03T16:20:34.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-03T16:20:34.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-03T16:20:34.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-03T16:20:34.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-03T16:20:34.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-03T16:20:34.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-03T16:20:34.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-03T16:20:34.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-03T16:20:34.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-03T16:20:34.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-03T16:20:34.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-03T16:20:34.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-03T16:20:34.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-03T16:20:34.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-03T16:20:34.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-03T16:20:34.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-03T16:20:34.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-03T16:20:34.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-03T16:20:34.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-03T16:20:34.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-03T16:20:34.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-03T16:20:34.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-03T16:20:34.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-03T16:20:34.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-03T16:20:34.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-03T16:20:34.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-03T16:20:34.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-03T16:20:34.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-03T16:20:34.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-03T16:20:34.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-03T16:20:34.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-03T16:20:34.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-03T16:20:34.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-03T16:20:34.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-03T16:20:34.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-03T16:20:34.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-03T16:20:34.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-03T16:20:34.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-03T16:20:34.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-03T16:20:34.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-03T16:20:34.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-03T16:20:34.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-03T16:20:34.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-03T16:20:34.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-03T16:20:34.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-03T16:20:34.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-03T16:20:34.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-03T16:20:34.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-03T16:20:34.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-03T16:20:34.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-03T16:20:34.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-03T16:20:34.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-03T16:20:34.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-03T16:20:34.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-03T16:20:34.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-03T16:20:34.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-03T16:20:34.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-03T16:20:34.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-03T16:20:34.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-03T16:20:34.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-03T16:20:34.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-03T16:20:34.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-03T16:20:34.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-03T16:20:34.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-03T16:20:34.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-03T16:20:34.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-03T16:20:34.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-03T16:20:34.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-03T16:20:34.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-03T16:20:34.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-03T16:20:34.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-03T16:20:34.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-03T16:20:34.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-03T16:20:34.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-03T16:20:34.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-03T16:20:34.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-03T16:20:34.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-03T16:20:34.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-03T16:20:34.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-03T16:20:34.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-03T16:20:34.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-03T16:20:34.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-03T16:20:34.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-03T16:20:34.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-03T16:20:34.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-03T16:20:34.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-03T16:20:34.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-03T16:20:34.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-03T16:20:34.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-03T16:20:34.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-03T16:20:34.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-03T16:20:34.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-03T16:20:34.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-03T16:20:34.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-03T16:20:34.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-03T16:20:34.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-03T16:20:34.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-03T16:20:34.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-03T16:20:34.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-03T16:20:34.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-03T16:20:34.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-03T16:20:34.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-03T16:20:34.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-03T16:20:34.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-03T16:20:34.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-03T16:20:34.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-03T16:20:34.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-03T16:20:34.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-03T16:20:34.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-03T16:20:34.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-03T16:20:34.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-03T16:20:34.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-03T16:20:34.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-03T16:20:34.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-03T16:20:34.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-03T16:20:34.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-03T16:20:34.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-03T16:20:34.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-03T16:20:34.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-03T16:20:34.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-03T16:20:34.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-03T16:20:34.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-03T16:20:34.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-03T16:20:34.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-03T16:20:34.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-03T16:20:34.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-03T16:20:34.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-03T16:20:34.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-03T16:20:34.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-03T16:20:34.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-03T16:20:34.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-03T16:20:34.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-03T16:20:34.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-03T16:20:34.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-03T16:20:34.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-03T16:20:34.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-03T16:20:34.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-03T16:20:34.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-03T16:20:34.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-03T16:20:34.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-03T16:20:34.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-03T16:20:34.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-03T16:20:34.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-03T16:20:34.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-03T16:20:34.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-03T16:20:34.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-03T16:20:34.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-03T16:20:34.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-03T16:20:34.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-03T16:20:34.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-03T16:20:34.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-03T16:20:34.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-03T16:20:34.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-03T16:20:34.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-03T16:20:34.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-03T16:20:34.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-03T16:20:34.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-03T16:20:34.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-03T16:20:34.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-03T16:20:34.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-03T16:20:34.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-03T16:20:34.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-03T16:20:34.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-03T16:20:34.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-03T16:20:34.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-03T16:20:34.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-03T16:20:34.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-03T16:20:34.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-03T16:20:34.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-03T16:20:34.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-03T16:20:34.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-03T16:20:34.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-03T16:20:34.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-03T16:20:34.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-03T16:20:34.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-03T16:20:34.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-03T16:20:34.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-03T16:20:34.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-03T16:20:34.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-03T16:20:34.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-03T16:20:34.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-03T16:20:34.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-03T16:20:34.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-03T16:20:34.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-03T16:20:34.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-03T16:20:34.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-03T16:20:34.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-03T16:20:34.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-03T16:20:34.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-03T16:20:34.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-03T16:20:34.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-03T16:20:34.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-03T16:20:34.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-03T16:20:34.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-03T16:20:34.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-03T16:20:34.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-03T16:20:34.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-03T16:20:34.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-03T16:20:34.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-03T16:20:34.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-03T16:20:34.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-03T16:20:34.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-03T16:20:34.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-03T16:20:34.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-03T16:20:34.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-03T16:20:34.028 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-03T16:20:34.028 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-03T16:20:34.028 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-03T16:20:34.028 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-03T16:20:34.028 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-03T16:20:34.028 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-03T16:20:34.028 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-03T16:20:34.028 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-03T16:20:34.028 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-03T16:20:34.028 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-03T16:20:34.028 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-03T16:20:34.028 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-03T16:20:34.028 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-03T16:20:34.028 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-03T16:20:34.029 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-03T16:20:34.029 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-03T16:20:34.029 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-03T16:20:34.029 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-03T16:20:34.029 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-03T16:20:34.029 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-03T16:20:34.029 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-03T16:20:34.029 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-03T16:20:34.029 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-03T16:20:34.029 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-03T16:20:34.029 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-03T16:20:34.029 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-03T16:20:34.029 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-03T16:20:34.029 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-03T16:20:34.030 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-03T16:20:34.030 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-03T16:20:34.030 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-03T16:20:34.030 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-03T16:20:34.030 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-03T16:20:34.030 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-03T16:20:34.030 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-03T16:20:34.030 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-03T16:20:34.030 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-03T16:20:34.030 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-03T16:20:34.030 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-03T16:20:34.030 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-03T16:20:34.030 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-03T16:20:34.030 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-03T16:20:34.030 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-03T16:20:34.031 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-03T16:20:34.031 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-03T16:20:34.031 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-03T16:20:34.031 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-03T16:20:34.031 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-03T16:20:34.031 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-03T16:20:34.031 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-03T16:20:34.031 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-03T16:20:34.031 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-03T16:20:34.031 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-03T16:20:34.031 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-03T16:20:34.031 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-03T16:20:34.031 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-03T16:20:34.031 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-03T16:20:34.032 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-03T16:20:34.032 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-03T16:20:34.032 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-03T16:20:34.032 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-03T16:20:34.032 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-03T16:20:34.032 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-03T16:20:34.032 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-03T16:20:34.032 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-03T16:20:34.032 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-03T16:20:34.032 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-03T16:20:34.032 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-03T16:20:34.032 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-03T16:20:34.032 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-03T16:20:34.032 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-03T16:20:34.033 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-03T16:20:34.033 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-03T16:20:34.033 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-03T16:20:34.033 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-03T16:20:34.033 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-03T16:20:34.033 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-03T16:20:34.033 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-03T16:20:34.033 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-03T16:20:34.033 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-03T16:20:34.033 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-03T16:20:34.033 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-03T16:20:34.033 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-03T16:20:34.033 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-03T16:20:34.033 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-03T16:20:34.034 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-03T16:20:34.034 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-03T16:20:34.034 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-03T16:20:34.034 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-03T16:20:34.034 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-03T16:20:34.034 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-03T16:20:34.034 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-03T16:20:34.034 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-03T16:20:34.034 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-03T16:20:34.034 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-03T16:20:34.034 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-03T16:20:34.034 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-03T16:20:34.034 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-03T16:20:34.034 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-03T16:20:34.035 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-03T16:20:34.035 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-03T16:20:34.035 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-03T16:20:34.035 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-03T16:20:34.035 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-03T16:20:34.035 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-03T16:20:34.035 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-03T16:20:34.035 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-03T16:20:34.035 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-03T16:20:34.035 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-03T16:20:34.035 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-03T16:20:34.035 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-03T16:20:34.035 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-03T16:20:34.035 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-03T16:20:34.036 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-03T16:20:34.036 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-03T16:20:34.036 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-03T16:20:34.036 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-03T16:20:34.036 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-03T16:20:34.036 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-03T16:20:34.036 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-03T16:20:34.036 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-03T16:20:34.036 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-03T16:20:34.036 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-03T16:20:34.036 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-03T16:20:34.036 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-03T16:20:34.036 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-03T16:20:34.036 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-03T16:20:34.036 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-03T16:20:34.036 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-03T16:20:34.037 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-03T16:20:34.037 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-03T16:20:34.037 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-03T16:20:34.037 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-03T16:20:34.037 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-03T16:20:34.037 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-03T16:20:34.037 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-03T16:20:34.037 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-03T16:20:34.037 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-03T16:20:34.037 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-03T16:20:34.037 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-03T16:20:34.037 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-03T16:20:34.037 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-03T16:20:34.037 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-03T16:20:34.037 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-03T16:20:34.038 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-03T16:20:34.038 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-03T16:20:34.038 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-03T16:20:34.038 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-03T16:20:34.038 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-03T16:20:34.038 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-03T16:20:34.038 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-03T16:20:34.038 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-03T16:20:34.038 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-03T16:20:34.038 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-03T16:20:34.038 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-03T16:20:34.038 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-03T16:20:34.038 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-03T16:20:34.038 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-03T16:20:34.039 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-03T16:20:34.039 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-03T16:20:34.039 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-03T16:20:34.039 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-03T16:20:34.039 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-03T16:20:34.039 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-03T16:20:34.039 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-03T16:20:34.039 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-03T16:20:34.039 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-03T16:20:34.039 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-03T16:20:34.039 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-03T16:20:34.039 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-03T16:20:34.039 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-03T16:20:34.039 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-03T16:20:34.040 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-03T16:20:34.040 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-03T16:20:34.040 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-03T16:20:34.040 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-03T16:20:34.040 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-03T16:20:34.040 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-03T16:20:34.040 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-03T16:20:34.040 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-03T16:20:34.040 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-03T16:20:34.040 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-03T16:20:34.040 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-03T16:20:34.040 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-03T16:20:34.040 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-03T16:20:34.040 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-03T16:20:34.041 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-03T16:20:34.041 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-03T16:20:34.041 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-03T16:20:34.041 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-03T16:20:34.041 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-03T16:20:34.041 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-03T16:20:34.041 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-03T16:20:34.041 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-03T16:20:34.041 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-03T16:20:34.041 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-03T16:20:34.041 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-03T16:20:34.041 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-03T16:20:34.041 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-03T16:20:34.041 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-03T16:20:34.041 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-03T16:20:34.041 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-03T16:20:34.042 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-03T16:20:34.042 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-03T16:20:34.042 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-03T16:20:34.042 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-03T16:20:34.042 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-03T16:20:34.042 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-03T16:20:34.042 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-03T16:20:34.042 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-03T16:20:34.042 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-03T16:20:34.042 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-03T16:20:34.042 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-03T16:20:34.042 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-03T16:20:34.042 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-03T16:20:34.042 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-03T16:20:34.043 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-03T16:20:34.043 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-03T16:20:34.043 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-03T16:20:34.043 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-03T16:20:34.043 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-03T16:20:34.043 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-03T16:20:34.043 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-03T16:20:34.043 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-03T16:20:34.043 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-03T16:20:34.043 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-03T16:20:34.043 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-03T16:20:34.043 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-03T16:20:34.043 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-03T16:20:34.043 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-03T16:20:34.043 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-03T16:20:34.044 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-03T16:20:34.044 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-03T16:20:34.044 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-03T16:20:34.044 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-03T16:20:34.044 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-03T16:20:34.044 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-03T16:20:34.044 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-03T16:20:34.044 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-03T16:20:34.044 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-03T16:20:34.044 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-03T16:20:34.044 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-03T16:20:34.044 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-03T16:20:34.044 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-03T16:20:34.044 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-03T16:20:34.044 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-03T16:20:34.044 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-03T16:20:34.045 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-03T16:20:34.045 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-03T16:20:34.045 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-03T16:20:34.045 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-03T16:20:34.045 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-03T16:20:34.045 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-03T16:20:34.045 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-03T16:20:34.045 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-03T16:20:34.045 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-03T16:20:34.045 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-03T16:20:34.045 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-03T16:20:34.045 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-03T16:20:34.045 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-03T16:20:34.045 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-03T16:20:34.045 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-03T16:20:34.045 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-03T16:20:34.046 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-03T16:20:34.046 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-03T16:20:34.046 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-03T16:20:34.046 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-03T16:20:34.046 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-03T16:20:34.046 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-03T16:20:34.046 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-03T16:20:34.046 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-03T16:20:34.046 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-03T16:20:34.046 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-03T16:20:34.046 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-03T16:20:34.046 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-03T16:20:34.046 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-03T16:20:34.046 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-03T16:20:34.047 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-03T16:20:34.047 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-03T16:20:34.047 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-03T16:20:34.047 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-03T16:20:34.047 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-03T16:20:34.047 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-03T16:20:34.047 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-03T16:20:34.047 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-03T16:20:34.047 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-03T16:20:34.047 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-03T16:20:34.047 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-03T16:20:34.047 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-03T16:20:34.047 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-03T16:20:34.047 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-03T16:20:34.047 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-03T16:20:34.048 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-03T16:20:34.048 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-03T16:20:34.048 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-03T16:20:34.048 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-03T16:20:34.048 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-03T16:20:34.048 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-03T16:20:34.048 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-03T16:20:34.048 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-03T16:20:34.048 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-03T16:20:34.048 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-03T16:20:34.048 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-03T16:20:34.048 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-03T16:20:34.048 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-03T16:20:34.048 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-03T16:20:34.048 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-03T16:20:34.048 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-03T16:20:34.049 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-03T16:20:34.049 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-03T16:20:34.049 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-03T16:20:34.049 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-03T16:20:34.049 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-03T16:20:34.049 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-03T16:20:34.049 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-03T16:20:34.049 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-03T16:20:34.049 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-03T16:20:34.049 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-03T16:20:34.049 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-03T16:20:34.049 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-03T16:20:34.049 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-03T16:20:34.049 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-03T16:20:34.049 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-03T16:20:34.050 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-03T16:20:34.050 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-03T16:20:34.050 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-03T16:20:34.050 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-03T16:20:34.050 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-03T16:20:34.050 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-03T16:20:34.050 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-03T16:20:34.050 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-03T16:20:34.050 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-03T16:20:34.050 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-03T16:20:34.050 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-03T16:20:34.050 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-03T16:20:34.050 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-03T16:20:34.050 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-03T16:20:34.051 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-03T16:20:34.051 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-03T16:20:34.051 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-03T16:20:34.051 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-03T16:20:34.051 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-03T16:20:34.051 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-03T16:20:34.051 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-03T16:20:34.051 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-03T16:20:34.051 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-03T16:20:34.051 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-03T16:20:34.051 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-03T16:20:34.051 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-03T16:20:34.051 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-03T16:20:34.051 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-03T16:20:34.051 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-03T16:20:34.052 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-03T16:20:34.052 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-03T16:20:34.052 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-03T16:20:34.052 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-03T16:20:34.052 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-03T16:20:34.052 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-03T16:20:34.052 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-03T16:20:34.052 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-03T16:20:34.052 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-03T16:20:34.052 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-03T16:20:34.052 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-03T16:20:34.052 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-03T16:20:34.052 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-03T16:20:34.052 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-03T16:20:34.052 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-03T16:20:34.053 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-03T16:20:34.053 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-03T16:20:34.053 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-03T16:20:34.053 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-03T16:20:34.053 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-03T16:20:34.053 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-03T16:20:34.053 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-03T16:20:34.053 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-03T16:20:34.053 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-03T16:20:34.053 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-03T16:20:34.053 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-03T16:20:34.053 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-03T16:20:34.053 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-03T16:20:34.053 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-03T16:20:34.053 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-03T16:20:34.054 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-03T16:20:34.054 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-03T16:20:34.054 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-03T16:20:34.054 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-03T16:20:34.054 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-03T16:20:34.054 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-03T16:20:34.054 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-03T16:20:34.054 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-03T16:20:34.054 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-03T16:20:34.054 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-03T16:20:34.054 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-03T16:20:34.054 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-03T16:20:34.054 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-03T16:20:34.054 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-03T16:20:34.054 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-03T16:20:34.055 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-03T16:20:34.055 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-03T16:20:34.055 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-03T16:20:34.055 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-03T16:20:34.055 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-03T16:20:34.055 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-03T16:20:34.055 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-03T16:20:34.055 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-03T16:20:34.055 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-03T16:20:34.055 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-03T16:20:34.055 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-03T16:20:34.055 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-03T16:20:34.055 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-03T16:20:34.055 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-03T16:20:34.055 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-03T16:20:34.055 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-03T16:20:34.056 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-03T16:20:34.056 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-03T16:20:34.056 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-03T16:20:34.056 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-03T16:20:34.056 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-03T16:20:34.056 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-03T16:20:34.056 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-03T16:20:34.056 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-03T16:20:34.056 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-03T16:20:34.056 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-03T16:20:34.056 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-03T16:20:34.056 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-03T16:20:34.056 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-03T16:20:34.056 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-03T16:20:34.056 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-03T16:20:34.057 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-03T16:20:34.057 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-03T16:20:34.057 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-03T16:20:34.057 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-03T16:20:34.057 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-03T16:20:34.057 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-03T16:20:34.057 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-03T16:20:34.057 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-03T16:20:34.057 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-03T16:20:34.057 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-03T16:20:34.057 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-03T16:20:34.057 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-03T16:20:34.057 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-03T16:20:34.057 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-03T16:20:34.057 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-03T16:20:34.058 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-03T16:20:34.058 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-03T16:20:34.058 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-03T16:20:34.058 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-03T16:20:34.058 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-03T16:20:34.058 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-03T16:20:34.058 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-03T16:20:34.058 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-03T16:20:34.058 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-03T16:20:34.058 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-03T16:20:34.058 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-03T16:20:34.058 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-03T16:20:34.058 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-03T16:20:34.058 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-03T16:20:34.059 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-03T16:20:34.059 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-03T16:20:34.059 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-03T16:20:34.059 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-03T16:20:34.059 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-03T16:20:34.059 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-03T16:20:34.059 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-03T16:20:34.059 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-03T16:20:34.059 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-03T16:20:34.059 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-03T16:20:34.059 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-03T16:20:34.059 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-03T16:20:34.059 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-03T16:20:34.059 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-03T16:20:34.059 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-03T16:20:34.060 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-03T16:20:34.060 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-03T16:20:34.060 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-03T16:20:34.060 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-03T16:20:34.060 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-03T16:20:34.060 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-03T16:20:34.060 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-03T16:20:34.060 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-03T16:20:34.060 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-03T16:20:34.060 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-03T16:20:34.060 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-03T16:20:34.060 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-03T16:20:34.060 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-03T16:20:34.060 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-03T16:20:34.060 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-03T16:20:34.061 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-03T16:20:34.061 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-03T16:20:34.061 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-03T16:20:34.061 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-03T16:20:34.061 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-03T16:20:34.061 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-03T16:20:34.061 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-03T16:20:34.061 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-03T16:20:34.061 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-03T16:20:34.061 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-03T16:20:34.061 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-03T16:20:34.061 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-03T16:20:34.061 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-03T16:20:34.061 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-03T16:20:34.061 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-03T16:20:34.062 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-03T16:20:34.062 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-03T16:20:34.062 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-03T16:20:34.062 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-03T16:20:34.062 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-03T16:20:34.062 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-03T16:20:34.062 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-03T16:20:34.062 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-03T16:20:34.062 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-03T16:20:34.062 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-03T16:20:34.062 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-03T16:20:34.062 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-03T16:20:34.062 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-03T16:20:34.062 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-03T16:20:34.063 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-03T16:20:34.063 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-03T16:20:34.063 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-03T16:20:34.063 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-03T16:20:34.063 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-03T16:20:34.063 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-03T16:20:34.063 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-03T16:20:34.063 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-03T16:20:34.063 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-03T16:20:34.063 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-03T16:20:34.063 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-03T16:20:34.063 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-03T16:20:34.063 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-03T16:20:34.063 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-03T16:20:34.063 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-03T16:20:34.064 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-03T16:20:34.064 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-03T16:20:34.064 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-03T16:20:34.064 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-03T16:20:34.064 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-03T16:20:34.064 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-03T16:20:34.064 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-03T16:20:34.064 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-03T16:20:34.064 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-03T16:20:34.064 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-03T16:20:34.064 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-03T16:20:34.064 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-03T16:20:34.064 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-03T16:20:34.064 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-03T16:20:34.064 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-03T16:20:34.064 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-03T16:20:34.064 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-03T16:20:34.065 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-03T16:20:34.065 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-03T16:20:34.065 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-03T16:20:34.065 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-03T16:20:34.065 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-03T16:20:34.065 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-03T16:20:34.065 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-03T16:20:34.065 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-03T16:20:34.065 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-03T16:20:34.065 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-03T16:20:34.065 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-03T16:20:34.065 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-03T16:20:34.065 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-03T16:20:34.065 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-03T16:20:34.066 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-03T16:20:34.066 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-03T16:20:34.066 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-03T16:20:34.066 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-03T16:20:34.066 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-03T16:20:34.066 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-03T16:20:34.066 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-03T16:20:34.066 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-03T16:20:34.066 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-03T16:20:34.066 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-03T16:20:34.066 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-03T16:20:34.066 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-03T16:20:34.066 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-03T16:20:34.066 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-03T16:20:34.067 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-03T16:20:34.067 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-03T16:20:34.067 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-03T16:20:34.067 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-03T16:20:34.067 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-03T16:20:34.067 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-03T16:20:34.067 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-03T16:20:34.067 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-03T16:20:34.067 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-03T16:20:34.067 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-03T16:20:34.067 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-03T16:20:34.067 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-03T16:20:34.067 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-03T16:20:34.067 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-03T16:20:34.068 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-03T16:20:34.068 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-03T16:20:34.068 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-03T16:20:34.068 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-03T16:20:34.068 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-03T16:20:34.068 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-03T16:20:34.068 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-03T16:20:34.068 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-03T16:20:34.068 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-03T16:20:34.068 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-03T16:20:34.068 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-03T16:20:34.068 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-03T16:20:34.068 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-03T16:20:34.068 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-03T16:20:34.068 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-03T16:20:34.068 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-03T16:20:34.069 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-03T16:20:34.069 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-03T16:20:34.069 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-03T16:20:34.069 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-03T16:20:34.069 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-03T16:20:34.069 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-03T16:20:34.069 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-03T16:20:34.069 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-03T16:20:34.069 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-03T16:20:34.069 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-03T16:20:34.069 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-03T16:20:34.069 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-03T16:20:34.069 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-03T16:20:34.069 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-03T16:20:34.070 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-03T16:20:34.070 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-03T16:20:34.070 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-03T16:20:34.070 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-03T16:20:34.070 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-03T16:20:34.070 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-03T16:20:34.070 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-03T16:20:34.070 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-03T16:20:34.070 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-03T16:20:34.070 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-03T16:20:34.070 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-03T16:20:34.070 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-03T16:20:34.070 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-03T16:20:34.071 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-03T16:20:34.071 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-03T16:20:34.071 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-03T16:20:34.071 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-03T16:20:34.071 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-03T16:20:34.071 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-03T16:20:34.071 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-03T16:20:34.071 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-03T16:20:34.071 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-03T16:20:34.071 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-03T16:20:34.071 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-03T16:20:34.071 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-03T16:20:34.071 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-03T16:20:34.071 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-03T16:20:34.072 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-03T16:20:34.072 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-03T16:20:34.072 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-03T16:20:34.072 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-03T16:20:34.072 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-03T16:20:34.072 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-03T16:20:34.072 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-03T16:20:34.072 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-03T16:20:34.072 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-03T16:20:34.072 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-03T16:20:34.072 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-03T16:20:34.072 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-03T16:20:34.072 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-03T16:20:34.072 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-03T16:20:34.072 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-03T16:20:34.073 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-03T16:20:34.073 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-03T16:20:34.073 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-03T16:20:34.073 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-03T16:20:34.073 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-03T16:20:34.073 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-03T16:20:34.073 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-03T16:20:34.073 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-03T16:20:34.073 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-03T16:20:34.073 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-03T16:20:34.073 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-03T16:20:34.073 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-03T16:20:34.073 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-03T16:20:34.073 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-03T16:20:34.073 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-03T16:20:34.073 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-03T16:20:34.073 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-03T16:20:34.074 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-03T16:20:34.074 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-03T16:20:34.074 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-03T16:20:34.074 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-03T16:20:34.074 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-03T16:20:34.074 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-03T16:20:34.074 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-03T16:20:34.074 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-03T16:20:34.074 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-03T16:20:34.074 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-03T16:20:34.074 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-03T16:20:34.074 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-03T16:20:34.074 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-03T16:20:34.075 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-03T16:20:34.075 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-03T16:20:34.075 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-03T16:20:34.075 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-03T16:20:34.075 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-03T16:20:34.075 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-03T16:20:34.075 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-03T16:20:34.075 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-03T16:20:34.075 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-03T16:20:34.075 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-03T16:20:34.075 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-03T16:20:34.075 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-03T16:20:34.075 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-03T16:20:34.075 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-03T16:20:34.075 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-03T16:20:34.076 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-03T16:20:34.076 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-03T16:20:34.076 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-03T16:20:34.076 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-03T16:20:34.076 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-03T16:20:34.076 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-03T16:20:34.076 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-03T16:20:34.076 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-03T16:20:34.076 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-03T16:20:34.076 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-03T16:20:34.076 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-03T16:20:34.076 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-03T16:20:34.076 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-03T16:20:34.076 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-03T16:20:34.076 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-03T16:20:34.077 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-03T16:20:34.077 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-03T16:20:34.077 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-03T16:20:34.077 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-03T16:20:34.077 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-03T16:20:34.077 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-03T16:20:34.077 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-03T16:20:34.077 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-03T16:20:34.077 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-03T16:20:34.077 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-03T16:20:34.077 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-03T16:20:34.077 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-03T16:20:34.077 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-03T16:20:34.077 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-03T16:20:34.078 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-03T16:20:34.078 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-03T16:20:34.078 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-03T16:20:34.078 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-03T16:20:34.078 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-03T16:20:34.078 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-03T16:20:34.078 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-03T16:20:34.078 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-03T16:20:34.078 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-03T16:20:34.078 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-03T16:20:34.078 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-03T16:20:34.078 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-03T16:20:34.078 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-03T16:20:34.078 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-03T16:20:34.079 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-03T16:20:34.079 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-03T16:20:34.079 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-03T16:20:34.079 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-03T16:20:34.079 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-03T16:20:34.079 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-03T16:20:34.079 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-03T16:20:34.079 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-03T16:20:34.079 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-03T16:20:34.079 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-03T16:20:34.079 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-03T16:20:34.079 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-03T16:20:34.079 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-03T16:20:34.079 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-03T16:20:34.080 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-03T16:20:34.080 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-03T16:20:34.080 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-03T16:20:34.080 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-03T16:20:34.080 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-03T16:20:34.080 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-03T16:20:34.080 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-03T16:20:34.080 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-03T16:20:34.080 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-03T16:20:34.080 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-03T16:20:34.080 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-03T16:20:34.080 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-03T16:20:34.080 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-03T16:20:34.080 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-03T16:20:34.080 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-03T16:20:34.081 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-03T16:20:34.081 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-03T16:20:34.081 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-03T16:20:34.081 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-03T16:20:34.081 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-03T16:20:34.081 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-03T16:20:34.081 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-03T16:20:34.081 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-03T16:20:34.081 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-03T16:20:34.081 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-03T16:20:34.081 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-03T16:20:34.081 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-03T16:20:34.081 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-03T16:20:34.081 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-03T16:20:34.082 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-03T16:20:34.082 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-03T16:20:34.082 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-03T16:20:34.082 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-03T16:20:34.082 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-03T16:20:34.082 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-03T16:20:34.082 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-03T16:20:34.082 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-03T16:20:34.082 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-03T16:20:34.082 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-03T16:20:34.082 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-03T16:20:34.082 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-03T16:20:34.082 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-03T16:20:34.082 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-03T16:20:34.082 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-03T16:20:34.083 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-03T16:20:34.083 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-03T16:20:34.083 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-03T16:20:34.083 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-03T16:20:34.083 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-03T16:20:34.083 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-03T16:20:34.083 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-03T16:20:34.083 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-03T16:20:34.083 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-03T16:20:34.083 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-03T16:20:34.083 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-03T16:20:34.083 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-03T16:20:34.083 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-03T16:20:34.083 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-03T16:20:34.084 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-03T16:20:34.084 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-03T16:20:34.084 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-03T16:20:34.084 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-03T16:20:34.084 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-03T16:20:34.084 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-03T16:20:34.084 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-03T16:20:34.084 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-03T16:20:34.084 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-03T16:20:34.084 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-03T16:20:34.084 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-03T16:20:34.084 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-03T16:20:34.084 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-03T16:20:34.084 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-03T16:20:34.084 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-03T16:20:34.085 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-03T16:20:34.085 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-03T16:20:34.085 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-03T16:20:34.085 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-03T16:20:34.085 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-03T16:20:34.085 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-03T16:20:34.085 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-03T16:20:34.085 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-03T16:20:34.085 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-03T16:20:34.085 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-03T16:20:34.085 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-03T16:20:34.085 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-03T16:20:34.085 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-03T16:20:34.085 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-03T16:20:34.085 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-03T16:20:34.086 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-03T16:20:34.086 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-03T16:20:34.086 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-03T16:20:34.086 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-03T16:20:34.086 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-03T16:20:34.086 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-03T16:20:34.086 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-03T16:20:34.086 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-03T16:20:34.086 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-03T16:20:34.086 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-03T16:20:34.086 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-03T16:20:34.086 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-03T16:20:34.087 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-03T16:20:34.087 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-03T16:20:34.087 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-03T16:20:34.087 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-03T16:20:34.087 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-03T16:20:34.087 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-03T16:20:34.087 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-03T16:20:34.087 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-03T16:20:34.087 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-03T16:20:34.087 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-03T16:20:34.087 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-03T16:20:34.087 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-03T16:20:34.087 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-03T16:20:34.087 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-03T16:20:34.088 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-03T16:20:34.088 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-03T16:20:34.088 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-03T16:20:34.088 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-03T16:20:34.088 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-03T16:20:34.088 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-03T16:20:34.088 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-03T16:20:34.088 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-03T16:20:34.088 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-03T16:20:34.088 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-03T16:20:34.088 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-03T16:20:34.088 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-03T16:20:34.088 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-03T16:20:34.088 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-03T16:20:34.088 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-03T16:20:34.089 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-03T16:20:34.089 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-03T16:20:34.089 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-03T16:20:34.089 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-03T16:20:34.089 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-03T16:20:34.089 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-03T16:20:34.089 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-03T16:20:34.089 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-03T16:20:34.089 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-03T16:20:34.089 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-03T16:20:34.089 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-03T16:20:34.089 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-03T16:20:34.089 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-03T16:20:34.089 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-03T16:20:34.089 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-03T16:20:34.090 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-03T16:20:34.090 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-03T16:20:34.090 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-03T16:20:34.090 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-03T16:20:34.090 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-03T16:20:34.090 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-03T16:20:34.090 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-03T16:20:34.090 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-03T16:20:34.090 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-03T16:20:34.090 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-03T16:20:34.090 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-03T16:20:34.090 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-03T16:20:34.090 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-03T16:20:34.090 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-03T16:20:34.091 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-03T16:20:34.091 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-03T16:20:34.091 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-03T16:20:34.091 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-03T16:20:34.091 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-03T16:20:34.091 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-03T16:20:34.091 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-03T16:20:34.091 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-03T16:20:34.091 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-03T16:20:34.091 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-03T16:20:34.091 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-03T16:20:34.091 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-03T16:20:34.091 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-03T16:20:34.091 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-03T16:20:34.092 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-03T16:20:34.092 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-03T16:20:34.092 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-03T16:20:34.092 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-03T16:20:34.092 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-03T16:20:34.092 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-03T16:20:34.092 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-03T16:20:34.092 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-03T16:20:34.092 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-03T16:20:34.092 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-03T16:20:34.092 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-03T16:20:34.092 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-03T16:20:34.092 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-03T16:20:34.092 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-03T16:20:34.093 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-03T16:20:34.093 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-03T16:20:34.093 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-03T16:20:34.093 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-03T16:20:34.093 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-03T16:20:34.093 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-03T16:20:34.093 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-03T16:20:34.093 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-03T16:20:34.093 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-03T16:20:34.093 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-03T16:20:34.093 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-03T16:20:34.093 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-03T16:20:34.093 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-03T16:20:34.094 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-03T16:20:34.094 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-03T16:20:34.094 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-03T16:20:34.094 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-03T16:20:34.094 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-03T16:20:34.094 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-03T16:20:34.094 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-03T16:20:34.094 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-03T16:20:34.094 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-03T16:20:34.094 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-03T16:20:34.094 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-03T16:20:34.094 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-03T16:20:34.094 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-03T16:20:34.094 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-03T16:20:34.095 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-03T16:20:34.095 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-03T16:20:34.095 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-03T16:20:34.095 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-03T16:20:34.095 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-03T16:20:34.095 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-03T16:20:34.095 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-03T16:20:34.095 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-03T16:20:34.095 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-03T16:20:34.095 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-03T16:20:34.095 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-03T16:20:34.095 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-03T16:20:34.095 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-03T16:20:34.095 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-03T16:20:34.096 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-03T16:20:34.096 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-03T16:20:34.096 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-03T16:20:34.096 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-03T16:20:34.096 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-03T16:20:34.096 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-03T16:20:34.096 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-03T16:20:34.096 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-03T16:20:34.096 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-03T16:20:34.096 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-03T16:20:34.096 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-03T16:20:34.096 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-03T16:20:34.096 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-03T16:20:34.096 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-03T16:20:34.096 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-03T16:20:34.096 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-03T16:20:34.097 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-03T16:20:34.097 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-03T16:20:34.097 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-03T16:20:34.097 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-03T16:20:34.097 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-03T16:20:34.097 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-03T16:20:34.097 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-03T16:20:34.097 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-03T16:20:34.097 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-03T16:20:34.097 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-03T16:20:34.097 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-03T16:20:34.097 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-03T16:20:34.097 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-03T16:20:34.097 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-03T16:20:34.097 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-03T16:20:34.098 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-03T16:20:34.098 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-03T16:20:34.098 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-03T16:20:34.098 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-03T16:20:34.098 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-03T16:20:34.098 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-03T16:20:34.098 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-03T16:20:34.098 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-03T16:20:34.098 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-03T16:20:34.098 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-03T16:20:34.098 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-03T16:20:34.098 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-03T16:20:34.098 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-03T16:20:34.099 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-03T16:20:34.099 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-03T16:20:34.099 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-03T16:20:34.099 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-03T16:20:34.099 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-03T16:20:34.099 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-03T16:20:34.099 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-03T16:20:34.099 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-03T16:20:34.099 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-03T16:20:34.099 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-03T16:20:34.099 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-03T16:20:34.099 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-03T16:20:34.099 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-03T16:20:34.099 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-03T16:20:34.100 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-03T16:20:34.100 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-03T16:20:34.100 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-03T16:20:34.100 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-03T16:20:34.100 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-03T16:20:34.100 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-03T16:20:34.100 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-03T16:20:34.100 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-03T16:20:34.100 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-03T16:20:34.100 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-03T16:20:34.100 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-03T16:20:34.100 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-03T16:20:34.100 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-03T16:20:34.100 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-03T16:20:34.100 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-03T16:20:34.101 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-03T16:20:34.101 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-03T16:20:34.101 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-03T16:20:34.101 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-03T16:20:34.101 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-03T16:20:34.101 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-03T16:20:34.101 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-03T16:20:34.101 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-03T16:20:34.101 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-03T16:20:34.101 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-03T16:20:34.101 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-03T16:20:34.101 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-03T16:20:34.101 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-03T16:20:34.101 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-03T16:20:34.101 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-03T16:20:34.102 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-03T16:20:34.102 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-03T16:20:34.102 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-03T16:20:34.102 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-03T16:20:34.102 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-03T16:20:34.102 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-03T16:20:34.102 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-03T16:20:34.102 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-03T16:20:34.102 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-03T16:20:34.102 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-03T16:20:34.102 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-03T16:20:34.102 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-03T16:20:34.102 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-03T16:20:34.102 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-03T16:20:34.103 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-03T16:20:34.103 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-03T16:20:34.103 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-03T16:20:34.103 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-03T16:20:34.103 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-03T16:20:34.103 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-03T16:20:34.103 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-03T16:20:34.103 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-03T16:20:34.103 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-03T16:20:34.103 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-03T16:20:34.103 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-03T16:20:34.103 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-03T16:20:34.103 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-03T16:20:34.103 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-03T16:20:34.103 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-03T16:20:34.103 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-03T16:20:34.104 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-03T16:20:34.104 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-03T16:20:34.104 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-03T16:20:34.104 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-03T16:20:34.104 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-03T16:20:34.104 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-03T16:20:34.104 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-03T16:20:34.104 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-03T16:20:34.104 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-03T16:20:34.104 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-03T16:20:34.104 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-03T16:20:34.104 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-03T16:20:34.104 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-03T16:20:34.104 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-03T16:20:34.104 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-03T16:20:34.105 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-03T16:20:34.105 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-03T16:20:34.105 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-03T16:20:34.105 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-03T16:20:34.105 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-03T16:20:34.105 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-03T16:20:34.105 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-03T16:20:34.105 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-03T16:20:34.105 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-03T16:20:34.105 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-03T16:20:34.105 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-03T16:20:34.105 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-03T16:20:34.105 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-03T16:20:34.105 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-03T16:20:34.106 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-03T16:20:34.106 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-03T16:20:34.106 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-03T16:20:34.106 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-03T16:20:34.106 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-03T16:20:34.106 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-03T16:20:34.106 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-03T16:20:34.106 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-03T16:20:34.106 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-03T16:20:34.106 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-03T16:20:34.106 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-03T16:20:34.106 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-03T16:20:34.106 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-03T16:20:34.106 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-03T16:20:34.106 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-03T16:20:34.107 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-03T16:20:34.107 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-03T16:20:34.107 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-03T16:20:34.107 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-03T16:20:34.107 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-03T16:20:34.107 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-03T16:20:34.107 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-03T16:20:34.107 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-03T16:20:34.107 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-03T16:20:34.107 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-03T16:20:34.107 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-03T16:20:34.107 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-03T16:20:34.107 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-03T16:20:34.107 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-03T16:20:34.108 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-03T16:20:34.108 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-03T16:20:34.108 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-03T16:20:34.108 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-03T16:20:34.108 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-03T16:20:34.108 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-03T16:20:34.108 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-03T16:20:34.108 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-03T16:20:34.108 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-03T16:20:34.108 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-03T16:20:34.108 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-03T16:20:34.108 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-03T16:20:34.108 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-03T16:20:34.108 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-03T16:20:34.108 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-03T16:20:34.109 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-03T16:20:34.109 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-03T16:20:34.109 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-03T16:20:34.109 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-03T16:20:34.109 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-03T16:20:34.109 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-03T16:20:34.109 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-03T16:20:34.109 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-03T16:20:34.109 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-03T16:20:34.109 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-03T16:20:34.109 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-03T16:20:34.109 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-03T16:20:34.109 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-03T16:20:34.109 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-03T16:20:34.110 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-03T16:20:34.110 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-03T16:20:34.110 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-03T16:20:34.110 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-03T16:20:34.110 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-03T16:20:34.110 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-03T16:20:34.110 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-03T16:20:34.110 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-03T16:20:34.110 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-03T16:20:34.110 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-03T16:20:34.110 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-03T16:20:34.110 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-03T16:20:34.110 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-03T16:20:34.111 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-03T16:20:34.111 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-03T16:20:34.111 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-03T16:20:34.111 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-03T16:20:34.111 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-03T16:20:34.111 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-03T16:20:34.111 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-03T16:20:34.111 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-03T16:20:34.111 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-03T16:20:34.111 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-03T16:20:34.111 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-03T16:20:34.111 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-03T16:20:34.111 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-03T16:20:34.112 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-03T16:20:34.112 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-03T16:20:34.112 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-03T16:20:34.112 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-03T16:20:34.112 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-03T16:20:34.112 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-03T16:20:34.112 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-03T16:20:34.112 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-03T16:20:34.112 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-03T16:20:34.112 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-03T16:20:34.112 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-03T16:20:34.112 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-03T16:20:34.112 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-03T16:20:34.112 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-03T16:20:34.112 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-03T16:20:34.113 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-03T16:20:34.113 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-03T16:20:34.113 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-03T16:20:34.113 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-03T16:20:34.113 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-03T16:20:34.113 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-03T16:20:34.113 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-03T16:20:34.113 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-03T16:20:34.113 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-03T16:20:34.113 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-03T16:20:34.113 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-03T16:20:34.113 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-03T16:20:34.113 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-03T16:20:34.113 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-03T16:20:34.114 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-03T16:20:34.114 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-03T16:20:34.114 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-03T16:20:34.114 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-03T16:20:34.114 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-03T16:20:34.114 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-03T16:20:34.114 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-03T16:20:34.114 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-03T16:20:34.114 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-03T16:20:34.114 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-03T16:20:34.114 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-03T16:20:34.114 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-03T16:20:34.114 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-03T16:20:34.114 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-03T16:20:34.115 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-03T16:20:34.115 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-03T16:20:34.115 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-03T16:20:34.115 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-03T16:20:34.115 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-03T16:20:34.115 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-03T16:20:34.115 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-03T16:20:34.115 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-03T16:20:34.115 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-03T16:20:34.115 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-03T16:20:34.115 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-03T16:20:34.115 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-03T16:20:34.115 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-03T16:20:34.115 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-03T16:20:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-03T16:20:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-03T16:20:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-03T16:20:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-03T16:20:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-03T16:20:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-03T16:20:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-03T16:20:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-03T16:20:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-03T16:20:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-03T16:20:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-03T16:20:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-03T16:20:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-03T16:20:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-03T16:20:34.116 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-03T16:20:34.117 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-03T16:20:34.117 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-03T16:20:34.117 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-03T16:20:34.117 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-03T16:20:34.117 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-03T16:20:34.117 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-03T16:20:34.117 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-03T16:20:34.117 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-03T16:20:34.117 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-03T16:20:34.117 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-03T16:20:34.117 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-03T16:20:34.117 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-03T16:20:34.117 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-03T16:20:34.117 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-03T16:20:34.117 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-03T16:20:34.118 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-03T16:20:34.118 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-03T16:20:34.118 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-03T16:20:34.118 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-03T16:20:34.118 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-03T16:20:34.118 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-03T16:20:34.118 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-03T16:20:34.118 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-03T16:20:34.118 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-03T16:20:34.118 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-03T16:20:34.118 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-03T16:20:34.118 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-03T16:20:34.118 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-03T16:20:34.119 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-03T16:20:34.119 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-03T16:20:34.119 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-03T16:20:34.119 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-03T16:20:34.119 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-03T16:20:34.119 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-03T16:20:34.119 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-03T16:20:34.119 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-03T16:20:34.119 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-03T16:20:34.119 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-03T16:20:34.119 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-03T16:20:34.119 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-03T16:20:34.119 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-03T16:20:34.119 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-03T16:20:34.120 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-03T16:20:34.120 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-03T16:20:34.120 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-03T16:20:34.120 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-03T16:20:34.120 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-03T16:20:34.120 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-03T16:20:34.120 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-03T16:20:34.120 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-03T16:20:34.120 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-03T16:20:34.120 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-03T16:20:34.120 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-03T16:20:34.120 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-03T16:20:34.120 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-03T16:20:34.120 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-03T16:20:34.120 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-03T16:20:34.121 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-03T16:20:34.121 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-03T16:20:34.121 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-03T16:20:34.121 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-03T16:20:34.121 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-03T16:20:34.121 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-03T16:20:34.121 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-03T16:20:34.121 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-03T16:20:34.121 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-03T16:20:34.121 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-03T16:20:34.121 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-03T16:20:34.121 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-03T16:20:34.121 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-03T16:20:34.121 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-03T16:20:34.121 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-03T16:20:34.122 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-03T16:20:34.122 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-03T16:20:34.122 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-03T16:20:34.122 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-03T16:20:34.122 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-03T16:20:34.122 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-03T16:20:34.122 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-03T16:20:34.122 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-03T16:20:34.122 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-03T16:20:34.122 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-03T16:20:34.122 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-03T16:20:34.122 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-03T16:20:34.122 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-03T16:20:34.123 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-03T16:20:34.123 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-03T16:20:34.123 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-03T16:20:34.123 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-03T16:20:34.123 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-03T16:20:34.123 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-03T16:20:34.123 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-03T16:20:34.123 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-03T16:20:34.123 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-03T16:20:34.123 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-03T16:20:34.123 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-03T16:20:34.123 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-03T16:20:34.123 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-03T16:20:34.123 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-03T16:20:34.123 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-03T16:20:34.124 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-03T16:20:34.124 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-03T16:20:34.124 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-03T16:20:34.124 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-03T16:20:34.124 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-03T16:20:34.124 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-03T16:20:34.124 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-03T16:20:34.124 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-03T16:20:34.124 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-03T16:20:34.124 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-03T16:20:34.124 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-03T16:20:34.124 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-03T16:20:34.124 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-03T16:20:34.124 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-03T16:20:34.125 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-03T16:20:34.125 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-03T16:20:34.125 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-03T16:20:34.125 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-03T16:20:34.125 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-03T16:20:34.125 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-03T16:20:34.125 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-03T16:20:34.125 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-03T16:20:34.125 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-03T16:20:34.125 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-03T16:20:34.125 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-03T16:20:34.125 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-03T16:20:34.125 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-03T16:20:34.125 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-03T16:20:34.126 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-03T16:20:34.126 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-03T16:20:34.126 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-03T16:20:34.126 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-03T16:20:34.126 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-03T16:20:34.126 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-03T16:20:34.126 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-03T16:20:34.126 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-03T16:20:34.126 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-03T16:20:34.126 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-03T16:20:34.126 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-03T16:20:34.126 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-03T16:20:34.126 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-03T16:20:34.126 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-03T16:20:34.127 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-03T16:20:34.127 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-03T16:20:34.127 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-03T16:20:34.127 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-03T16:20:34.127 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-03T16:20:34.127 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-03T16:20:34.127 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-03T16:20:34.127 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-03T16:20:34.127 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-03T16:20:34.127 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-03T16:20:34.127 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-03T16:20:34.127 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-03T16:20:34.127 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-03T16:20:34.127 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-03T16:20:34.127 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-03T16:20:34.128 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-03T16:20:34.128 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-03T16:20:34.128 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-03T16:20:34.128 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-03T16:20:34.128 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-03T16:20:34.128 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-03T16:20:34.128 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-03T16:20:34.128 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-03T16:20:34.128 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-03T16:20:34.128 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-03T16:20:34.128 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-03T16:20:34.128 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-03T16:20:34.128 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-03T16:20:34.128 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-03T16:20:34.128 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-03T16:20:34.128 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-03T16:20:34.129 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-03T16:20:34.129 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-03T16:20:34.129 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-03T16:20:34.129 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-03T16:20:34.129 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-03T16:20:34.129 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-03T16:20:34.129 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-03T16:20:34.129 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-03T16:20:34.129 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-03T16:20:34.129 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-03T16:20:34.129 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-03T16:20:34.129 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-03T16:20:34.129 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-03T16:20:34.129 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-03T16:20:34.129 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-03T16:20:34.129 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-03T16:20:34.130 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-03T16:20:34.130 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-03T16:20:34.130 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-03T16:20:34.130 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-03T16:20:34.130 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-03T16:20:34.130 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-03T16:20:34.130 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-03T16:20:34.130 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-03T16:20:34.130 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-03T16:20:34.130 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-03T16:20:34.130 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-03T16:20:34.130 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-03T16:20:34.130 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-03T16:20:34.130 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-03T16:20:34.131 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-03T16:20:34.131 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-03T16:20:34.131 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-03T16:20:34.131 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-03T16:20:34.131 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-03T16:20:34.131 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-03T16:20:34.131 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-03T16:20:34.131 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-03T16:20:34.131 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-03T16:20:34.131 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-03T16:20:34.131 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-03T16:20:34.131 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-03T16:20:34.131 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-03T16:20:34.131 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-03T16:20:34.131 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-03T16:20:34.132 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-03T16:20:34.132 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-03T16:20:34.132 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-03T16:20:34.132 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-03T16:20:34.132 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-03T16:20:34.132 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-03T16:20:34.132 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-03T16:20:34.132 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-03T16:20:34.132 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-03T16:20:34.132 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-03T16:20:34.132 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-03T16:20:34.132 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-03T16:20:34.132 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-03T16:20:34.132 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-03T16:20:34.133 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-03T16:20:34.133 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-03T16:20:34.133 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-03T16:20:34.133 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-03T16:20:34.133 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-03T16:20:34.133 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-03T16:20:34.133 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-03T16:20:34.133 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-03T16:20:34.133 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-03T16:20:34.133 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-03T16:20:34.133 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-03T16:20:34.133 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-03T16:20:34.133 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-03T16:20:34.133 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-03T16:20:34.133 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-03T16:20:34.134 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-03T16:20:34.134 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-03T16:20:34.134 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-03T16:20:34.134 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-03T16:20:34.134 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-03T16:20:34.134 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-03T16:20:34.134 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-03T16:20:34.134 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-03T16:20:34.134 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-03T16:20:34.134 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-03T16:20:34.134 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-03T16:20:34.134 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-03T16:20:34.134 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-03T16:20:34.135 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-03T16:20:34.135 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-03T16:20:34.135 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-03T16:20:34.135 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-03T16:20:34.135 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-03T16:20:34.135 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-03T16:20:34.135 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-03T16:20:34.135 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-03T16:20:34.135 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-03T16:20:34.135 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-03T16:20:34.135 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-03T16:20:34.135 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-03T16:20:34.135 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-03T16:20:34.136 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-03T16:20:34.136 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-03T16:20:34.136 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-03T16:20:34.136 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-03T16:20:34.136 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-03T16:20:34.136 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-03T16:20:34.136 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-03T16:20:34.136 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-03T16:20:34.136 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-03T16:20:34.136 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-03T16:20:34.136 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-03T16:20:34.136 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-03T16:20:34.136 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-03T16:20:34.136 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-03T16:20:34.136 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-03T16:20:34.137 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-03T16:20:34.137 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-03T16:20:34.137 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-03T16:20:34.137 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-03T16:20:34.137 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-03T16:20:34.137 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-03T16:20:34.137 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-03T16:20:34.137 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-03T16:20:34.137 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-03T16:20:34.137 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-03T16:20:34.137 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-03T16:20:34.137 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-03T16:20:34.137 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-03T16:20:34.137 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-03T16:20:34.137 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-03T16:20:34.138 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-03T16:20:34.138 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-03T16:20:34.138 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-03T16:20:34.138 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-03T16:20:34.138 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-03T16:20:34.138 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-03T16:20:34.138 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-03T16:20:34.138 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-03T16:20:34.138 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-03T16:20:34.138 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-03T16:20:34.138 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-03T16:20:34.138 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-03T16:20:34.138 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-03T16:20:34.138 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-03T16:20:34.138 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-03T16:20:34.139 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-03T16:20:34.139 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-03T16:20:34.139 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-03T16:20:34.139 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-03T16:20:34.139 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-03T16:20:34.139 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-03T16:20:34.139 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-03T16:20:34.139 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-03T16:20:34.139 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-03T16:20:34.139 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-03T16:20:34.139 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-03T16:20:34.139 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-03T16:20:34.139 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-03T16:20:34.139 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-03T16:20:34.140 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-03T16:20:34.140 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-03T16:20:34.140 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-03T16:20:34.140 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-03T16:20:34.140 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-03T16:20:34.140 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-03T16:20:34.140 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-03T16:20:34.140 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-03T16:20:34.140 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-03T16:20:34.140 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-03T16:20:34.140 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-03T16:20:34.140 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-03T16:20:34.140 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-03T16:20:34.140 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-03T16:20:34.140 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-03T16:20:34.141 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-03T16:20:34.141 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-03T16:20:34.141 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-03T16:20:34.141 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-03T16:20:34.141 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-03T16:20:34.145 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:34.145 DEBUG:teuthology.orchestra.run.smithi146:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-03T16:20:34.167 INFO:teuthology.orchestra.run.smithi146.stdout:postinstall scriptlet (using /bin/sh): 2024-05-03T16:20:34.167 INFO:teuthology.orchestra.run.smithi146.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-03T16:20:34.167 INFO:teuthology.orchestra.run.smithi146.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-03T16:20:34.168 INFO:teuthology.orchestra.run.smithi146.stdout:fi 2024-05-03T16:20:34.168 INFO:teuthology.orchestra.run.smithi146.stdout:for file in vmlinuz System.map config; do 2024-05-03T16:20:34.168 INFO:teuthology.orchestra.run.smithi146.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-03T16:20:34.168 INFO:teuthology.orchestra.run.smithi146.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-03T16:20:34.168 INFO:teuthology.orchestra.run.smithi146.stdout: fi 2024-05-03T16:20:34.168 INFO:teuthology.orchestra.run.smithi146.stdout:done 2024-05-03T16:20:34.168 INFO:teuthology.orchestra.run.smithi146.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-03T16:20:34.168 INFO:teuthology.orchestra.run.smithi146.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-03T16:20:34.168 INFO:teuthology.orchestra.run.smithi146.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-03T16:20:34.168 INFO:teuthology.orchestra.run.smithi146.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-03T16:20:34.168 INFO:teuthology.orchestra.run.smithi146.stdout:fi 2024-05-03T16:20:34.168 INFO:teuthology.orchestra.run.smithi146.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-03T16:20:34.168 INFO:teuthology.orchestra.run.smithi146.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:34.169 INFO:teuthology.orchestra.run.smithi146.stdout:fi 2024-05-03T16:20:34.169 INFO:teuthology.orchestra.run.smithi146.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-03T16:20:34.169 INFO:teuthology.orchestra.run.smithi146.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-03T16:20:34.169 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:34.169 INFO:teuthology.orchestra.run.smithi146.stdout:fi 2024-05-03T16:20:34.170 DEBUG:teuthology.orchestra.run.smithi146:> sudo rpm -qi grub2-tools 2024-05-03T16:20:34.249 INFO:teuthology.orchestra.run.smithi146.stdout:Name : grub2-tools 2024-05-03T16:20:34.249 INFO:teuthology.orchestra.run.smithi146.stdout:Epoch : 1 2024-05-03T16:20:34.249 INFO:teuthology.orchestra.run.smithi146.stdout:Version : 2.06 2024-05-03T16:20:34.249 INFO:teuthology.orchestra.run.smithi146.stdout:Release : 68.el9 2024-05-03T16:20:34.249 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: x86_64 2024-05-03T16:20:34.250 INFO:teuthology.orchestra.run.smithi146.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-03T16:20:34.250 INFO:teuthology.orchestra.run.smithi146.stdout:Group : Unspecified 2024-05-03T16:20:34.250 INFO:teuthology.orchestra.run.smithi146.stdout:Size : 8264254 2024-05-03T16:20:34.250 INFO:teuthology.orchestra.run.smithi146.stdout:License : GPLv3+ 2024-05-03T16:20:34.250 INFO:teuthology.orchestra.run.smithi146.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-03T16:20:34.250 INFO:teuthology.orchestra.run.smithi146.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-03T16:20:34.250 INFO:teuthology.orchestra.run.smithi146.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-03T16:20:34.250 INFO:teuthology.orchestra.run.smithi146.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-03T16:20:34.250 INFO:teuthology.orchestra.run.smithi146.stdout:Packager : builder@centos.org 2024-05-03T16:20:34.250 INFO:teuthology.orchestra.run.smithi146.stdout:Vendor : CentOS 2024-05-03T16:20:34.250 INFO:teuthology.orchestra.run.smithi146.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-03T16:20:34.250 INFO:teuthology.orchestra.run.smithi146.stdout:Summary : Support tools for GRUB. 2024-05-03T16:20:34.250 INFO:teuthology.orchestra.run.smithi146.stdout:Description : 2024-05-03T16:20:34.250 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:20:34.251 INFO:teuthology.orchestra.run.smithi146.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-03T16:20:34.251 INFO:teuthology.orchestra.run.smithi146.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-03T16:20:34.251 INFO:teuthology.orchestra.run.smithi146.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-03T16:20:34.251 INFO:teuthology.orchestra.run.smithi146.stdout:hardware devices. 2024-05-03T16:20:34.251 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:20:34.251 INFO:teuthology.orchestra.run.smithi146.stdout:This subpackage provides tools for support of all platforms. 2024-05-03T16:20:34.252 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-03T16:20:34.252 INFO:teuthology.task.kernel:Updating grub on smithi146 to boot 6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:34.252 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-03T16:20:34.798 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2024-05-03T16:20:36.159 INFO:teuthology.orchestra.run.smithi146.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-03T16:20:36.188 INFO:teuthology.orchestra.run.smithi146.stderr:done 2024-05-03T16:20:36.190 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2024-05-03T16:20:36.205 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.2ByyEHTQLN 2024-05-03T16:20:36.205 DEBUG:teuthology.orchestra.run.smithi146:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.2ByyEHTQLN 2024-05-03T16:20:36.271 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.2ByyEHTQLN 2024-05-03T16:20:36.409 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.2ByyEHTQLN is 6KB 2024-05-03T16:20:36.457 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.2ByyEHTQLN 2024-05-03T16:20:36.471 DEBUG:teuthology.orchestra.run.smithi146:> sudo /bin/ls /boot/loader/entries || true 2024-05-03T16:20:36.541 INFO:teuthology.orchestra.run.smithi146.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-03T16:20:36.541 INFO:teuthology.orchestra.run.smithi146.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-03T16:20:36.542 INFO:teuthology.orchestra.run.smithi146.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-03T16:20:36.542 INFO:teuthology.orchestra.run.smithi146.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-03T16:20:36.543 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:36.693 DEBUG:teuthology.orchestra.run.smithi146:> sudo shutdown -r now 2024-05-03T16:20:47.456 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-03T16:20:47.456 DEBUG:teuthology.orchestra.run.smithi134:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-03T16:20:47.533 INFO:teuthology.orchestra.run.smithi134.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:47.533 INFO:teuthology.orchestra.run.smithi134.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:47.533 INFO:teuthology.orchestra.run.smithi134.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:47.533 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-03T16:20:47.533 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-03T16:20:47.533 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-03T16:20:47.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-03T16:20:47.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-03T16:20:47.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-03T16:20:47.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-03T16:20:47.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-03T16:20:47.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-03T16:20:47.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-03T16:20:47.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-03T16:20:47.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-03T16:20:47.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-03T16:20:47.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-03T16:20:47.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-03T16:20:47.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-03T16:20:47.535 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-03T16:20:47.535 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-03T16:20:47.535 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-03T16:20:47.535 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-03T16:20:47.535 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-03T16:20:47.535 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-03T16:20:47.535 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-03T16:20:47.535 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-03T16:20:47.535 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-03T16:20:47.535 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-03T16:20:47.535 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-03T16:20:47.535 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-03T16:20:47.535 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-03T16:20:47.535 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-03T16:20:47.535 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-03T16:20:47.536 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-03T16:20:47.536 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-03T16:20:47.536 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-03T16:20:47.536 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-03T16:20:47.536 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-03T16:20:47.536 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-03T16:20:47.536 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-03T16:20:47.536 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-03T16:20:47.536 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-03T16:20:47.536 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-03T16:20:47.536 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-03T16:20:47.536 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-03T16:20:47.536 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-03T16:20:47.536 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-03T16:20:47.537 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-03T16:20:47.537 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-03T16:20:47.537 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-03T16:20:47.537 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-03T16:20:47.537 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-03T16:20:47.537 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-03T16:20:47.537 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-03T16:20:47.537 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-03T16:20:47.537 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-03T16:20:47.537 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-03T16:20:47.537 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-03T16:20:47.537 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-03T16:20:47.537 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-03T16:20:47.537 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-03T16:20:47.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-03T16:20:47.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-03T16:20:47.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-03T16:20:47.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-03T16:20:47.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-03T16:20:47.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-03T16:20:47.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-03T16:20:47.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-03T16:20:47.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-03T16:20:47.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-03T16:20:47.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-03T16:20:47.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-03T16:20:47.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-03T16:20:47.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-03T16:20:47.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-03T16:20:47.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-03T16:20:47.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-03T16:20:47.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-03T16:20:47.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-03T16:20:47.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-03T16:20:47.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-03T16:20:47.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-03T16:20:47.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-03T16:20:47.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-03T16:20:47.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-03T16:20:47.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-03T16:20:47.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-03T16:20:47.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-03T16:20:47.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-03T16:20:47.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-03T16:20:47.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-03T16:20:47.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-03T16:20:47.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-03T16:20:47.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-03T16:20:47.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-03T16:20:47.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-03T16:20:47.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-03T16:20:47.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-03T16:20:47.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-03T16:20:47.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-03T16:20:47.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-03T16:20:47.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-03T16:20:47.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-03T16:20:47.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-03T16:20:47.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-03T16:20:47.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-03T16:20:47.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-03T16:20:47.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-03T16:20:47.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-03T16:20:47.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-03T16:20:47.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-03T16:20:47.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-03T16:20:47.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-03T16:20:47.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-03T16:20:47.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-03T16:20:47.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-03T16:20:47.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-03T16:20:47.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-03T16:20:47.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-03T16:20:47.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-03T16:20:47.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-03T16:20:47.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-03T16:20:47.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-03T16:20:47.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-03T16:20:47.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-03T16:20:47.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-03T16:20:47.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-03T16:20:47.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-03T16:20:47.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-03T16:20:47.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-03T16:20:47.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-03T16:20:47.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-03T16:20:47.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-03T16:20:47.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-03T16:20:47.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-03T16:20:47.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-03T16:20:47.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-03T16:20:47.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-03T16:20:47.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-03T16:20:47.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-03T16:20:47.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-03T16:20:47.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-03T16:20:47.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-03T16:20:47.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-03T16:20:47.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-03T16:20:47.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-03T16:20:47.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-03T16:20:47.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-03T16:20:47.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-03T16:20:47.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-03T16:20:47.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-03T16:20:47.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-03T16:20:47.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-03T16:20:47.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-03T16:20:47.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-03T16:20:47.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-03T16:20:47.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-03T16:20:47.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-03T16:20:47.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-03T16:20:47.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-03T16:20:47.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-03T16:20:47.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-03T16:20:47.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-03T16:20:47.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-03T16:20:47.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-03T16:20:47.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-03T16:20:47.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-03T16:20:47.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-03T16:20:47.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-03T16:20:47.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-03T16:20:47.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-03T16:20:47.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-03T16:20:47.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-03T16:20:47.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-03T16:20:47.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-03T16:20:47.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-03T16:20:47.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-03T16:20:47.546 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-03T16:20:47.546 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-03T16:20:47.546 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-03T16:20:47.546 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-03T16:20:47.546 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-03T16:20:47.546 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-03T16:20:47.546 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-03T16:20:47.546 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-03T16:20:47.546 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-03T16:20:47.546 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-03T16:20:47.546 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-03T16:20:47.546 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-03T16:20:47.546 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-03T16:20:47.546 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-03T16:20:47.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-03T16:20:47.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-03T16:20:47.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-03T16:20:47.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-03T16:20:47.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-03T16:20:47.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-03T16:20:47.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-03T16:20:47.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-03T16:20:47.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-03T16:20:47.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-03T16:20:47.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-03T16:20:47.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-03T16:20:47.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-03T16:20:47.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-03T16:20:47.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-03T16:20:47.548 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-03T16:20:47.548 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-03T16:20:47.548 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-03T16:20:47.548 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-03T16:20:47.548 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-03T16:20:47.548 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-03T16:20:47.548 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-03T16:20:47.548 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-03T16:20:47.548 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-03T16:20:47.548 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-03T16:20:47.548 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-03T16:20:47.548 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-03T16:20:47.548 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-03T16:20:47.548 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-03T16:20:47.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-03T16:20:47.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-03T16:20:47.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-03T16:20:47.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-03T16:20:47.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-03T16:20:47.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-03T16:20:47.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-03T16:20:47.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-03T16:20:47.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-03T16:20:47.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-03T16:20:47.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-03T16:20:47.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-03T16:20:47.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-03T16:20:47.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-03T16:20:47.550 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-03T16:20:47.550 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-03T16:20:47.550 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-03T16:20:47.550 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-03T16:20:47.550 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-03T16:20:47.550 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-03T16:20:47.550 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-03T16:20:47.550 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-03T16:20:47.550 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-03T16:20:47.550 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-03T16:20:47.550 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-03T16:20:47.550 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-03T16:20:47.550 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-03T16:20:47.550 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-03T16:20:47.551 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-03T16:20:47.551 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-03T16:20:47.551 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-03T16:20:47.551 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-03T16:20:47.551 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-03T16:20:47.551 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-03T16:20:47.551 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-03T16:20:47.551 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-03T16:20:47.551 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-03T16:20:47.551 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-03T16:20:47.551 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-03T16:20:47.551 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-03T16:20:47.551 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-03T16:20:47.551 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-03T16:20:47.552 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-03T16:20:47.552 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-03T16:20:47.552 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-03T16:20:47.552 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-03T16:20:47.552 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-03T16:20:47.552 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-03T16:20:47.552 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-03T16:20:47.552 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-03T16:20:47.552 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-03T16:20:47.552 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-03T16:20:47.552 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-03T16:20:47.552 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-03T16:20:47.552 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-03T16:20:47.552 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-03T16:20:47.552 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-03T16:20:47.553 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-03T16:20:47.553 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-03T16:20:47.553 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-03T16:20:47.553 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-03T16:20:47.553 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-03T16:20:47.553 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-03T16:20:47.553 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-03T16:20:47.553 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-03T16:20:47.553 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-03T16:20:47.553 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-03T16:20:47.553 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-03T16:20:47.553 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-03T16:20:47.553 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-03T16:20:47.553 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-03T16:20:47.554 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-03T16:20:47.554 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-03T16:20:47.554 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-03T16:20:47.554 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-03T16:20:47.554 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-03T16:20:47.554 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-03T16:20:47.554 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-03T16:20:47.554 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-03T16:20:47.554 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-03T16:20:47.554 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-03T16:20:47.554 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-03T16:20:47.554 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-03T16:20:47.554 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-03T16:20:47.554 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-03T16:20:47.555 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-03T16:20:47.555 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-03T16:20:47.555 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-03T16:20:47.555 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-03T16:20:47.555 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-03T16:20:47.555 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-03T16:20:47.555 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-03T16:20:47.555 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-03T16:20:47.555 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-03T16:20:47.555 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-03T16:20:47.555 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-03T16:20:47.555 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-03T16:20:47.555 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-03T16:20:47.555 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-03T16:20:47.555 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-03T16:20:47.556 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-03T16:20:47.556 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-03T16:20:47.556 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-03T16:20:47.556 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-03T16:20:47.556 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-03T16:20:47.556 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-03T16:20:47.556 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-03T16:20:47.556 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-03T16:20:47.556 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-03T16:20:47.556 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-03T16:20:47.556 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-03T16:20:47.556 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-03T16:20:47.556 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-03T16:20:47.556 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-03T16:20:47.556 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-03T16:20:47.557 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-03T16:20:47.557 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-03T16:20:47.557 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-03T16:20:47.557 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-03T16:20:47.557 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-03T16:20:47.557 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-03T16:20:47.557 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-03T16:20:47.557 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-03T16:20:47.557 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-03T16:20:47.557 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-03T16:20:47.557 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-03T16:20:47.557 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-03T16:20:47.557 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-03T16:20:47.558 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-03T16:20:47.558 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-03T16:20:47.558 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-03T16:20:47.558 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-03T16:20:47.558 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-03T16:20:47.558 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-03T16:20:47.558 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-03T16:20:47.558 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-03T16:20:47.558 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-03T16:20:47.558 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-03T16:20:47.558 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-03T16:20:47.558 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-03T16:20:47.558 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-03T16:20:47.559 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-03T16:20:47.559 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-03T16:20:47.559 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-03T16:20:47.559 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-03T16:20:47.559 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-03T16:20:47.559 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-03T16:20:47.559 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-03T16:20:47.559 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-03T16:20:47.559 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-03T16:20:47.559 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-03T16:20:47.559 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-03T16:20:47.559 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-03T16:20:47.559 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-03T16:20:47.559 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-03T16:20:47.559 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-03T16:20:47.560 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-03T16:20:47.560 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-03T16:20:47.560 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-03T16:20:47.560 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-03T16:20:47.560 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-03T16:20:47.560 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-03T16:20:47.560 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-03T16:20:47.560 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-03T16:20:47.560 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-03T16:20:47.560 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-03T16:20:47.560 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-03T16:20:47.560 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-03T16:20:47.560 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-03T16:20:47.560 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-03T16:20:47.561 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-03T16:20:47.561 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-03T16:20:47.561 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-03T16:20:47.561 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-03T16:20:47.561 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-03T16:20:47.561 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-03T16:20:47.561 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-03T16:20:47.561 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-03T16:20:47.561 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-03T16:20:47.561 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-03T16:20:47.561 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-03T16:20:47.561 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-03T16:20:47.561 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-03T16:20:47.561 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-03T16:20:47.562 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-03T16:20:47.562 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-03T16:20:47.562 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-03T16:20:47.562 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-03T16:20:47.562 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-03T16:20:47.562 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-03T16:20:47.562 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-03T16:20:47.562 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-03T16:20:47.562 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-03T16:20:47.562 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-03T16:20:47.562 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-03T16:20:47.562 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-03T16:20:47.562 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-03T16:20:47.562 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-03T16:20:47.563 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-03T16:20:47.563 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-03T16:20:47.563 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-03T16:20:47.563 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-03T16:20:47.563 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-03T16:20:47.563 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-03T16:20:47.563 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-03T16:20:47.563 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-03T16:20:47.563 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-03T16:20:47.563 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-03T16:20:47.563 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-03T16:20:47.563 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-03T16:20:47.563 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-03T16:20:47.563 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-03T16:20:47.564 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-03T16:20:47.564 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-03T16:20:47.564 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-03T16:20:47.564 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-03T16:20:47.564 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-03T16:20:47.564 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-03T16:20:47.564 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-03T16:20:47.564 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-03T16:20:47.564 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-03T16:20:47.564 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-03T16:20:47.564 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-03T16:20:47.564 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-03T16:20:47.564 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-03T16:20:47.564 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-03T16:20:47.564 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-03T16:20:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-03T16:20:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-03T16:20:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-03T16:20:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-03T16:20:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-03T16:20:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-03T16:20:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-03T16:20:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-03T16:20:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-03T16:20:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-03T16:20:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-03T16:20:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-03T16:20:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-03T16:20:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-03T16:20:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-03T16:20:47.566 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-03T16:20:47.566 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-03T16:20:47.566 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-03T16:20:47.566 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-03T16:20:47.566 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-03T16:20:47.566 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-03T16:20:47.566 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-03T16:20:47.566 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-03T16:20:47.566 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-03T16:20:47.566 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-03T16:20:47.566 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-03T16:20:47.566 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-03T16:20:47.566 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-03T16:20:47.566 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-03T16:20:47.567 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-03T16:20:47.567 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-03T16:20:47.567 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-03T16:20:47.567 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-03T16:20:47.567 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-03T16:20:47.567 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-03T16:20:47.567 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-03T16:20:47.567 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-03T16:20:47.567 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-03T16:20:47.567 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-03T16:20:47.567 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-03T16:20:47.567 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-03T16:20:47.567 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-03T16:20:47.567 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-03T16:20:47.568 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-03T16:20:47.568 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-03T16:20:47.568 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-03T16:20:47.568 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-03T16:20:47.568 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-03T16:20:47.568 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-03T16:20:47.568 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-03T16:20:47.568 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-03T16:20:47.568 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-03T16:20:47.568 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-03T16:20:47.568 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-03T16:20:47.568 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-03T16:20:47.568 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-03T16:20:47.569 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-03T16:20:47.569 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-03T16:20:47.569 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-03T16:20:47.569 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-03T16:20:47.569 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-03T16:20:47.569 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-03T16:20:47.569 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-03T16:20:47.569 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-03T16:20:47.569 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-03T16:20:47.569 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-03T16:20:47.569 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-03T16:20:47.569 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-03T16:20:47.569 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-03T16:20:47.569 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-03T16:20:47.569 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-03T16:20:47.570 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-03T16:20:47.570 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-03T16:20:47.570 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-03T16:20:47.570 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-03T16:20:47.570 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-03T16:20:47.570 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-03T16:20:47.570 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-03T16:20:47.570 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-03T16:20:47.570 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-03T16:20:47.570 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-03T16:20:47.570 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-03T16:20:47.570 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-03T16:20:47.570 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-03T16:20:47.570 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-03T16:20:47.571 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-03T16:20:47.571 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-03T16:20:47.571 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-03T16:20:47.571 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-03T16:20:47.571 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-03T16:20:47.571 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-03T16:20:47.571 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-03T16:20:47.571 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-03T16:20:47.571 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-03T16:20:47.571 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-03T16:20:47.571 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-03T16:20:47.573 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-03T16:20:47.573 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-03T16:20:47.573 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-03T16:20:47.573 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-03T16:20:47.573 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-03T16:20:47.574 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-03T16:20:47.574 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-03T16:20:47.574 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-03T16:20:47.574 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-03T16:20:47.574 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-03T16:20:47.574 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-03T16:20:47.574 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-03T16:20:47.574 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-03T16:20:47.574 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-03T16:20:47.574 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-03T16:20:47.574 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-03T16:20:47.574 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-03T16:20:47.574 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-03T16:20:47.574 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-03T16:20:47.575 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-03T16:20:47.575 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-03T16:20:47.575 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-03T16:20:47.575 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-03T16:20:47.575 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-03T16:20:47.575 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-03T16:20:47.575 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-03T16:20:47.575 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-03T16:20:47.575 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-03T16:20:47.575 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-03T16:20:47.575 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-03T16:20:47.575 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-03T16:20:47.575 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-03T16:20:47.575 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-03T16:20:47.576 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-03T16:20:47.576 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-03T16:20:47.576 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-03T16:20:47.576 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-03T16:20:47.576 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-03T16:20:47.576 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-03T16:20:47.576 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-03T16:20:47.576 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-03T16:20:47.576 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-03T16:20:47.576 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-03T16:20:47.576 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-03T16:20:47.576 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-03T16:20:47.576 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-03T16:20:47.577 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-03T16:20:47.577 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-03T16:20:47.577 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-03T16:20:47.577 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-03T16:20:47.577 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-03T16:20:47.577 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-03T16:20:47.577 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-03T16:20:47.577 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-03T16:20:47.577 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-03T16:20:47.577 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-03T16:20:47.577 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-03T16:20:47.577 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-03T16:20:47.577 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-03T16:20:47.577 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-03T16:20:47.577 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-03T16:20:47.578 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-03T16:20:47.578 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-03T16:20:47.578 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-03T16:20:47.578 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-03T16:20:47.578 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-03T16:20:47.578 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-03T16:20:47.578 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-03T16:20:47.578 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-03T16:20:47.578 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-03T16:20:47.578 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-03T16:20:47.578 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-03T16:20:47.578 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-03T16:20:47.578 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-03T16:20:47.579 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-03T16:20:47.579 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-03T16:20:47.579 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-03T16:20:47.579 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-03T16:20:47.579 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-03T16:20:47.579 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-03T16:20:47.579 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-03T16:20:47.579 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-03T16:20:47.579 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-03T16:20:47.579 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-03T16:20:47.579 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-03T16:20:47.579 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-03T16:20:47.579 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-03T16:20:47.579 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-03T16:20:47.580 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-03T16:20:47.580 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-03T16:20:47.580 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-03T16:20:47.580 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-03T16:20:47.580 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-03T16:20:47.580 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-03T16:20:47.580 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-03T16:20:47.580 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-03T16:20:47.580 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-03T16:20:47.580 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-03T16:20:47.580 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-03T16:20:47.580 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-03T16:20:47.580 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-03T16:20:47.580 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-03T16:20:47.581 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-03T16:20:47.581 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-03T16:20:47.581 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-03T16:20:47.581 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-03T16:20:47.581 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-03T16:20:47.581 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-03T16:20:47.581 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-03T16:20:47.581 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-03T16:20:47.581 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-03T16:20:47.581 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-03T16:20:47.581 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-03T16:20:47.581 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-03T16:20:47.581 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-03T16:20:47.581 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-03T16:20:47.582 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-03T16:20:47.582 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-03T16:20:47.582 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-03T16:20:47.582 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-03T16:20:47.582 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-03T16:20:47.582 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-03T16:20:47.582 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-03T16:20:47.582 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-03T16:20:47.582 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-03T16:20:47.582 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-03T16:20:47.582 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-03T16:20:47.582 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-03T16:20:47.582 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-03T16:20:47.582 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-03T16:20:47.583 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-03T16:20:47.583 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-03T16:20:47.583 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-03T16:20:47.583 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-03T16:20:47.583 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-03T16:20:47.583 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-03T16:20:47.583 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-03T16:20:47.583 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-03T16:20:47.583 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-03T16:20:47.583 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-03T16:20:47.583 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-03T16:20:47.583 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-03T16:20:47.583 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-03T16:20:47.583 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-03T16:20:47.583 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-03T16:20:47.584 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-03T16:20:47.584 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-03T16:20:47.584 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-03T16:20:47.584 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-03T16:20:47.584 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-03T16:20:47.584 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-03T16:20:47.584 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-03T16:20:47.584 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-03T16:20:47.584 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-03T16:20:47.584 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-03T16:20:47.584 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-03T16:20:47.584 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-03T16:20:47.584 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-03T16:20:47.585 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-03T16:20:47.585 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-03T16:20:47.585 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-03T16:20:47.585 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-03T16:20:47.585 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-03T16:20:47.585 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-03T16:20:47.585 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-03T16:20:47.585 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-03T16:20:47.585 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-03T16:20:47.585 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-03T16:20:47.585 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-03T16:20:47.585 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-03T16:20:47.585 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-03T16:20:47.585 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-03T16:20:47.586 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-03T16:20:47.586 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-03T16:20:47.586 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-03T16:20:47.586 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-03T16:20:47.586 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-03T16:20:47.586 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-03T16:20:47.586 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-03T16:20:47.586 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-03T16:20:47.586 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-03T16:20:47.586 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-03T16:20:47.586 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-03T16:20:47.586 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-03T16:20:47.586 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-03T16:20:47.586 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-03T16:20:47.587 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-03T16:20:47.587 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-03T16:20:47.587 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-03T16:20:47.587 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-03T16:20:47.587 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-03T16:20:47.587 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-03T16:20:47.587 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-03T16:20:47.587 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-03T16:20:47.587 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-03T16:20:47.587 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-03T16:20:47.587 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-03T16:20:47.587 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-03T16:20:47.587 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-03T16:20:47.587 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-03T16:20:47.587 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-03T16:20:47.588 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-03T16:20:47.588 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-03T16:20:47.588 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-03T16:20:47.588 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-03T16:20:47.588 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-03T16:20:47.588 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-03T16:20:47.588 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-03T16:20:47.588 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-03T16:20:47.588 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-03T16:20:47.588 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-03T16:20:47.588 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-03T16:20:47.588 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-03T16:20:47.588 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-03T16:20:47.588 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-03T16:20:47.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-03T16:20:47.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-03T16:20:47.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-03T16:20:47.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-03T16:20:47.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-03T16:20:47.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-03T16:20:47.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-03T16:20:47.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-03T16:20:47.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-03T16:20:47.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-03T16:20:47.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-03T16:20:47.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-03T16:20:47.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-03T16:20:47.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-03T16:20:47.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-03T16:20:47.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-03T16:20:47.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-03T16:20:47.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-03T16:20:47.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-03T16:20:47.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-03T16:20:47.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-03T16:20:47.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-03T16:20:47.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-03T16:20:47.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-03T16:20:47.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-03T16:20:47.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-03T16:20:47.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-03T16:20:47.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-03T16:20:47.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-03T16:20:47.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-03T16:20:47.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-03T16:20:47.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-03T16:20:47.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-03T16:20:47.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-03T16:20:47.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-03T16:20:47.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-03T16:20:47.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-03T16:20:47.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-03T16:20:47.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-03T16:20:47.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-03T16:20:47.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-03T16:20:47.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-03T16:20:47.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-03T16:20:47.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-03T16:20:47.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-03T16:20:47.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-03T16:20:47.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-03T16:20:47.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-03T16:20:47.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-03T16:20:47.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-03T16:20:47.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-03T16:20:47.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-03T16:20:47.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-03T16:20:47.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-03T16:20:47.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-03T16:20:47.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-03T16:20:47.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-03T16:20:47.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-03T16:20:47.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-03T16:20:47.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-03T16:20:47.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-03T16:20:47.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-03T16:20:47.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-03T16:20:47.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-03T16:20:47.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-03T16:20:47.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-03T16:20:47.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-03T16:20:47.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-03T16:20:47.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-03T16:20:47.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-03T16:20:47.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-03T16:20:47.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-03T16:20:47.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-03T16:20:47.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-03T16:20:47.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-03T16:20:47.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-03T16:20:47.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-03T16:20:47.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-03T16:20:47.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-03T16:20:47.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-03T16:20:47.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-03T16:20:47.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-03T16:20:47.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-03T16:20:47.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-03T16:20:47.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-03T16:20:47.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-03T16:20:47.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-03T16:20:47.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-03T16:20:47.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-03T16:20:47.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-03T16:20:47.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-03T16:20:47.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-03T16:20:47.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-03T16:20:47.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-03T16:20:47.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-03T16:20:47.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-03T16:20:47.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-03T16:20:47.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-03T16:20:47.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-03T16:20:47.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-03T16:20:47.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-03T16:20:47.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-03T16:20:47.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-03T16:20:47.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-03T16:20:47.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-03T16:20:47.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-03T16:20:47.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-03T16:20:47.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-03T16:20:47.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-03T16:20:47.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-03T16:20:47.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-03T16:20:47.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-03T16:20:47.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-03T16:20:47.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-03T16:20:47.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-03T16:20:47.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-03T16:20:47.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-03T16:20:47.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-03T16:20:47.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-03T16:20:47.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-03T16:20:47.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-03T16:20:47.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-03T16:20:47.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-03T16:20:47.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-03T16:20:47.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-03T16:20:47.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-03T16:20:47.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-03T16:20:47.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-03T16:20:47.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-03T16:20:47.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-03T16:20:47.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-03T16:20:47.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-03T16:20:47.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-03T16:20:47.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-03T16:20:47.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-03T16:20:47.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-03T16:20:47.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-03T16:20:47.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-03T16:20:47.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-03T16:20:47.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-03T16:20:47.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-03T16:20:47.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-03T16:20:47.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-03T16:20:47.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-03T16:20:47.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-03T16:20:47.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-03T16:20:47.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-03T16:20:47.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-03T16:20:47.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-03T16:20:47.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-03T16:20:47.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-03T16:20:47.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-03T16:20:47.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-03T16:20:47.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-03T16:20:47.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-03T16:20:47.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-03T16:20:47.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-03T16:20:47.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-03T16:20:47.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-03T16:20:47.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-03T16:20:47.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-03T16:20:47.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-03T16:20:47.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-03T16:20:47.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-03T16:20:47.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-03T16:20:47.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-03T16:20:47.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-03T16:20:47.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-03T16:20:47.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-03T16:20:47.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-03T16:20:47.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-03T16:20:47.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-03T16:20:47.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-03T16:20:47.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-03T16:20:47.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-03T16:20:47.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-03T16:20:47.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-03T16:20:47.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-03T16:20:47.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-03T16:20:47.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-03T16:20:47.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-03T16:20:47.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-03T16:20:47.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-03T16:20:47.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-03T16:20:47.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-03T16:20:47.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-03T16:20:47.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-03T16:20:47.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-03T16:20:47.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-03T16:20:47.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-03T16:20:47.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-03T16:20:47.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-03T16:20:47.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-03T16:20:47.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-03T16:20:47.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-03T16:20:47.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-03T16:20:47.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-03T16:20:47.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-03T16:20:47.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-03T16:20:47.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-03T16:20:47.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-03T16:20:47.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-03T16:20:47.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-03T16:20:47.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-03T16:20:47.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-03T16:20:47.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-03T16:20:47.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-03T16:20:47.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-03T16:20:47.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-03T16:20:47.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-03T16:20:47.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-03T16:20:47.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-03T16:20:47.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-03T16:20:47.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-03T16:20:47.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-03T16:20:47.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-03T16:20:47.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-03T16:20:47.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-03T16:20:47.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-03T16:20:47.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-03T16:20:47.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-03T16:20:47.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-03T16:20:47.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-03T16:20:47.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-03T16:20:47.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-03T16:20:47.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-03T16:20:47.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-03T16:20:47.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-03T16:20:47.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-03T16:20:47.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-03T16:20:47.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-03T16:20:47.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-03T16:20:47.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-03T16:20:47.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-03T16:20:47.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-03T16:20:47.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-03T16:20:47.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-03T16:20:47.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-03T16:20:47.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-03T16:20:47.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-03T16:20:47.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-03T16:20:47.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-03T16:20:47.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-03T16:20:47.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-03T16:20:47.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-03T16:20:47.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-03T16:20:47.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-03T16:20:47.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-03T16:20:47.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-03T16:20:47.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-03T16:20:47.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-03T16:20:47.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-03T16:20:47.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-03T16:20:47.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-03T16:20:47.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-03T16:20:47.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-03T16:20:47.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-03T16:20:47.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-03T16:20:47.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-03T16:20:47.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-03T16:20:47.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-03T16:20:47.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-03T16:20:47.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-03T16:20:47.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-03T16:20:47.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-03T16:20:47.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-03T16:20:47.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-03T16:20:47.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-03T16:20:47.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-03T16:20:47.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-03T16:20:47.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-03T16:20:47.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-03T16:20:47.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-03T16:20:47.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-03T16:20:47.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-03T16:20:47.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-03T16:20:47.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-03T16:20:47.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-03T16:20:47.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-03T16:20:47.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-03T16:20:47.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-03T16:20:47.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-03T16:20:47.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-03T16:20:47.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-03T16:20:47.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-03T16:20:47.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-03T16:20:47.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-03T16:20:47.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-03T16:20:47.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-03T16:20:47.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-03T16:20:47.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-03T16:20:47.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-03T16:20:47.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-03T16:20:47.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-03T16:20:47.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-03T16:20:47.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-03T16:20:47.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-03T16:20:47.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-03T16:20:47.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-03T16:20:47.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-03T16:20:47.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-03T16:20:47.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-03T16:20:47.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-03T16:20:47.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-03T16:20:47.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-03T16:20:47.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-03T16:20:47.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-03T16:20:47.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-03T16:20:47.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-03T16:20:47.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-03T16:20:47.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-03T16:20:47.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-03T16:20:47.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-03T16:20:47.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-03T16:20:47.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-03T16:20:47.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-03T16:20:47.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-03T16:20:47.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-03T16:20:47.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-03T16:20:47.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-03T16:20:47.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-03T16:20:47.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-03T16:20:47.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-03T16:20:47.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-03T16:20:47.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-03T16:20:47.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-03T16:20:47.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-03T16:20:47.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-03T16:20:47.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-03T16:20:47.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-03T16:20:47.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-03T16:20:47.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-03T16:20:47.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-03T16:20:47.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-03T16:20:47.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-03T16:20:47.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-03T16:20:47.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-03T16:20:47.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-03T16:20:47.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-03T16:20:47.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-03T16:20:47.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-03T16:20:47.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-03T16:20:47.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-03T16:20:47.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-03T16:20:47.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-03T16:20:47.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-03T16:20:47.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-03T16:20:47.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-03T16:20:47.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-03T16:20:47.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-03T16:20:47.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-03T16:20:47.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-03T16:20:47.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-03T16:20:47.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-03T16:20:47.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-03T16:20:47.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-03T16:20:47.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-03T16:20:47.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-03T16:20:47.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-03T16:20:47.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-03T16:20:47.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-03T16:20:47.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-03T16:20:47.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-03T16:20:47.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-03T16:20:47.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-03T16:20:47.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-03T16:20:47.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-03T16:20:47.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-03T16:20:47.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-03T16:20:47.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-03T16:20:47.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-03T16:20:47.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-03T16:20:47.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-03T16:20:47.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-03T16:20:47.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-03T16:20:47.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-03T16:20:47.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-03T16:20:47.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-03T16:20:47.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-03T16:20:47.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-03T16:20:47.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-03T16:20:47.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-03T16:20:47.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-03T16:20:47.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-03T16:20:47.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-03T16:20:47.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-03T16:20:47.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-03T16:20:47.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-03T16:20:47.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-03T16:20:47.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-03T16:20:47.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-03T16:20:47.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-03T16:20:47.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-03T16:20:47.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-03T16:20:47.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-03T16:20:47.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-03T16:20:47.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-03T16:20:47.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-03T16:20:47.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-03T16:20:47.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-03T16:20:47.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-03T16:20:47.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-03T16:20:47.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-03T16:20:47.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-03T16:20:47.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-03T16:20:47.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-03T16:20:47.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-03T16:20:47.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-03T16:20:47.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-03T16:20:47.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-03T16:20:47.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-03T16:20:47.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-03T16:20:47.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-03T16:20:47.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-03T16:20:47.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-03T16:20:47.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-03T16:20:47.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-03T16:20:47.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-03T16:20:47.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-03T16:20:47.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-03T16:20:47.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-03T16:20:47.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-03T16:20:47.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-03T16:20:47.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-03T16:20:47.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-03T16:20:47.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-03T16:20:47.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-03T16:20:47.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-03T16:20:47.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-03T16:20:47.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-03T16:20:47.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-03T16:20:47.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-03T16:20:47.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-03T16:20:47.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-03T16:20:47.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-03T16:20:47.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-03T16:20:47.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-03T16:20:47.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-03T16:20:47.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-03T16:20:47.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-03T16:20:47.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-03T16:20:47.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-03T16:20:47.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-03T16:20:47.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-03T16:20:47.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-03T16:20:47.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-03T16:20:47.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-03T16:20:47.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-03T16:20:47.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-03T16:20:47.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-03T16:20:47.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-03T16:20:47.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-03T16:20:47.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-03T16:20:47.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-03T16:20:47.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-03T16:20:47.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-03T16:20:47.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-03T16:20:47.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-03T16:20:47.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-03T16:20:47.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-03T16:20:47.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-03T16:20:47.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-03T16:20:47.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-03T16:20:47.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-03T16:20:47.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-03T16:20:47.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-03T16:20:47.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-03T16:20:47.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-03T16:20:47.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-03T16:20:47.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-03T16:20:47.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-03T16:20:47.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-03T16:20:47.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-03T16:20:47.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-03T16:20:47.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-03T16:20:47.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-03T16:20:47.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-03T16:20:47.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-03T16:20:47.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-03T16:20:47.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-03T16:20:47.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-03T16:20:47.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-03T16:20:47.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-03T16:20:47.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-03T16:20:47.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-03T16:20:47.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-03T16:20:47.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-03T16:20:47.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-03T16:20:47.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-03T16:20:47.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-03T16:20:47.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-03T16:20:47.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-03T16:20:47.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-03T16:20:47.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-03T16:20:47.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-03T16:20:47.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-03T16:20:47.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-03T16:20:47.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-03T16:20:47.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-03T16:20:47.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-03T16:20:47.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-03T16:20:47.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-03T16:20:47.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-03T16:20:47.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-03T16:20:47.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-03T16:20:47.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-03T16:20:47.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-03T16:20:47.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-03T16:20:47.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-03T16:20:47.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-03T16:20:47.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-03T16:20:47.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-03T16:20:47.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-03T16:20:47.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-03T16:20:47.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-03T16:20:47.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-03T16:20:47.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-03T16:20:47.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-03T16:20:47.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-03T16:20:47.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-03T16:20:47.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-03T16:20:47.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-03T16:20:47.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-03T16:20:47.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-03T16:20:47.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-03T16:20:47.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-03T16:20:47.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-03T16:20:47.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-03T16:20:47.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-03T16:20:47.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-03T16:20:47.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-03T16:20:47.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-03T16:20:47.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-03T16:20:47.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-03T16:20:47.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-03T16:20:47.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-03T16:20:47.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-03T16:20:47.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-03T16:20:47.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-03T16:20:47.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-03T16:20:47.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-03T16:20:47.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-03T16:20:47.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-03T16:20:47.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-03T16:20:47.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-03T16:20:47.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-03T16:20:47.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-03T16:20:47.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-03T16:20:47.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-03T16:20:47.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-03T16:20:47.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-03T16:20:47.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-03T16:20:47.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-03T16:20:47.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-03T16:20:47.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-03T16:20:47.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-03T16:20:47.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-03T16:20:47.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-03T16:20:47.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-03T16:20:47.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-03T16:20:47.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-03T16:20:47.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-03T16:20:47.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-03T16:20:47.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-03T16:20:47.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-03T16:20:47.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-03T16:20:47.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-03T16:20:47.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-03T16:20:47.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-03T16:20:47.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-03T16:20:47.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-03T16:20:47.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-03T16:20:47.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-03T16:20:47.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-03T16:20:47.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-03T16:20:47.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-03T16:20:47.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-03T16:20:47.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-03T16:20:47.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-03T16:20:47.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-03T16:20:47.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-03T16:20:47.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-03T16:20:47.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-03T16:20:47.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-03T16:20:47.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-03T16:20:47.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-03T16:20:47.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-03T16:20:47.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-03T16:20:47.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-03T16:20:47.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-03T16:20:47.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-03T16:20:47.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-03T16:20:47.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-03T16:20:47.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-03T16:20:47.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-03T16:20:47.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-03T16:20:47.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-03T16:20:47.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-03T16:20:47.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-03T16:20:47.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-03T16:20:47.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-03T16:20:47.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-03T16:20:47.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-03T16:20:47.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-03T16:20:47.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-03T16:20:47.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-03T16:20:47.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-03T16:20:47.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-03T16:20:47.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-03T16:20:47.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-03T16:20:47.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-03T16:20:47.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-03T16:20:47.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-03T16:20:47.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-03T16:20:47.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-03T16:20:47.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-03T16:20:47.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-03T16:20:47.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-03T16:20:47.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-03T16:20:47.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-03T16:20:47.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-03T16:20:47.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-03T16:20:47.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-03T16:20:47.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-03T16:20:47.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-03T16:20:47.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-03T16:20:47.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-03T16:20:47.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-03T16:20:47.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-03T16:20:47.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-03T16:20:47.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-03T16:20:47.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-03T16:20:47.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-03T16:20:47.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-03T16:20:47.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-03T16:20:47.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-03T16:20:47.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-03T16:20:47.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-03T16:20:47.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-03T16:20:47.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-03T16:20:47.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-03T16:20:47.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-03T16:20:47.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-03T16:20:47.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-03T16:20:47.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-03T16:20:47.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-03T16:20:47.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-03T16:20:47.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-03T16:20:47.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-03T16:20:47.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-03T16:20:47.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-03T16:20:47.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-03T16:20:47.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-03T16:20:47.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-03T16:20:47.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-03T16:20:47.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-03T16:20:47.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-03T16:20:47.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-03T16:20:47.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-03T16:20:47.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-03T16:20:47.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-03T16:20:47.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-03T16:20:47.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-03T16:20:47.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-03T16:20:47.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-03T16:20:47.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-03T16:20:47.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-03T16:20:47.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-03T16:20:47.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-03T16:20:47.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-03T16:20:47.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-03T16:20:47.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-03T16:20:47.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-03T16:20:47.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-03T16:20:47.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-03T16:20:47.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-03T16:20:47.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-03T16:20:47.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-03T16:20:47.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-03T16:20:47.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-03T16:20:47.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-03T16:20:47.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-03T16:20:47.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-03T16:20:47.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-03T16:20:47.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-03T16:20:47.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-03T16:20:47.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-03T16:20:47.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-03T16:20:47.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-03T16:20:47.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-03T16:20:47.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-03T16:20:47.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-03T16:20:47.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-03T16:20:47.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-03T16:20:47.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-03T16:20:47.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-03T16:20:47.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-03T16:20:47.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-03T16:20:47.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-03T16:20:47.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-03T16:20:47.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-03T16:20:47.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-03T16:20:47.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-03T16:20:47.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-03T16:20:47.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-03T16:20:47.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-03T16:20:47.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-03T16:20:47.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-03T16:20:47.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-03T16:20:47.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-03T16:20:47.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-03T16:20:47.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-03T16:20:47.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-03T16:20:47.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-03T16:20:47.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-03T16:20:47.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-03T16:20:47.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-03T16:20:47.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-03T16:20:47.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-03T16:20:47.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-03T16:20:47.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-03T16:20:47.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-03T16:20:47.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-03T16:20:47.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-03T16:20:47.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-03T16:20:47.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-03T16:20:47.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-03T16:20:47.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-03T16:20:47.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-03T16:20:47.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-03T16:20:47.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-03T16:20:47.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-03T16:20:47.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-03T16:20:47.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-03T16:20:47.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-03T16:20:47.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-03T16:20:47.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-03T16:20:47.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-03T16:20:47.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-03T16:20:47.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-03T16:20:47.640 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-03T16:20:47.640 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-03T16:20:47.640 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-03T16:20:47.640 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-03T16:20:47.640 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-03T16:20:47.640 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-03T16:20:47.640 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-03T16:20:47.640 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-03T16:20:47.640 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-03T16:20:47.640 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-03T16:20:47.640 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-03T16:20:47.640 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-03T16:20:47.640 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-03T16:20:47.640 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-03T16:20:47.640 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-03T16:20:47.640 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-03T16:20:47.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-03T16:20:47.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-03T16:20:47.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-03T16:20:47.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-03T16:20:47.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-03T16:20:47.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-03T16:20:47.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-03T16:20:47.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-03T16:20:47.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-03T16:20:47.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-03T16:20:47.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-03T16:20:47.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-03T16:20:47.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-03T16:20:47.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-03T16:20:47.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-03T16:20:47.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-03T16:20:47.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-03T16:20:47.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-03T16:20:47.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-03T16:20:47.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-03T16:20:47.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-03T16:20:47.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-03T16:20:47.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-03T16:20:47.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-03T16:20:47.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-03T16:20:47.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-03T16:20:47.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-03T16:20:47.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-03T16:20:47.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-03T16:20:47.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-03T16:20:47.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-03T16:20:47.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-03T16:20:47.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-03T16:20:47.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-03T16:20:47.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-03T16:20:47.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-03T16:20:47.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-03T16:20:47.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-03T16:20:47.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-03T16:20:47.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-03T16:20:47.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-03T16:20:47.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-03T16:20:47.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-03T16:20:47.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-03T16:20:47.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-03T16:20:47.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-03T16:20:47.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-03T16:20:47.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-03T16:20:47.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-03T16:20:47.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-03T16:20:47.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-03T16:20:47.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-03T16:20:47.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-03T16:20:47.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-03T16:20:47.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-03T16:20:47.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-03T16:20:47.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-03T16:20:47.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-03T16:20:47.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-03T16:20:47.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-03T16:20:47.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-03T16:20:47.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-03T16:20:47.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-03T16:20:47.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-03T16:20:47.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-03T16:20:47.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-03T16:20:47.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-03T16:20:47.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-03T16:20:47.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-03T16:20:47.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-03T16:20:47.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-03T16:20:47.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-03T16:20:47.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-03T16:20:47.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-03T16:20:47.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-03T16:20:47.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-03T16:20:47.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-03T16:20:47.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-03T16:20:47.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-03T16:20:47.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-03T16:20:47.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-03T16:20:47.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-03T16:20:47.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-03T16:20:47.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-03T16:20:47.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-03T16:20:47.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-03T16:20:47.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-03T16:20:47.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-03T16:20:47.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-03T16:20:47.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-03T16:20:47.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-03T16:20:47.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-03T16:20:47.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-03T16:20:47.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-03T16:20:47.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-03T16:20:47.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-03T16:20:47.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-03T16:20:47.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-03T16:20:47.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-03T16:20:47.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-03T16:20:47.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-03T16:20:47.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-03T16:20:47.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-03T16:20:47.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-03T16:20:47.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-03T16:20:47.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-03T16:20:47.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-03T16:20:47.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-03T16:20:47.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-03T16:20:47.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-03T16:20:47.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-03T16:20:47.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-03T16:20:47.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-03T16:20:47.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-03T16:20:47.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-03T16:20:47.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-03T16:20:47.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-03T16:20:47.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-03T16:20:47.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-03T16:20:47.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-03T16:20:47.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-03T16:20:47.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-03T16:20:47.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-03T16:20:47.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-03T16:20:47.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-03T16:20:47.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-03T16:20:47.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-03T16:20:47.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-03T16:20:47.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-03T16:20:47.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-03T16:20:47.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-03T16:20:47.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-03T16:20:47.650 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-03T16:20:47.650 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-03T16:20:47.650 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-03T16:20:47.650 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-03T16:20:47.650 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-03T16:20:47.650 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-03T16:20:47.650 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-03T16:20:47.650 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-03T16:20:47.650 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-03T16:20:47.650 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-03T16:20:47.650 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-03T16:20:47.650 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-03T16:20:47.650 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-03T16:20:47.650 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-03T16:20:47.650 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-03T16:20:47.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-03T16:20:47.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-03T16:20:47.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-03T16:20:47.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-03T16:20:47.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-03T16:20:47.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-03T16:20:47.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-03T16:20:47.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-03T16:20:47.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-03T16:20:47.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-03T16:20:47.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-03T16:20:47.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-03T16:20:47.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-03T16:20:47.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-03T16:20:47.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-03T16:20:47.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-03T16:20:47.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-03T16:20:47.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-03T16:20:47.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-03T16:20:47.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-03T16:20:47.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-03T16:20:47.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-03T16:20:47.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-03T16:20:47.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-03T16:20:47.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-03T16:20:47.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-03T16:20:47.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-03T16:20:47.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-03T16:20:47.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-03T16:20:47.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-03T16:20:47.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-03T16:20:47.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-03T16:20:47.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-03T16:20:47.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-03T16:20:47.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-03T16:20:47.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-03T16:20:47.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-03T16:20:47.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-03T16:20:47.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-03T16:20:47.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-03T16:20:47.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-03T16:20:47.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-03T16:20:47.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-03T16:20:47.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-03T16:20:47.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-03T16:20:47.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-03T16:20:47.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-03T16:20:47.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-03T16:20:47.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-03T16:20:47.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-03T16:20:47.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-03T16:20:47.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-03T16:20:47.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-03T16:20:47.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-03T16:20:47.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-03T16:20:47.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-03T16:20:47.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-03T16:20:47.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-03T16:20:47.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-03T16:20:47.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-03T16:20:47.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-03T16:20:47.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-03T16:20:47.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-03T16:20:47.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-03T16:20:47.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-03T16:20:47.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-03T16:20:47.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-03T16:20:47.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-03T16:20:47.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-03T16:20:47.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-03T16:20:47.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-03T16:20:47.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-03T16:20:47.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-03T16:20:47.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-03T16:20:47.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-03T16:20:47.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-03T16:20:47.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-03T16:20:47.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-03T16:20:47.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-03T16:20:47.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-03T16:20:47.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-03T16:20:47.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-03T16:20:47.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-03T16:20:47.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-03T16:20:47.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-03T16:20:47.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-03T16:20:47.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-03T16:20:47.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-03T16:20:47.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-03T16:20:47.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-03T16:20:47.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-03T16:20:47.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-03T16:20:47.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-03T16:20:47.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-03T16:20:47.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-03T16:20:47.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-03T16:20:47.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-03T16:20:47.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-03T16:20:47.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-03T16:20:47.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-03T16:20:47.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-03T16:20:47.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-03T16:20:47.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-03T16:20:47.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-03T16:20:47.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-03T16:20:47.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-03T16:20:47.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-03T16:20:47.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-03T16:20:47.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-03T16:20:47.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-03T16:20:47.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-03T16:20:47.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-03T16:20:47.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-03T16:20:47.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-03T16:20:47.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-03T16:20:47.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-03T16:20:47.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-03T16:20:47.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-03T16:20:47.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-03T16:20:47.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-03T16:20:47.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-03T16:20:47.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-03T16:20:47.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-03T16:20:47.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-03T16:20:47.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-03T16:20:47.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-03T16:20:47.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-03T16:20:47.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-03T16:20:47.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-03T16:20:47.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-03T16:20:47.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-03T16:20:47.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-03T16:20:47.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-03T16:20:47.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-03T16:20:47.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-03T16:20:47.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-03T16:20:47.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-03T16:20:47.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-03T16:20:47.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-03T16:20:47.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-03T16:20:47.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-03T16:20:47.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-03T16:20:47.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-03T16:20:47.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-03T16:20:47.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-03T16:20:47.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-03T16:20:47.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-03T16:20:47.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-03T16:20:47.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-03T16:20:47.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-03T16:20:47.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-03T16:20:47.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-03T16:20:47.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-03T16:20:47.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-03T16:20:47.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-03T16:20:47.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-03T16:20:47.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-03T16:20:47.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-03T16:20:47.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-03T16:20:47.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-03T16:20:47.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-03T16:20:47.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-03T16:20:47.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-03T16:20:47.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-03T16:20:47.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-03T16:20:47.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-03T16:20:47.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-03T16:20:47.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-03T16:20:47.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-03T16:20:47.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-03T16:20:47.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-03T16:20:47.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-03T16:20:47.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-03T16:20:47.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-03T16:20:47.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-03T16:20:47.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-03T16:20:47.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-03T16:20:47.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-03T16:20:47.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-03T16:20:47.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-03T16:20:47.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-03T16:20:47.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-03T16:20:47.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-03T16:20:47.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-03T16:20:47.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-03T16:20:47.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-03T16:20:47.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-03T16:20:47.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-03T16:20:47.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-03T16:20:47.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-03T16:20:47.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-03T16:20:47.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-03T16:20:47.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-03T16:20:47.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-03T16:20:47.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-03T16:20:47.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-03T16:20:47.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-03T16:20:47.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-03T16:20:47.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-03T16:20:47.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-03T16:20:47.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-03T16:20:47.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-03T16:20:47.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-03T16:20:47.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-03T16:20:47.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-03T16:20:47.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-03T16:20:47.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-03T16:20:47.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-03T16:20:47.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-03T16:20:47.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-03T16:20:47.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-03T16:20:47.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-03T16:20:47.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-03T16:20:47.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-03T16:20:47.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-03T16:20:47.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-03T16:20:47.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-03T16:20:47.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-03T16:20:47.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-03T16:20:47.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-03T16:20:47.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-03T16:20:47.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-03T16:20:47.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-03T16:20:47.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-03T16:20:47.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-03T16:20:47.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-03T16:20:47.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-03T16:20:47.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-03T16:20:47.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-03T16:20:47.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-03T16:20:47.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-03T16:20:47.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-03T16:20:47.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-03T16:20:47.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-03T16:20:47.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-03T16:20:47.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-03T16:20:47.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-03T16:20:47.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-03T16:20:47.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-03T16:20:47.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-03T16:20:47.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-03T16:20:47.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-03T16:20:47.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-03T16:20:47.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-03T16:20:47.668 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-03T16:20:47.668 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-03T16:20:47.668 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-03T16:20:47.668 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-03T16:20:47.668 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-03T16:20:47.668 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-03T16:20:47.668 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-03T16:20:47.668 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-03T16:20:47.668 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-03T16:20:47.668 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-03T16:20:47.668 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-03T16:20:47.668 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-03T16:20:47.668 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-03T16:20:47.668 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-03T16:20:47.669 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-03T16:20:47.669 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-03T16:20:47.669 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-03T16:20:47.669 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-03T16:20:47.669 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-03T16:20:47.669 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-03T16:20:47.669 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-03T16:20:47.669 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-03T16:20:47.669 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-03T16:20:47.669 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-03T16:20:47.669 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-03T16:20:47.669 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-03T16:20:47.669 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-03T16:20:47.669 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-03T16:20:47.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-03T16:20:47.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-03T16:20:47.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-03T16:20:47.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-03T16:20:47.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-03T16:20:47.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-03T16:20:47.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-03T16:20:47.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-03T16:20:47.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-03T16:20:47.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-03T16:20:47.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-03T16:20:47.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-03T16:20:47.674 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:47.674 DEBUG:teuthology.orchestra.run.smithi134:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-03T16:20:47.696 INFO:teuthology.orchestra.run.smithi134.stdout:postinstall scriptlet (using /bin/sh): 2024-05-03T16:20:47.696 INFO:teuthology.orchestra.run.smithi134.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-03T16:20:47.696 INFO:teuthology.orchestra.run.smithi134.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-03T16:20:47.697 INFO:teuthology.orchestra.run.smithi134.stdout:fi 2024-05-03T16:20:47.697 INFO:teuthology.orchestra.run.smithi134.stdout:for file in vmlinuz System.map config; do 2024-05-03T16:20:47.697 INFO:teuthology.orchestra.run.smithi134.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-03T16:20:47.697 INFO:teuthology.orchestra.run.smithi134.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-03T16:20:47.697 INFO:teuthology.orchestra.run.smithi134.stdout: fi 2024-05-03T16:20:47.697 INFO:teuthology.orchestra.run.smithi134.stdout:done 2024-05-03T16:20:47.697 INFO:teuthology.orchestra.run.smithi134.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-03T16:20:47.697 INFO:teuthology.orchestra.run.smithi134.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-03T16:20:47.697 INFO:teuthology.orchestra.run.smithi134.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-03T16:20:47.697 INFO:teuthology.orchestra.run.smithi134.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-03T16:20:47.697 INFO:teuthology.orchestra.run.smithi134.stdout:fi 2024-05-03T16:20:47.697 INFO:teuthology.orchestra.run.smithi134.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-03T16:20:47.697 INFO:teuthology.orchestra.run.smithi134.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:47.697 INFO:teuthology.orchestra.run.smithi134.stdout:fi 2024-05-03T16:20:47.698 INFO:teuthology.orchestra.run.smithi134.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-03T16:20:47.698 INFO:teuthology.orchestra.run.smithi134.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-03T16:20:47.698 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:47.698 INFO:teuthology.orchestra.run.smithi134.stdout:fi 2024-05-03T16:20:47.699 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -qi grub2-tools 2024-05-03T16:20:47.769 INFO:teuthology.orchestra.run.smithi134.stdout:Name : grub2-tools 2024-05-03T16:20:47.769 INFO:teuthology.orchestra.run.smithi134.stdout:Epoch : 1 2024-05-03T16:20:47.769 INFO:teuthology.orchestra.run.smithi134.stdout:Version : 2.06 2024-05-03T16:20:47.769 INFO:teuthology.orchestra.run.smithi134.stdout:Release : 68.el9 2024-05-03T16:20:47.769 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: x86_64 2024-05-03T16:20:47.769 INFO:teuthology.orchestra.run.smithi134.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-03T16:20:47.769 INFO:teuthology.orchestra.run.smithi134.stdout:Group : Unspecified 2024-05-03T16:20:47.769 INFO:teuthology.orchestra.run.smithi134.stdout:Size : 8264254 2024-05-03T16:20:47.770 INFO:teuthology.orchestra.run.smithi134.stdout:License : GPLv3+ 2024-05-03T16:20:47.770 INFO:teuthology.orchestra.run.smithi134.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-03T16:20:47.770 INFO:teuthology.orchestra.run.smithi134.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-03T16:20:47.770 INFO:teuthology.orchestra.run.smithi134.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-03T16:20:47.770 INFO:teuthology.orchestra.run.smithi134.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-03T16:20:47.770 INFO:teuthology.orchestra.run.smithi134.stdout:Packager : builder@centos.org 2024-05-03T16:20:47.770 INFO:teuthology.orchestra.run.smithi134.stdout:Vendor : CentOS 2024-05-03T16:20:47.770 INFO:teuthology.orchestra.run.smithi134.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-03T16:20:47.770 INFO:teuthology.orchestra.run.smithi134.stdout:Summary : Support tools for GRUB. 2024-05-03T16:20:47.770 INFO:teuthology.orchestra.run.smithi134.stdout:Description : 2024-05-03T16:20:47.770 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-03T16:20:47.770 INFO:teuthology.orchestra.run.smithi134.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-03T16:20:47.770 INFO:teuthology.orchestra.run.smithi134.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-03T16:20:47.770 INFO:teuthology.orchestra.run.smithi134.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-03T16:20:47.770 INFO:teuthology.orchestra.run.smithi134.stdout:hardware devices. 2024-05-03T16:20:47.771 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-03T16:20:47.771 INFO:teuthology.orchestra.run.smithi134.stdout:This subpackage provides tools for support of all platforms. 2024-05-03T16:20:47.771 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-03T16:20:47.772 INFO:teuthology.task.kernel:Updating grub on smithi134 to boot 6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:47.772 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-03T16:20:48.363 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-05-03T16:20:49.727 INFO:teuthology.orchestra.run.smithi134.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-03T16:20:49.756 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-05-03T16:20:49.758 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-05-03T16:20:49.773 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.KzW3uUXHtL 2024-05-03T16:20:49.773 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.KzW3uUXHtL 2024-05-03T16:20:49.847 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.KzW3uUXHtL 2024-05-03T16:20:49.990 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.KzW3uUXHtL is 6KB 2024-05-03T16:20:50.040 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.KzW3uUXHtL 2024-05-03T16:20:50.054 DEBUG:teuthology.orchestra.run.smithi134:> sudo /bin/ls /boot/loader/entries || true 2024-05-03T16:20:50.115 INFO:teuthology.orchestra.run.smithi134.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-03T16:20:50.116 INFO:teuthology.orchestra.run.smithi134.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-03T16:20:50.116 INFO:teuthology.orchestra.run.smithi134.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-03T16:20:50.116 INFO:teuthology.orchestra.run.smithi134.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-03T16:20:50.117 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:50.265 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-05-03T16:20:57.222 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-03T16:20:57.222 DEBUG:teuthology.orchestra.run.smithi081:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-03T16:20:57.308 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:57.308 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:57.308 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:57.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-03T16:20:57.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-03T16:20:57.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-03T16:20:57.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-03T16:20:57.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-03T16:20:57.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-03T16:20:57.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-03T16:20:57.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-03T16:20:57.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-03T16:20:57.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-03T16:20:57.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-03T16:20:57.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-03T16:20:57.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-03T16:20:57.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-03T16:20:57.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-03T16:20:57.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-03T16:20:57.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-03T16:20:57.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-03T16:20:57.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-03T16:20:57.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-03T16:20:57.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-03T16:20:57.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-03T16:20:57.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-03T16:20:57.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-03T16:20:57.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-03T16:20:57.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-03T16:20:57.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-03T16:20:57.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-03T16:20:57.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-03T16:20:57.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-03T16:20:57.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-03T16:20:57.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-03T16:20:57.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-03T16:20:57.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-03T16:20:57.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-03T16:20:57.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-03T16:20:57.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-03T16:20:57.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-03T16:20:57.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-03T16:20:57.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-03T16:20:57.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-03T16:20:57.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-03T16:20:57.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-03T16:20:57.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-03T16:20:57.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-03T16:20:57.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-03T16:20:57.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-03T16:20:57.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-03T16:20:57.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-03T16:20:57.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-03T16:20:57.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-03T16:20:57.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-03T16:20:57.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-03T16:20:57.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-03T16:20:57.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-03T16:20:57.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-03T16:20:57.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-03T16:20:57.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-03T16:20:57.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-03T16:20:57.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-03T16:20:57.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-03T16:20:57.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-03T16:20:57.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-03T16:20:57.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-03T16:20:57.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-03T16:20:57.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-03T16:20:57.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-03T16:20:57.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-03T16:20:57.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-03T16:20:57.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-03T16:20:57.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-03T16:20:57.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-03T16:20:57.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-03T16:20:57.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-03T16:20:57.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-03T16:20:57.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-03T16:20:57.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-03T16:20:57.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-03T16:20:57.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-03T16:20:57.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-03T16:20:57.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-03T16:20:57.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-03T16:20:57.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-03T16:20:57.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-03T16:20:57.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-03T16:20:57.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-03T16:20:57.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-03T16:20:57.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-03T16:20:57.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-03T16:20:57.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-03T16:20:57.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-03T16:20:57.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-03T16:20:57.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-03T16:20:57.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-03T16:20:57.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-03T16:20:57.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-03T16:20:57.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-03T16:20:57.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-03T16:20:57.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-03T16:20:57.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-03T16:20:57.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-03T16:20:57.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-03T16:20:57.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-03T16:20:57.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-03T16:20:57.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-03T16:20:57.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-03T16:20:57.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-03T16:20:57.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-03T16:20:57.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-03T16:20:57.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-03T16:20:57.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-03T16:20:57.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-03T16:20:57.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-03T16:20:57.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-03T16:20:57.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-03T16:20:57.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-03T16:20:57.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-03T16:20:57.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-03T16:20:57.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-03T16:20:57.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-03T16:20:57.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-03T16:20:57.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-03T16:20:57.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-03T16:20:57.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-03T16:20:57.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-03T16:20:57.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-03T16:20:57.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-03T16:20:57.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-03T16:20:57.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-03T16:20:57.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-03T16:20:57.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-03T16:20:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-03T16:20:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-03T16:20:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-03T16:20:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-03T16:20:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-03T16:20:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-03T16:20:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-03T16:20:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-03T16:20:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-03T16:20:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-03T16:20:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-03T16:20:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-03T16:20:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-03T16:20:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-03T16:20:57.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-03T16:20:57.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-03T16:20:57.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-03T16:20:57.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-03T16:20:57.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-03T16:20:57.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-03T16:20:57.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-03T16:20:57.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-03T16:20:57.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-03T16:20:57.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-03T16:20:57.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-03T16:20:57.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-03T16:20:57.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-03T16:20:57.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-03T16:20:57.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-03T16:20:57.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-03T16:20:57.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-03T16:20:57.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-03T16:20:57.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-03T16:20:57.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-03T16:20:57.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-03T16:20:57.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-03T16:20:57.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-03T16:20:57.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-03T16:20:57.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-03T16:20:57.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-03T16:20:57.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-03T16:20:57.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-03T16:20:57.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-03T16:20:57.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-03T16:20:57.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-03T16:20:57.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-03T16:20:57.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-03T16:20:57.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-03T16:20:57.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-03T16:20:57.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-03T16:20:57.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-03T16:20:57.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-03T16:20:57.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-03T16:20:57.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-03T16:20:57.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-03T16:20:57.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-03T16:20:57.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-03T16:20:57.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-03T16:20:57.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-03T16:20:57.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-03T16:20:57.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-03T16:20:57.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-03T16:20:57.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-03T16:20:57.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-03T16:20:57.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-03T16:20:57.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-03T16:20:57.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-03T16:20:57.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-03T16:20:57.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-03T16:20:57.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-03T16:20:57.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-03T16:20:57.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-03T16:20:57.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-03T16:20:57.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-03T16:20:57.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-03T16:20:57.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-03T16:20:57.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-03T16:20:57.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-03T16:20:57.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-03T16:20:57.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-03T16:20:57.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-03T16:20:57.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-03T16:20:57.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-03T16:20:57.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-03T16:20:57.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-03T16:20:57.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-03T16:20:57.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-03T16:20:57.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-03T16:20:57.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-03T16:20:57.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-03T16:20:57.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-03T16:20:57.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-03T16:20:57.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-03T16:20:57.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-03T16:20:57.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-03T16:20:57.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-03T16:20:57.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-03T16:20:57.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-03T16:20:57.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-03T16:20:57.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-03T16:20:57.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-03T16:20:57.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-03T16:20:57.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-03T16:20:57.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-03T16:20:57.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-03T16:20:57.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-03T16:20:57.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-03T16:20:57.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-03T16:20:57.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-03T16:20:57.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-03T16:20:57.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-03T16:20:57.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-03T16:20:57.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-03T16:20:57.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-03T16:20:57.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-03T16:20:57.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-03T16:20:57.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-03T16:20:57.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-03T16:20:57.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-03T16:20:57.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-03T16:20:57.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-03T16:20:57.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-03T16:20:57.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-03T16:20:57.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-03T16:20:57.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-03T16:20:57.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-03T16:20:57.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-03T16:20:57.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-03T16:20:57.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-03T16:20:57.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-03T16:20:57.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-03T16:20:57.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-03T16:20:57.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-03T16:20:57.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-03T16:20:57.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-03T16:20:57.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-03T16:20:57.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-03T16:20:57.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-03T16:20:57.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-03T16:20:57.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-03T16:20:57.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-03T16:20:57.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-03T16:20:57.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-03T16:20:57.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-03T16:20:57.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-03T16:20:57.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-03T16:20:57.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-03T16:20:57.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-03T16:20:57.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-03T16:20:57.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-03T16:20:57.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-03T16:20:57.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-03T16:20:57.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-03T16:20:57.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-03T16:20:57.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-03T16:20:57.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-03T16:20:57.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-03T16:20:57.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-03T16:20:57.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-03T16:20:57.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-03T16:20:57.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-03T16:20:57.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-03T16:20:57.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-03T16:20:57.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-03T16:20:57.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-03T16:20:57.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-03T16:20:57.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-03T16:20:57.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-03T16:20:57.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-03T16:20:57.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-03T16:20:57.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-03T16:20:57.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-03T16:20:57.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-03T16:20:57.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-03T16:20:57.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-03T16:20:57.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-03T16:20:57.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-03T16:20:57.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-03T16:20:57.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-03T16:20:57.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-03T16:20:57.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-03T16:20:57.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-03T16:20:57.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-03T16:20:57.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-03T16:20:57.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-03T16:20:57.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-03T16:20:57.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-03T16:20:57.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-03T16:20:57.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-03T16:20:57.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-03T16:20:57.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-03T16:20:57.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-03T16:20:57.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-03T16:20:57.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-03T16:20:57.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-03T16:20:57.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-03T16:20:57.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-03T16:20:57.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-03T16:20:57.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-03T16:20:57.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-03T16:20:57.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-03T16:20:57.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-03T16:20:57.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-03T16:20:57.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-03T16:20:57.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-03T16:20:57.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-03T16:20:57.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-03T16:20:57.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-03T16:20:57.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-03T16:20:57.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-03T16:20:57.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-03T16:20:57.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-03T16:20:57.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-03T16:20:57.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-03T16:20:57.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-03T16:20:57.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-03T16:20:57.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-03T16:20:57.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-03T16:20:57.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-03T16:20:57.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-03T16:20:57.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-03T16:20:57.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-03T16:20:57.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-03T16:20:57.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-03T16:20:57.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-03T16:20:57.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-03T16:20:57.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-03T16:20:57.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-03T16:20:57.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-03T16:20:57.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-03T16:20:57.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-03T16:20:57.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-03T16:20:57.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-03T16:20:57.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-03T16:20:57.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-03T16:20:57.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-03T16:20:57.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-03T16:20:57.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-03T16:20:57.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-03T16:20:57.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-03T16:20:57.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-03T16:20:57.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-03T16:20:57.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-03T16:20:57.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-03T16:20:57.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-03T16:20:57.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-03T16:20:57.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-03T16:20:57.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-03T16:20:57.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-03T16:20:57.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-03T16:20:57.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-03T16:20:57.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-03T16:20:57.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-03T16:20:57.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-03T16:20:57.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-03T16:20:57.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-03T16:20:57.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-03T16:20:57.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-03T16:20:57.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-03T16:20:57.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-03T16:20:57.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-03T16:20:57.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-03T16:20:57.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-03T16:20:57.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-03T16:20:57.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-03T16:20:57.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-03T16:20:57.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-03T16:20:57.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-03T16:20:57.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-03T16:20:57.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-03T16:20:57.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-03T16:20:57.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-03T16:20:57.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-03T16:20:57.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-03T16:20:57.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-03T16:20:57.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-03T16:20:57.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-03T16:20:57.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-03T16:20:57.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-03T16:20:57.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-03T16:20:57.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-03T16:20:57.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-03T16:20:57.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-03T16:20:57.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-03T16:20:57.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-03T16:20:57.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-03T16:20:57.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-03T16:20:57.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-03T16:20:57.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-03T16:20:57.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-03T16:20:57.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-03T16:20:57.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-03T16:20:57.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-03T16:20:57.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-03T16:20:57.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-03T16:20:57.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-03T16:20:57.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-03T16:20:57.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-03T16:20:57.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-03T16:20:57.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-03T16:20:57.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-03T16:20:57.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-03T16:20:57.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-03T16:20:57.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-03T16:20:57.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-03T16:20:57.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-03T16:20:57.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-03T16:20:57.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-03T16:20:57.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-03T16:20:57.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-03T16:20:57.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-03T16:20:57.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-03T16:20:57.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-03T16:20:57.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-03T16:20:57.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-03T16:20:57.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-03T16:20:57.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-03T16:20:57.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-03T16:20:57.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-03T16:20:57.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-03T16:20:57.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-03T16:20:57.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-03T16:20:57.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-03T16:20:57.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-03T16:20:57.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-03T16:20:57.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-03T16:20:57.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-03T16:20:57.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-03T16:20:57.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-03T16:20:57.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-03T16:20:57.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-03T16:20:57.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-03T16:20:57.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-03T16:20:57.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-03T16:20:57.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-03T16:20:57.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-03T16:20:57.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-03T16:20:57.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-03T16:20:57.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-03T16:20:57.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-03T16:20:57.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-03T16:20:57.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-03T16:20:57.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-03T16:20:57.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-03T16:20:57.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-03T16:20:57.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-03T16:20:57.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-03T16:20:57.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-03T16:20:57.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-03T16:20:57.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-03T16:20:57.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-03T16:20:57.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-03T16:20:57.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-03T16:20:57.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-03T16:20:57.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-03T16:20:57.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-03T16:20:57.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-03T16:20:57.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-03T16:20:57.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-03T16:20:57.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-03T16:20:57.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-03T16:20:57.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-03T16:20:57.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-03T16:20:57.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-03T16:20:57.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-03T16:20:57.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-03T16:20:57.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-03T16:20:57.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-03T16:20:57.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-03T16:20:57.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-03T16:20:57.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-03T16:20:57.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-03T16:20:57.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-03T16:20:57.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-03T16:20:57.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-03T16:20:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-03T16:20:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-03T16:20:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-03T16:20:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-03T16:20:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-03T16:20:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-03T16:20:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-03T16:20:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-03T16:20:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-03T16:20:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-03T16:20:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-03T16:20:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-03T16:20:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-03T16:20:57.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-03T16:20:57.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-03T16:20:57.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-03T16:20:57.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-03T16:20:57.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-03T16:20:57.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-03T16:20:57.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-03T16:20:57.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-03T16:20:57.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-03T16:20:57.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-03T16:20:57.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-03T16:20:57.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-03T16:20:57.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-03T16:20:57.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-03T16:20:57.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-03T16:20:57.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-03T16:20:57.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-03T16:20:57.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-03T16:20:57.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-03T16:20:57.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-03T16:20:57.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-03T16:20:57.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-03T16:20:57.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-03T16:20:57.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-03T16:20:57.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-03T16:20:57.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-03T16:20:57.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-03T16:20:57.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-03T16:20:57.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-03T16:20:57.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-03T16:20:57.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-03T16:20:57.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-03T16:20:57.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-03T16:20:57.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-03T16:20:57.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-03T16:20:57.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-03T16:20:57.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-03T16:20:57.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-03T16:20:57.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-03T16:20:57.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-03T16:20:57.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-03T16:20:57.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-03T16:20:57.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-03T16:20:57.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-03T16:20:57.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-03T16:20:57.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-03T16:20:57.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-03T16:20:57.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-03T16:20:57.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-03T16:20:57.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-03T16:20:57.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-03T16:20:57.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-03T16:20:57.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-03T16:20:57.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-03T16:20:57.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-03T16:20:57.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-03T16:20:57.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-03T16:20:57.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-03T16:20:57.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-03T16:20:57.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-03T16:20:57.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-03T16:20:57.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-03T16:20:57.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-03T16:20:57.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-03T16:20:57.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-03T16:20:57.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-03T16:20:57.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-03T16:20:57.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-03T16:20:57.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-03T16:20:57.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-03T16:20:57.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-03T16:20:57.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-03T16:20:57.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-03T16:20:57.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-03T16:20:57.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-03T16:20:57.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-03T16:20:57.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-03T16:20:57.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-03T16:20:57.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-03T16:20:57.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-03T16:20:57.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-03T16:20:57.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-03T16:20:57.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-03T16:20:57.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-03T16:20:57.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-03T16:20:57.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-03T16:20:57.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-03T16:20:57.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-03T16:20:57.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-03T16:20:57.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-03T16:20:57.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-03T16:20:57.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-03T16:20:57.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-03T16:20:57.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-03T16:20:57.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-03T16:20:57.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-03T16:20:57.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-03T16:20:57.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-03T16:20:57.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-03T16:20:57.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-03T16:20:57.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-03T16:20:57.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-03T16:20:57.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-03T16:20:57.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-03T16:20:57.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-03T16:20:57.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-03T16:20:57.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-03T16:20:57.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-03T16:20:57.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-03T16:20:57.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-03T16:20:57.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-03T16:20:57.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-03T16:20:57.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-03T16:20:57.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-03T16:20:57.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-03T16:20:57.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-03T16:20:57.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-03T16:20:57.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-03T16:20:57.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-03T16:20:57.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-03T16:20:57.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-03T16:20:57.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-03T16:20:57.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-03T16:20:57.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-03T16:20:57.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-03T16:20:57.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-03T16:20:57.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-03T16:20:57.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-03T16:20:57.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-03T16:20:57.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-03T16:20:57.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-03T16:20:57.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-03T16:20:57.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-03T16:20:57.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-03T16:20:57.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-03T16:20:57.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-03T16:20:57.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-03T16:20:57.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-03T16:20:57.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-03T16:20:57.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-03T16:20:57.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-03T16:20:57.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-03T16:20:57.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-03T16:20:57.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-03T16:20:57.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-03T16:20:57.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-03T16:20:57.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-03T16:20:57.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-03T16:20:57.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-03T16:20:57.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-03T16:20:57.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-03T16:20:57.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-03T16:20:57.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-03T16:20:57.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-03T16:20:57.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-03T16:20:57.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-03T16:20:57.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-03T16:20:57.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-03T16:20:57.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-03T16:20:57.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-03T16:20:57.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-03T16:20:57.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-03T16:20:57.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-03T16:20:57.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-03T16:20:57.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-03T16:20:57.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-03T16:20:57.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-03T16:20:57.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-03T16:20:57.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-03T16:20:57.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-03T16:20:57.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-03T16:20:57.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-03T16:20:57.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-03T16:20:57.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-03T16:20:57.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-03T16:20:57.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-03T16:20:57.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-03T16:20:57.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-03T16:20:57.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-03T16:20:57.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-03T16:20:57.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-03T16:20:57.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-03T16:20:57.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-03T16:20:57.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-03T16:20:57.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-03T16:20:57.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-03T16:20:57.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-03T16:20:57.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-03T16:20:57.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-03T16:20:57.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-03T16:20:57.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-03T16:20:57.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-03T16:20:57.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-03T16:20:57.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-03T16:20:57.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-03T16:20:57.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-03T16:20:57.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-03T16:20:57.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-03T16:20:57.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-03T16:20:57.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-03T16:20:57.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-03T16:20:57.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-03T16:20:57.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-03T16:20:57.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-03T16:20:57.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-03T16:20:57.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-03T16:20:57.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-03T16:20:57.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-03T16:20:57.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-03T16:20:57.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-03T16:20:57.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-03T16:20:57.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-03T16:20:57.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-03T16:20:57.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-03T16:20:57.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-03T16:20:57.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-03T16:20:57.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-03T16:20:57.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-03T16:20:57.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-03T16:20:57.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-03T16:20:57.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-03T16:20:57.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-03T16:20:57.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-03T16:20:57.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-03T16:20:57.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-03T16:20:57.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-03T16:20:57.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-03T16:20:57.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-03T16:20:57.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-03T16:20:57.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-03T16:20:57.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-03T16:20:57.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-03T16:20:57.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-03T16:20:57.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-03T16:20:57.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-03T16:20:57.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-03T16:20:57.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-03T16:20:57.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-03T16:20:57.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-03T16:20:57.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-03T16:20:57.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-03T16:20:57.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-03T16:20:57.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-03T16:20:57.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-03T16:20:57.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-03T16:20:57.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-03T16:20:57.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-03T16:20:57.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-03T16:20:57.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-03T16:20:57.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-03T16:20:57.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-03T16:20:57.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-03T16:20:57.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-03T16:20:57.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-03T16:20:57.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-03T16:20:57.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-03T16:20:57.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-03T16:20:57.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-03T16:20:57.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-03T16:20:57.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-03T16:20:57.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-03T16:20:57.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-03T16:20:57.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-03T16:20:57.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-03T16:20:57.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-03T16:20:57.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-03T16:20:57.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-03T16:20:57.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-03T16:20:57.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-03T16:20:57.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-03T16:20:57.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-03T16:20:57.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-03T16:20:57.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-03T16:20:57.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-03T16:20:57.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-03T16:20:57.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-03T16:20:57.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-03T16:20:57.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-03T16:20:57.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-03T16:20:57.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-03T16:20:57.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-03T16:20:57.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-03T16:20:57.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-03T16:20:57.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-03T16:20:57.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-03T16:20:57.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-03T16:20:57.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-03T16:20:57.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-03T16:20:57.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-03T16:20:57.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-03T16:20:57.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-03T16:20:57.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-03T16:20:57.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-03T16:20:57.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-03T16:20:57.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-03T16:20:57.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-03T16:20:57.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-03T16:20:57.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-03T16:20:57.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-03T16:20:57.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-03T16:20:57.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-03T16:20:57.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-03T16:20:57.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-03T16:20:57.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-03T16:20:57.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-03T16:20:57.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-03T16:20:57.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-03T16:20:57.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-03T16:20:57.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-03T16:20:57.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-03T16:20:57.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-03T16:20:57.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-03T16:20:57.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-03T16:20:57.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-03T16:20:57.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-03T16:20:57.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-03T16:20:57.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-03T16:20:57.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-03T16:20:57.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-03T16:20:57.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-03T16:20:57.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-03T16:20:57.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-03T16:20:57.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-03T16:20:57.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-03T16:20:57.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-03T16:20:57.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-03T16:20:57.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-03T16:20:57.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-03T16:20:57.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-03T16:20:57.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-03T16:20:57.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-03T16:20:57.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-03T16:20:57.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-03T16:20:57.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-03T16:20:57.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-03T16:20:57.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-03T16:20:57.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-03T16:20:57.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-03T16:20:57.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-03T16:20:57.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-03T16:20:57.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-03T16:20:57.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-03T16:20:57.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-03T16:20:57.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-03T16:20:57.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-03T16:20:57.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-03T16:20:57.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-03T16:20:57.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-03T16:20:57.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-03T16:20:57.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-03T16:20:57.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-03T16:20:57.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-03T16:20:57.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-03T16:20:57.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-03T16:20:57.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-03T16:20:57.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-03T16:20:57.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-03T16:20:57.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-03T16:20:57.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-03T16:20:57.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-03T16:20:57.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-03T16:20:57.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-03T16:20:57.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-03T16:20:57.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-03T16:20:57.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-03T16:20:57.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-03T16:20:57.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-03T16:20:57.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-03T16:20:57.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-03T16:20:57.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-03T16:20:57.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-03T16:20:57.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-03T16:20:57.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-03T16:20:57.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-03T16:20:57.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-03T16:20:57.375 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-03T16:20:57.377 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-03T16:20:57.377 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-03T16:20:57.377 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-03T16:20:57.377 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-03T16:20:57.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-03T16:20:57.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-03T16:20:57.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-03T16:20:57.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-03T16:20:57.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-03T16:20:57.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-03T16:20:57.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-03T16:20:57.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-03T16:20:57.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-03T16:20:57.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-03T16:20:57.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-03T16:20:57.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-03T16:20:57.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-03T16:20:57.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-03T16:20:57.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-03T16:20:57.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-03T16:20:57.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-03T16:20:57.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-03T16:20:57.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-03T16:20:57.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-03T16:20:57.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-03T16:20:57.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-03T16:20:57.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-03T16:20:57.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-03T16:20:57.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-03T16:20:57.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-03T16:20:57.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-03T16:20:57.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-03T16:20:57.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-03T16:20:57.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-03T16:20:57.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-03T16:20:57.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-03T16:20:57.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-03T16:20:57.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-03T16:20:57.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-03T16:20:57.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-03T16:20:57.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-03T16:20:57.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-03T16:20:57.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-03T16:20:57.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-03T16:20:57.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-03T16:20:57.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-03T16:20:57.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-03T16:20:57.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-03T16:20:57.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-03T16:20:57.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-03T16:20:57.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-03T16:20:57.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-03T16:20:57.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-03T16:20:57.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-03T16:20:57.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-03T16:20:57.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-03T16:20:57.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-03T16:20:57.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-03T16:20:57.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-03T16:20:57.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-03T16:20:57.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-03T16:20:57.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-03T16:20:57.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-03T16:20:57.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-03T16:20:57.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-03T16:20:57.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-03T16:20:57.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-03T16:20:57.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-03T16:20:57.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-03T16:20:57.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-03T16:20:57.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-03T16:20:57.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-03T16:20:57.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-03T16:20:57.383 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-03T16:20:57.383 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-03T16:20:57.383 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-03T16:20:57.383 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-03T16:20:57.383 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-03T16:20:57.383 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-03T16:20:57.383 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-03T16:20:57.383 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-03T16:20:57.383 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-03T16:20:57.383 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-03T16:20:57.383 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-03T16:20:57.383 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-03T16:20:57.383 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-03T16:20:57.383 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-03T16:20:57.384 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-03T16:20:57.384 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-03T16:20:57.384 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-03T16:20:57.384 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-03T16:20:57.384 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-03T16:20:57.384 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-03T16:20:57.384 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-03T16:20:57.384 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-03T16:20:57.384 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-03T16:20:57.384 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-03T16:20:57.384 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-03T16:20:57.384 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-03T16:20:57.384 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-03T16:20:57.385 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-03T16:20:57.385 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-03T16:20:57.385 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-03T16:20:57.385 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-03T16:20:57.385 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-03T16:20:57.385 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-03T16:20:57.385 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-03T16:20:57.385 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-03T16:20:57.385 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-03T16:20:57.385 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-03T16:20:57.385 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-03T16:20:57.385 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-03T16:20:57.385 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-03T16:20:57.385 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-03T16:20:57.385 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-03T16:20:57.386 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-03T16:20:57.386 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-03T16:20:57.386 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-03T16:20:57.386 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-03T16:20:57.386 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-03T16:20:57.386 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-03T16:20:57.386 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-03T16:20:57.386 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-03T16:20:57.386 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-03T16:20:57.386 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-03T16:20:57.386 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-03T16:20:57.386 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-03T16:20:57.386 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-03T16:20:57.387 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-03T16:20:57.387 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-03T16:20:57.387 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-03T16:20:57.387 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-03T16:20:57.387 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-03T16:20:57.387 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-03T16:20:57.387 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-03T16:20:57.387 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-03T16:20:57.387 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-03T16:20:57.387 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-03T16:20:57.387 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-03T16:20:57.387 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-03T16:20:57.388 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-03T16:20:57.388 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-03T16:20:57.388 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-03T16:20:57.388 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-03T16:20:57.388 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-03T16:20:57.388 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-03T16:20:57.388 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-03T16:20:57.388 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-03T16:20:57.388 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-03T16:20:57.388 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-03T16:20:57.388 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-03T16:20:57.388 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-03T16:20:57.388 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-03T16:20:57.389 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-03T16:20:57.389 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-03T16:20:57.389 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-03T16:20:57.389 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-03T16:20:57.389 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-03T16:20:57.389 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-03T16:20:57.389 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-03T16:20:57.389 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-03T16:20:57.389 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-03T16:20:57.389 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-03T16:20:57.389 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-03T16:20:57.389 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-03T16:20:57.390 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-03T16:20:57.390 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-03T16:20:57.390 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-03T16:20:57.390 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-03T16:20:57.390 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-03T16:20:57.390 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-03T16:20:57.390 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-03T16:20:57.390 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-03T16:20:57.390 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-03T16:20:57.390 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-03T16:20:57.390 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-03T16:20:57.390 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-03T16:20:57.391 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-03T16:20:57.391 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-03T16:20:57.391 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-03T16:20:57.391 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-03T16:20:57.391 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-03T16:20:57.391 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-03T16:20:57.391 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-03T16:20:57.391 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-03T16:20:57.391 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-03T16:20:57.391 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-03T16:20:57.391 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-03T16:20:57.391 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-03T16:20:57.391 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-03T16:20:57.391 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-03T16:20:57.392 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-03T16:20:57.392 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-03T16:20:57.392 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-03T16:20:57.392 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-03T16:20:57.392 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-03T16:20:57.392 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-03T16:20:57.392 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-03T16:20:57.392 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-03T16:20:57.392 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-03T16:20:57.392 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-03T16:20:57.392 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-03T16:20:57.392 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-03T16:20:57.392 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-03T16:20:57.392 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-03T16:20:57.393 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-03T16:20:57.393 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-03T16:20:57.393 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-03T16:20:57.393 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-03T16:20:57.393 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-03T16:20:57.393 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-03T16:20:57.393 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-03T16:20:57.393 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-03T16:20:57.393 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-03T16:20:57.393 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-03T16:20:57.393 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-03T16:20:57.393 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-03T16:20:57.393 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-03T16:20:57.394 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-03T16:20:57.394 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-03T16:20:57.394 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-03T16:20:57.394 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-03T16:20:57.394 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-03T16:20:57.394 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-03T16:20:57.394 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-03T16:20:57.394 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-03T16:20:57.394 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-03T16:20:57.394 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-03T16:20:57.394 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-03T16:20:57.394 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-03T16:20:57.394 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-03T16:20:57.395 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-03T16:20:57.395 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-03T16:20:57.395 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-03T16:20:57.395 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-03T16:20:57.395 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-03T16:20:57.395 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-03T16:20:57.395 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-03T16:20:57.395 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-03T16:20:57.395 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-03T16:20:57.395 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-03T16:20:57.395 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-03T16:20:57.395 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-03T16:20:57.395 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-03T16:20:57.396 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-03T16:20:57.396 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-03T16:20:57.396 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-03T16:20:57.396 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-03T16:20:57.396 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-03T16:20:57.396 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-03T16:20:57.396 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-03T16:20:57.396 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-03T16:20:57.396 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-03T16:20:57.396 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-03T16:20:57.396 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-03T16:20:57.396 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-03T16:20:57.396 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-03T16:20:57.397 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-03T16:20:57.397 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-03T16:20:57.397 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-03T16:20:57.397 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-03T16:20:57.397 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-03T16:20:57.397 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-03T16:20:57.397 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-03T16:20:57.397 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-03T16:20:57.397 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-03T16:20:57.397 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-03T16:20:57.397 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-03T16:20:57.397 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-03T16:20:57.397 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-03T16:20:57.397 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-03T16:20:57.398 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-03T16:20:57.398 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-03T16:20:57.398 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-03T16:20:57.398 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-03T16:20:57.398 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-03T16:20:57.398 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-03T16:20:57.398 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-03T16:20:57.398 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-03T16:20:57.398 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-03T16:20:57.398 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-03T16:20:57.398 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-03T16:20:57.398 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-03T16:20:57.398 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-03T16:20:57.398 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-03T16:20:57.399 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-03T16:20:57.399 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-03T16:20:57.399 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-03T16:20:57.399 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-03T16:20:57.399 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-03T16:20:57.399 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-03T16:20:57.399 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-03T16:20:57.399 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-03T16:20:57.399 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-03T16:20:57.399 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-03T16:20:57.399 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-03T16:20:57.399 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-03T16:20:57.399 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-03T16:20:57.399 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-03T16:20:57.400 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-03T16:20:57.400 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-03T16:20:57.400 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-03T16:20:57.400 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-03T16:20:57.400 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-03T16:20:57.400 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-03T16:20:57.400 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-03T16:20:57.400 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-03T16:20:57.400 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-03T16:20:57.400 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-03T16:20:57.400 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-03T16:20:57.400 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-03T16:20:57.400 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-03T16:20:57.401 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-03T16:20:57.401 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-03T16:20:57.401 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-03T16:20:57.401 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-03T16:20:57.401 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-03T16:20:57.401 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-03T16:20:57.401 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-03T16:20:57.401 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-03T16:20:57.401 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-03T16:20:57.401 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-03T16:20:57.401 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-03T16:20:57.401 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-03T16:20:57.401 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-03T16:20:57.401 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-03T16:20:57.402 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-03T16:20:57.402 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-03T16:20:57.402 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-03T16:20:57.402 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-03T16:20:57.402 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-03T16:20:57.402 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-03T16:20:57.402 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-03T16:20:57.402 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-03T16:20:57.402 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-03T16:20:57.402 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-03T16:20:57.402 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-03T16:20:57.402 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-03T16:20:57.402 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-03T16:20:57.403 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-03T16:20:57.403 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-03T16:20:57.403 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-03T16:20:57.403 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-03T16:20:57.403 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-03T16:20:57.403 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-03T16:20:57.403 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-03T16:20:57.403 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-03T16:20:57.403 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-03T16:20:57.403 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-03T16:20:57.403 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-03T16:20:57.403 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-03T16:20:57.403 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-03T16:20:57.404 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-03T16:20:57.404 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-03T16:20:57.404 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-03T16:20:57.404 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-03T16:20:57.404 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-03T16:20:57.404 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-03T16:20:57.404 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-03T16:20:57.404 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-03T16:20:57.404 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-03T16:20:57.404 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-03T16:20:57.404 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-03T16:20:57.404 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-03T16:20:57.405 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-03T16:20:57.405 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-03T16:20:57.405 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-03T16:20:57.405 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-03T16:20:57.405 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-03T16:20:57.405 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-03T16:20:57.405 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-03T16:20:57.405 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-03T16:20:57.405 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-03T16:20:57.405 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-03T16:20:57.405 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-03T16:20:57.406 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-03T16:20:57.406 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-03T16:20:57.406 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-03T16:20:57.406 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-03T16:20:57.406 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-03T16:20:57.406 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-03T16:20:57.406 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-03T16:20:57.406 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-03T16:20:57.406 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-03T16:20:57.406 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-03T16:20:57.406 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-03T16:20:57.406 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-03T16:20:57.406 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-03T16:20:57.406 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-03T16:20:57.407 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-03T16:20:57.407 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-03T16:20:57.407 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-03T16:20:57.407 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-03T16:20:57.407 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-03T16:20:57.407 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-03T16:20:57.407 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-03T16:20:57.407 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-03T16:20:57.407 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-03T16:20:57.407 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-03T16:20:57.407 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-03T16:20:57.407 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-03T16:20:57.407 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-03T16:20:57.407 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-03T16:20:57.407 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-03T16:20:57.408 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-03T16:20:57.408 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-03T16:20:57.408 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-03T16:20:57.408 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-03T16:20:57.408 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-03T16:20:57.408 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-03T16:20:57.408 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-03T16:20:57.408 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-03T16:20:57.408 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-03T16:20:57.408 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-03T16:20:57.408 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-03T16:20:57.408 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-03T16:20:57.408 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-03T16:20:57.409 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-03T16:20:57.409 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-03T16:20:57.409 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-03T16:20:57.409 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-03T16:20:57.409 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-03T16:20:57.409 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-03T16:20:57.409 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-03T16:20:57.409 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-03T16:20:57.409 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-03T16:20:57.409 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-03T16:20:57.409 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-03T16:20:57.409 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-03T16:20:57.409 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-03T16:20:57.409 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-03T16:20:57.410 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-03T16:20:57.410 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-03T16:20:57.410 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-03T16:20:57.410 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-03T16:20:57.410 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-03T16:20:57.410 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-03T16:20:57.410 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-03T16:20:57.410 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-03T16:20:57.410 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-03T16:20:57.410 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-03T16:20:57.410 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-03T16:20:57.410 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-03T16:20:57.410 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-03T16:20:57.411 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-03T16:20:57.411 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-03T16:20:57.411 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-03T16:20:57.411 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-03T16:20:57.411 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-03T16:20:57.411 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-03T16:20:57.411 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-03T16:20:57.411 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-03T16:20:57.411 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-03T16:20:57.411 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-03T16:20:57.411 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-03T16:20:57.411 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-03T16:20:57.411 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-03T16:20:57.411 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-03T16:20:57.412 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-03T16:20:57.412 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-03T16:20:57.412 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-03T16:20:57.412 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-03T16:20:57.412 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-03T16:20:57.412 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-03T16:20:57.412 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-03T16:20:57.412 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-03T16:20:57.412 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-03T16:20:57.412 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-03T16:20:57.412 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-03T16:20:57.412 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-03T16:20:57.412 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-03T16:20:57.412 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-03T16:20:57.413 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-03T16:20:57.413 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-03T16:20:57.413 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-03T16:20:57.413 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-03T16:20:57.413 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-03T16:20:57.413 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-03T16:20:57.413 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-03T16:20:57.413 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-03T16:20:57.413 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-03T16:20:57.413 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-03T16:20:57.413 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-03T16:20:57.413 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-03T16:20:57.413 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-03T16:20:57.414 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-03T16:20:57.414 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-03T16:20:57.414 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-03T16:20:57.414 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-03T16:20:57.414 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-03T16:20:57.414 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-03T16:20:57.414 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-03T16:20:57.414 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-03T16:20:57.414 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-03T16:20:57.414 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-03T16:20:57.414 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-03T16:20:57.414 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-03T16:20:57.414 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-03T16:20:57.414 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-03T16:20:57.415 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-03T16:20:57.415 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-03T16:20:57.415 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-03T16:20:57.415 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-03T16:20:57.415 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-03T16:20:57.415 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-03T16:20:57.415 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-03T16:20:57.415 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-03T16:20:57.415 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-03T16:20:57.415 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-03T16:20:57.415 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-03T16:20:57.415 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-03T16:20:57.416 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-03T16:20:57.416 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-03T16:20:57.416 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-03T16:20:57.416 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-03T16:20:57.416 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-03T16:20:57.416 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-03T16:20:57.416 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-03T16:20:57.416 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-03T16:20:57.416 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-03T16:20:57.416 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-03T16:20:57.416 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-03T16:20:57.416 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-03T16:20:57.416 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-03T16:20:57.416 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-03T16:20:57.417 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-03T16:20:57.417 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-03T16:20:57.417 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-03T16:20:57.417 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-03T16:20:57.417 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-03T16:20:57.417 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-03T16:20:57.417 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-03T16:20:57.417 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-03T16:20:57.417 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-03T16:20:57.417 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-03T16:20:57.417 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-03T16:20:57.417 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-03T16:20:57.417 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-03T16:20:57.417 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-03T16:20:57.418 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-03T16:20:57.418 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-03T16:20:57.418 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-03T16:20:57.418 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-03T16:20:57.418 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-03T16:20:57.418 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-03T16:20:57.418 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-03T16:20:57.418 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-03T16:20:57.418 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-03T16:20:57.418 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-03T16:20:57.418 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-03T16:20:57.418 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-03T16:20:57.418 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-03T16:20:57.419 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-03T16:20:57.419 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-03T16:20:57.419 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-03T16:20:57.419 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-03T16:20:57.419 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-03T16:20:57.419 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-03T16:20:57.419 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-03T16:20:57.419 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-03T16:20:57.419 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-03T16:20:57.419 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-03T16:20:57.419 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-03T16:20:57.419 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-03T16:20:57.419 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-03T16:20:57.420 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-03T16:20:57.420 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-03T16:20:57.420 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-03T16:20:57.420 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-03T16:20:57.420 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-03T16:20:57.420 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-03T16:20:57.420 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-03T16:20:57.420 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-03T16:20:57.420 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-03T16:20:57.420 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-03T16:20:57.420 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-03T16:20:57.420 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-03T16:20:57.420 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-03T16:20:57.420 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-03T16:20:57.421 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-03T16:20:57.421 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-03T16:20:57.421 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-03T16:20:57.421 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-03T16:20:57.421 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-03T16:20:57.421 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-03T16:20:57.421 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-03T16:20:57.421 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-03T16:20:57.421 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-03T16:20:57.421 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-03T16:20:57.421 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-03T16:20:57.421 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-03T16:20:57.421 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-03T16:20:57.421 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-03T16:20:57.421 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-03T16:20:57.422 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-03T16:20:57.422 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-03T16:20:57.422 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-03T16:20:57.422 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-03T16:20:57.422 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-03T16:20:57.422 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-03T16:20:57.422 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-03T16:20:57.422 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-03T16:20:57.422 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-03T16:20:57.422 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-03T16:20:57.422 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-03T16:20:57.422 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-03T16:20:57.423 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-03T16:20:57.423 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-03T16:20:57.423 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-03T16:20:57.423 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-03T16:20:57.423 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-03T16:20:57.423 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-03T16:20:57.423 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-03T16:20:57.423 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-03T16:20:57.423 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-03T16:20:57.423 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-03T16:20:57.423 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-03T16:20:57.423 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-03T16:20:57.423 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-03T16:20:57.424 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-03T16:20:57.424 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-03T16:20:57.424 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-03T16:20:57.424 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-03T16:20:57.424 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-03T16:20:57.424 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-03T16:20:57.424 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-03T16:20:57.424 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-03T16:20:57.424 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-03T16:20:57.424 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-03T16:20:57.424 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-03T16:20:57.424 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-03T16:20:57.424 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-03T16:20:57.424 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-03T16:20:57.425 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-03T16:20:57.425 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-03T16:20:57.425 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-03T16:20:57.425 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-03T16:20:57.425 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-03T16:20:57.425 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-03T16:20:57.425 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-03T16:20:57.425 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-03T16:20:57.425 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-03T16:20:57.425 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-03T16:20:57.425 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-03T16:20:57.425 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-03T16:20:57.426 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-03T16:20:57.426 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-03T16:20:57.426 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-03T16:20:57.426 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-03T16:20:57.426 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-03T16:20:57.426 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-03T16:20:57.426 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-03T16:20:57.426 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-03T16:20:57.426 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-03T16:20:57.426 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-03T16:20:57.426 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-03T16:20:57.426 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-03T16:20:57.426 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-03T16:20:57.426 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-03T16:20:57.427 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-03T16:20:57.427 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-03T16:20:57.427 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-03T16:20:57.427 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-03T16:20:57.427 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-03T16:20:57.427 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-03T16:20:57.427 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-03T16:20:57.427 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-03T16:20:57.427 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-03T16:20:57.427 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-03T16:20:57.427 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-03T16:20:57.427 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-03T16:20:57.427 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-03T16:20:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-03T16:20:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-03T16:20:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-03T16:20:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-03T16:20:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-03T16:20:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-03T16:20:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-03T16:20:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-03T16:20:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-03T16:20:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-03T16:20:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-03T16:20:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-03T16:20:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-03T16:20:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-03T16:20:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-03T16:20:57.429 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-03T16:20:57.429 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-03T16:20:57.429 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-03T16:20:57.429 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-03T16:20:57.429 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-03T16:20:57.429 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-03T16:20:57.429 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-03T16:20:57.429 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-03T16:20:57.429 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-03T16:20:57.429 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-03T16:20:57.429 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-03T16:20:57.429 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-03T16:20:57.429 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-03T16:20:57.429 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-03T16:20:57.429 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-03T16:20:57.429 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-03T16:20:57.429 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-03T16:20:57.430 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-03T16:20:57.430 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-03T16:20:57.430 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-03T16:20:57.430 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-03T16:20:57.430 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-03T16:20:57.430 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-03T16:20:57.430 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-03T16:20:57.430 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-03T16:20:57.430 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-03T16:20:57.430 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-03T16:20:57.430 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-03T16:20:57.430 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-03T16:20:57.430 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-03T16:20:57.430 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-03T16:20:57.431 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-03T16:20:57.431 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-03T16:20:57.431 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-03T16:20:57.431 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-03T16:20:57.431 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-03T16:20:57.431 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-03T16:20:57.431 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-03T16:20:57.431 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-03T16:20:57.431 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-03T16:20:57.431 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-03T16:20:57.431 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-03T16:20:57.431 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-03T16:20:57.431 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-03T16:20:57.431 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-03T16:20:57.432 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-03T16:20:57.432 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-03T16:20:57.432 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-03T16:20:57.432 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-03T16:20:57.432 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-03T16:20:57.432 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-03T16:20:57.432 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-03T16:20:57.432 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-03T16:20:57.432 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-03T16:20:57.432 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-03T16:20:57.432 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-03T16:20:57.432 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-03T16:20:57.432 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-03T16:20:57.432 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-03T16:20:57.432 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-03T16:20:57.433 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-03T16:20:57.433 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-03T16:20:57.433 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-03T16:20:57.433 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-03T16:20:57.433 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-03T16:20:57.433 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-03T16:20:57.433 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-03T16:20:57.433 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-03T16:20:57.433 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-03T16:20:57.433 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-03T16:20:57.433 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-03T16:20:57.433 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-03T16:20:57.433 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-03T16:20:57.433 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-03T16:20:57.433 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-03T16:20:57.433 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-03T16:20:57.434 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-03T16:20:57.434 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-03T16:20:57.434 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-03T16:20:57.434 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-03T16:20:57.434 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-03T16:20:57.434 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-03T16:20:57.434 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-03T16:20:57.434 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-03T16:20:57.434 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-03T16:20:57.434 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-03T16:20:57.434 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-03T16:20:57.434 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-03T16:20:57.434 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-03T16:20:57.435 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-03T16:20:57.435 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-03T16:20:57.435 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-03T16:20:57.435 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-03T16:20:57.435 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-03T16:20:57.435 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-03T16:20:57.435 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-03T16:20:57.435 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-03T16:20:57.435 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-03T16:20:57.435 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-03T16:20:57.435 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-03T16:20:57.435 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-03T16:20:57.435 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-03T16:20:57.435 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-03T16:20:57.436 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-03T16:20:57.436 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-03T16:20:57.436 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-03T16:20:57.436 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-03T16:20:57.436 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-03T16:20:57.436 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-03T16:20:57.436 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-03T16:20:57.436 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-03T16:20:57.436 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-03T16:20:57.436 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-03T16:20:57.436 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-03T16:20:57.436 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-03T16:20:57.436 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-03T16:20:57.436 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-03T16:20:57.436 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-03T16:20:57.437 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-03T16:20:57.437 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-03T16:20:57.437 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-03T16:20:57.437 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-03T16:20:57.437 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-03T16:20:57.437 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-03T16:20:57.437 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-03T16:20:57.437 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-03T16:20:57.437 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-03T16:20:57.437 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-03T16:20:57.437 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-03T16:20:57.437 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-03T16:20:57.437 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-03T16:20:57.438 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-03T16:20:57.438 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-03T16:20:57.438 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-03T16:20:57.438 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-03T16:20:57.438 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-03T16:20:57.438 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-03T16:20:57.438 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-03T16:20:57.438 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-03T16:20:57.438 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-03T16:20:57.438 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-03T16:20:57.438 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-03T16:20:57.438 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-03T16:20:57.438 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-03T16:20:57.438 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-03T16:20:57.439 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-03T16:20:57.439 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-03T16:20:57.439 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-03T16:20:57.439 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-03T16:20:57.439 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-03T16:20:57.439 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-03T16:20:57.439 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-03T16:20:57.439 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-03T16:20:57.439 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-03T16:20:57.439 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-03T16:20:57.439 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-03T16:20:57.439 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-03T16:20:57.439 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-03T16:20:57.439 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-03T16:20:57.440 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-03T16:20:57.440 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-03T16:20:57.440 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-03T16:20:57.440 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-03T16:20:57.440 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-03T16:20:57.440 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-03T16:20:57.440 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-03T16:20:57.440 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-03T16:20:57.440 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-03T16:20:57.440 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-03T16:20:57.440 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-03T16:20:57.440 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-03T16:20:57.440 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-03T16:20:57.441 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-03T16:20:57.441 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-03T16:20:57.441 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-03T16:20:57.441 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-03T16:20:57.441 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-03T16:20:57.441 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-03T16:20:57.441 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-03T16:20:57.441 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-03T16:20:57.441 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-03T16:20:57.441 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-03T16:20:57.441 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-03T16:20:57.441 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-03T16:20:57.441 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-03T16:20:57.441 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-03T16:20:57.442 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-03T16:20:57.442 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-03T16:20:57.442 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-03T16:20:57.442 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-03T16:20:57.442 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-03T16:20:57.442 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-03T16:20:57.442 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-03T16:20:57.442 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-03T16:20:57.442 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-03T16:20:57.442 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-03T16:20:57.442 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-03T16:20:57.442 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-03T16:20:57.442 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-03T16:20:57.443 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-03T16:20:57.443 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-03T16:20:57.443 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-03T16:20:57.443 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-03T16:20:57.443 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-03T16:20:57.443 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-03T16:20:57.443 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-03T16:20:57.443 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-03T16:20:57.443 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-03T16:20:57.443 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-03T16:20:57.443 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-03T16:20:57.443 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-03T16:20:57.443 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-03T16:20:57.443 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-03T16:20:57.443 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-03T16:20:57.444 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-03T16:20:57.444 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-03T16:20:57.444 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-03T16:20:57.444 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-03T16:20:57.444 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-03T16:20:57.444 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-03T16:20:57.444 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-03T16:20:57.444 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-03T16:20:57.444 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-03T16:20:57.444 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-03T16:20:57.444 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-03T16:20:57.444 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-03T16:20:57.444 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-03T16:20:57.444 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-03T16:20:57.445 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-03T16:20:57.445 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-03T16:20:57.445 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-03T16:20:57.445 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-03T16:20:57.445 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-03T16:20:57.445 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-03T16:20:57.445 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-03T16:20:57.445 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-03T16:20:57.445 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-03T16:20:57.445 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-03T16:20:57.445 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-03T16:20:57.445 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-03T16:20:57.445 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-03T16:20:57.445 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-03T16:20:57.446 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-03T16:20:57.446 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-03T16:20:57.446 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-03T16:20:57.446 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-03T16:20:57.446 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-03T16:20:57.446 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-03T16:20:57.446 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-03T16:20:57.446 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-03T16:20:57.446 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-03T16:20:57.446 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-03T16:20:57.446 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-03T16:20:57.446 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-03T16:20:57.446 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-03T16:20:57.446 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-03T16:20:57.446 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-03T16:20:57.447 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-03T16:20:57.447 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-03T16:20:57.447 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-03T16:20:57.447 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-03T16:20:57.447 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-03T16:20:57.447 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-03T16:20:57.447 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-03T16:20:57.447 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-03T16:20:57.447 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-03T16:20:57.447 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-03T16:20:57.447 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-03T16:20:57.447 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-03T16:20:57.447 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-03T16:20:57.447 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-03T16:20:57.447 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-03T16:20:57.448 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-03T16:20:57.448 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-03T16:20:57.448 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-03T16:20:57.448 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-03T16:20:57.448 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-03T16:20:57.448 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-03T16:20:57.448 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-03T16:20:57.448 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-03T16:20:57.448 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-03T16:20:57.448 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-03T16:20:57.448 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-03T16:20:57.448 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-03T16:20:57.448 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-03T16:20:57.448 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-03T16:20:57.448 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-03T16:20:57.448 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-03T16:20:57.449 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-03T16:20:57.449 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-03T16:20:57.449 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-03T16:20:57.449 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-03T16:20:57.449 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-03T16:20:57.449 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-03T16:20:57.449 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-03T16:20:57.449 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-03T16:20:57.449 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-03T16:20:57.449 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-03T16:20:57.449 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-03T16:20:57.449 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-03T16:20:57.449 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-03T16:20:57.449 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-03T16:20:57.449 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-03T16:20:57.450 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-03T16:20:57.450 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-03T16:20:57.450 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-03T16:20:57.450 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-03T16:20:57.450 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-03T16:20:57.450 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-03T16:20:57.450 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-03T16:20:57.450 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-03T16:20:57.450 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-03T16:20:57.450 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-03T16:20:57.450 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-03T16:20:57.450 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-03T16:20:57.450 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-03T16:20:57.450 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-03T16:20:57.451 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-03T16:20:57.451 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-03T16:20:57.451 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-03T16:20:57.451 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-03T16:20:57.451 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-03T16:20:57.451 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-03T16:20:57.451 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-03T16:20:57.451 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-03T16:20:57.451 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-03T16:20:57.451 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-03T16:20:57.451 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-03T16:20:57.451 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-03T16:20:57.451 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-03T16:20:57.452 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-03T16:20:57.452 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-03T16:20:57.452 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-03T16:20:57.452 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-03T16:20:57.452 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-03T16:20:57.452 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-03T16:20:57.452 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-03T16:20:57.452 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-03T16:20:57.452 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-03T16:20:57.452 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-03T16:20:57.452 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-03T16:20:57.452 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-03T16:20:57.452 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-03T16:20:57.452 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-03T16:20:57.453 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-03T16:20:57.453 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-03T16:20:57.453 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-03T16:20:57.453 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-03T16:20:57.453 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-03T16:20:57.453 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-03T16:20:57.453 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-03T16:20:57.453 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-03T16:20:57.453 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-03T16:20:57.453 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-03T16:20:57.453 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-03T16:20:57.453 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-03T16:20:57.453 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-03T16:20:57.453 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-03T16:20:57.454 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-03T16:20:57.454 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-03T16:20:57.454 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-03T16:20:57.454 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-03T16:20:57.458 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:57.458 DEBUG:teuthology.orchestra.run.smithi081:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-03T16:20:57.482 INFO:teuthology.orchestra.run.smithi081.stdout:postinstall scriptlet (using /bin/sh): 2024-05-03T16:20:57.482 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-03T16:20:57.482 INFO:teuthology.orchestra.run.smithi081.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-03T16:20:57.482 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2024-05-03T16:20:57.482 INFO:teuthology.orchestra.run.smithi081.stdout:for file in vmlinuz System.map config; do 2024-05-03T16:20:57.482 INFO:teuthology.orchestra.run.smithi081.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-03T16:20:57.482 INFO:teuthology.orchestra.run.smithi081.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-03T16:20:57.482 INFO:teuthology.orchestra.run.smithi081.stdout: fi 2024-05-03T16:20:57.482 INFO:teuthology.orchestra.run.smithi081.stdout:done 2024-05-03T16:20:57.483 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-03T16:20:57.483 INFO:teuthology.orchestra.run.smithi081.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-03T16:20:57.483 INFO:teuthology.orchestra.run.smithi081.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-03T16:20:57.483 INFO:teuthology.orchestra.run.smithi081.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-03T16:20:57.483 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2024-05-03T16:20:57.483 INFO:teuthology.orchestra.run.smithi081.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-03T16:20:57.483 INFO:teuthology.orchestra.run.smithi081.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:57.483 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2024-05-03T16:20:57.483 INFO:teuthology.orchestra.run.smithi081.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-03T16:20:57.483 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-03T16:20:57.483 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:57.483 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2024-05-03T16:20:57.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -qi grub2-tools 2024-05-03T16:20:57.557 INFO:teuthology.orchestra.run.smithi081.stdout:Name : grub2-tools 2024-05-03T16:20:57.557 INFO:teuthology.orchestra.run.smithi081.stdout:Epoch : 1 2024-05-03T16:20:57.557 INFO:teuthology.orchestra.run.smithi081.stdout:Version : 2.06 2024-05-03T16:20:57.558 INFO:teuthology.orchestra.run.smithi081.stdout:Release : 68.el9 2024-05-03T16:20:57.558 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: x86_64 2024-05-03T16:20:57.558 INFO:teuthology.orchestra.run.smithi081.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-03T16:20:57.558 INFO:teuthology.orchestra.run.smithi081.stdout:Group : Unspecified 2024-05-03T16:20:57.558 INFO:teuthology.orchestra.run.smithi081.stdout:Size : 8264254 2024-05-03T16:20:57.558 INFO:teuthology.orchestra.run.smithi081.stdout:License : GPLv3+ 2024-05-03T16:20:57.558 INFO:teuthology.orchestra.run.smithi081.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-03T16:20:57.558 INFO:teuthology.orchestra.run.smithi081.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-03T16:20:57.558 INFO:teuthology.orchestra.run.smithi081.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-03T16:20:57.558 INFO:teuthology.orchestra.run.smithi081.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-03T16:20:57.558 INFO:teuthology.orchestra.run.smithi081.stdout:Packager : builder@centos.org 2024-05-03T16:20:57.558 INFO:teuthology.orchestra.run.smithi081.stdout:Vendor : CentOS 2024-05-03T16:20:57.558 INFO:teuthology.orchestra.run.smithi081.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-03T16:20:57.558 INFO:teuthology.orchestra.run.smithi081.stdout:Summary : Support tools for GRUB. 2024-05-03T16:20:57.559 INFO:teuthology.orchestra.run.smithi081.stdout:Description : 2024-05-03T16:20:57.559 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:20:57.559 INFO:teuthology.orchestra.run.smithi081.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-03T16:20:57.559 INFO:teuthology.orchestra.run.smithi081.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-03T16:20:57.559 INFO:teuthology.orchestra.run.smithi081.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-03T16:20:57.559 INFO:teuthology.orchestra.run.smithi081.stdout:hardware devices. 2024-05-03T16:20:57.559 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:20:57.559 INFO:teuthology.orchestra.run.smithi081.stdout:This subpackage provides tools for support of all platforms. 2024-05-03T16:20:57.560 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-03T16:20:57.560 INFO:teuthology.task.kernel:Updating grub on smithi081 to boot 6.9.0-rc3-g806ec36b2112 2024-05-03T16:20:57.560 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-03T16:20:58.142 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-05-03T16:20:59.584 INFO:teuthology.orchestra.run.smithi081.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-03T16:20:59.603 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-05-03T16:20:59.605 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-05-03T16:20:59.620 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.HylNkJNapw 2024-05-03T16:20:59.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HylNkJNapw 2024-05-03T16:20:59.696 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.HylNkJNapw 2024-05-03T16:20:59.837 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.HylNkJNapw is 6KB 2024-05-03T16:20:59.885 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.HylNkJNapw 2024-05-03T16:20:59.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo /bin/ls /boot/loader/entries || true 2024-05-03T16:20:59.960 INFO:teuthology.orchestra.run.smithi081.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-03T16:20:59.960 INFO:teuthology.orchestra.run.smithi081.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-03T16:20:59.960 INFO:teuthology.orchestra.run.smithi081.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-03T16:20:59.960 INFO:teuthology.orchestra.run.smithi081.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-03T16:20:59.961 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-03T16:21:00.105 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-05-03T16:21:00.196 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-05-03T16:21:06.702 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-05-03T16:21:06.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-05-03T16:21:06.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T16:21:20.281 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-03T16:21:20.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-05-03T16:21:20.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T16:21:25.150 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-05-03T16:21:30.110 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-03T16:21:30.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-05-03T16:21:30.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T16:21:34.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-05-03T16:21:34.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T16:21:37.214 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-05-03T16:21:48.446 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-05-03T16:21:49.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-05-03T16:21:49.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T16:21:57.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-05-03T16:21:57.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T16:22:00.510 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-05-03T16:22:12.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-05-03T16:22:12.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T16:22:20.291 DEBUG:teuthology.orchestra.remote:timed out 2024-05-03T16:22:29.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-05-03T16:22:29.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T16:22:30.942 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-05-03T16:22:37.037 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-05-03T16:22:37.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-05-03T16:22:37.642 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-g806ec36b2112"... 2024-05-03T16:22:37.642 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-05-03T16:22:37.685 INFO:teuthology.orchestra.run.smithi134.stdout:6.9.0-rc3-g806ec36b2112 2024-05-03T16:22:37.686 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-03T16:22:37.686 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-03T16:22:37.686 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-03T16:22:38.687 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-03T16:22:38.687 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-03T16:22:38.839 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-05-03T16:22:38.892 DEBUG:teuthology.parallel:result is None 2024-05-03T16:22:45.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-05-03T16:22:45.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T16:22:47.857 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-05-03T16:22:48.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-05-03T16:22:48.392 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-g806ec36b2112"... 2024-05-03T16:22:48.392 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-05-03T16:22:48.435 INFO:teuthology.orchestra.run.smithi081.stdout:6.9.0-rc3-g806ec36b2112 2024-05-03T16:22:48.435 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-03T16:22:48.435 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-03T16:22:48.435 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-03T16:22:49.218 DEBUG:teuthology.orchestra.remote:timed out 2024-05-03T16:22:49.436 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-03T16:22:49.436 DEBUG:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-03T16:22:49.647 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2024-05-03T16:22:49.708 DEBUG:teuthology.parallel:result is None 2024-05-03T16:23:04.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-05-03T16:23:04.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T16:23:04.540 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-05-03T16:23:05.222 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-05-03T16:23:05.222 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.9.0-rc3-g806ec36b2112"... 2024-05-03T16:23:05.222 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2024-05-03T16:23:05.271 INFO:teuthology.orchestra.run.smithi146.stdout:6.9.0-rc3-g806ec36b2112 2024-05-03T16:23:05.271 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-03T16:23:05.271 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-03T16:23:05.271 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-03T16:23:06.272 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-05-03T16:23:06.273 DEBUG:teuthology.orchestra.run.smithi146:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-03T16:23:06.396 INFO:teuthology.orchestra.run.smithi146.stdout:ttyS1 2024-05-03T16:23:06.459 DEBUG:teuthology.parallel:result is None 2024-05-03T16:23:06.459 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-03T16:23:06.471 INFO:teuthology.task.internal:Creating test directory... 2024-05-03T16:23:06.471 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-03T16:23:06.480 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-03T16:23:06.489 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-03T16:23:06.543 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-03T16:23:06.550 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-03T16:23:06.612 INFO:teuthology.task.internal:Creating archive directory... 2024-05-03T16:23:06.613 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-03T16:23:06.620 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-03T16:23:06.626 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-03T16:23:06.788 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-03T16:23:06.794 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-03T16:23:06.795 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-03T16:23:06.802 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-03T16:23:06.809 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-03T16:23:06.887 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-03T16:23:06.899 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-03T16:23:06.901 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-03T16:23:06.915 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-03T16:23:06.929 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-03T16:23:06.935 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-03T16:23:06.942 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-03T16:23:06.949 INFO:teuthology.task.internal:Configuring sudo... 2024-05-03T16:23:06.949 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-03T16:23:06.956 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-03T16:23:06.963 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-03T16:23:07.048 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-03T16:23:07.057 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-03T16:23:07.058 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-03T16:23:07.065 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-03T16:23:07.072 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-03T16:23:07.128 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-03T16:23:07.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-03T16:23:07.297 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-03T16:23:07.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-03T16:23:07.462 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T16:23:07.462 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-03T16:23:07.542 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-03T16:23:07.629 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-03T16:23:07.745 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-03T16:23:07.828 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-03T16:23:07.907 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-03T16:23:07.907 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-03T16:23:07.986 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-03T16:23:08.074 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-03T16:23:08.166 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-03T16:23:08.246 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-03T16:23:08.332 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-05-03T16:23:08.333 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-03T16:23:08.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-05-03T16:23:08.425 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-05-03T16:23:08.432 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2024-05-03T16:23:08.531 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-03T16:23:08.549 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-03T16:23:08.569 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-03T16:23:09.087 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-03T16:23:09.094 INFO:teuthology.task.internal:Starting timer... 2024-05-03T16:23:09.094 INFO:teuthology.run_tasks:Running task pcp... 2024-05-03T16:23:09.150 INFO:teuthology.run_tasks:Running task selinux... 2024-05-03T16:23:09.232 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-03T16:23:09.233 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2024-05-03T16:23:09.357 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2024-05-03T16:23:09.362 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-05-03T16:23:09.477 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-05-03T16:23:09.481 DEBUG:teuthology.orchestra.run.smithi146:> sudo service auditd rotate 2024-05-03T16:23:09.611 INFO:teuthology.orchestra.run.smithi146.stdout:Rotating logs: 2024-05-03T16:23:09.615 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-03T16:23:09.615 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2024-05-03T16:23:09.696 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2024-05-03T16:23:09.696 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-05-03T16:23:09.750 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-05-03T16:23:09.751 DEBUG:teuthology.orchestra.run.smithi146:> /usr/sbin/getenforce 2024-05-03T16:23:09.810 INFO:teuthology.orchestra.run.smithi146.stdout:Permissive 2024-05-03T16:23:09.811 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi134.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi146.front.sepia.ceph.com': 'permissive'} 2024-05-03T16:23:09.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-03T16:23:09.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T16:23:09.889 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-03T16:23:09.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T16:23:09.968 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-03T16:23:10.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T16:23:10.050 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-03T16:23:10.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2024-05-03T16:23:10.118 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-05-03T16:23:10.189 DEBUG:teuthology.orchestra.run.smithi146:> sudo /usr/sbin/setenforce permissive 2024-05-03T16:23:10.261 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-03T16:23:10.272 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-03T16:23:10.278 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-03T16:23:10.426 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-03T16:23:10.444 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-03T16:23:10.446 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi134.front.sepia.ceph.com,smithi146.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-03T16:28:43.990 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com'), Remote(name='ubuntu@smithi146.front.sepia.ceph.com')] 2024-05-03T16:28:43.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-05-03T16:28:43.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T16:28:44.109 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-05-03T16:28:44.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-05-03T16:28:44.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-05-03T16:28:44.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T16:28:44.361 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-05-03T16:28:44.509 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-05-03T16:28:44.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-05-03T16:28:44.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T16:28:44.610 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-05-03T16:28:44.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-05-03T16:28:44.761 INFO:teuthology.run_tasks:Running task clock... 2024-05-03T16:28:44.772 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-03T16:28:44.772 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-03T16:28:44.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-03T16:28:44.780 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-03T16:28:44.780 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-03T16:28:44.787 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-03T16:28:44.787 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-03T16:28:44.870 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-03T16:28:44.871 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-03T16:28:44.885 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-03T16:28:44.914 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-03T16:28:44.916 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-03T16:28:44.929 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-03T16:28:44.988 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2024-05-03T16:28:44.989 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-05-03T16:28:45.008 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: ntpd: command not found 2024-05-03T16:28:45.017 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2024-05-03T16:28:45.023 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-05-03T16:28:45.041 INFO:teuthology.orchestra.run.smithi146.stdout:506 Cannot talk to daemon 2024-05-03T16:28:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-03T16:28:45.065 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-03T16:28:45.082 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-03T16:28:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-03T16:28:45.107 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-03T16:28:45.123 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-03T16:28:45.234 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-05-03T16:28:45.242 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-05-03T16:28:45.242 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-03T16:28:45.242 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-05-03T16:28:45.242 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T16:28:45.243 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T16:28:45.243 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T16:28:45.243 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T16:28:45.250 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-03T16:28:45.250 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-05-03T16:28:45.250 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T16:28:45.251 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T16:28:45.251 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T16:28:45.251 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T16:28:45.262 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: ntpq: command not found 2024-05-03T16:28:45.272 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-03T16:28:45.272 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2024-05-03T16:28:45.272 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T16:28:45.272 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T16:28:45.272 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T16:28:45.272 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T16:28:45.273 INFO:teuthology.run_tasks:Running task install... 2024-05-03T16:28:45.283 DEBUG:teuthology.task.install:project ceph 2024-05-03T16:28:45.283 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea'}} 2024-05-03T16:28:45.283 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea'} 2024-05-03T16:28:45.283 INFO:teuthology.task.install:Using flavor: default 2024-05-03T16:28:45.289 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-03T16:28:45.289 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-03T16:28:45.289 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea', 'tag': None, 'wait_for_package': False} 2024-05-03T16:28:45.290 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T16:28:45.292 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea', 'tag': None, 'wait_for_package': False} 2024-05-03T16:28:45.292 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T16:28:45.293 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea', 'tag': None, 'wait_for_package': False} 2024-05-03T16:28:45.293 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T16:28:45.443 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/ 2024-05-03T16:28:45.443 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3450.g9a047fe7 2024-05-03T16:28:45.447 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/ 2024-05-03T16:28:45.447 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3450.g9a047fe7 2024-05-03T16:28:45.521 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/ 2024-05-03T16:28:45.521 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3450.g9a047fe7 2024-05-03T16:28:45.561 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-03T16:28:45.562 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T16:28:45.562 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-03T16:28:45.565 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-03T16:28:45.566 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-05-03T16:28:45.566 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-03T16:28:45.631 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-03T16:28:45.631 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-03T16:28:45.632 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-03T16:28:45.654 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-03T16:28:45.655 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9a047fe7599a549042d06a3fb5b6813a203eabea/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-03T16:28:45.659 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-03T16:28:45.659 DEBUG:teuthology.orchestra.run.smithi146:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9a047fe7599a549042d06a3fb5b6813a203eabea/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-03T16:28:45.721 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-03T16:28:45.721 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9a047fe7599a549042d06a3fb5b6813a203eabea/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-03T16:28:45.779 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-03T16:28:45.788 DEBUG:teuthology.orchestra.run.smithi146:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-03T16:28:45.846 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-03T16:28:45.882 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-03T16:28:45.900 DEBUG:teuthology.orchestra.run.smithi146:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-03T16:28:45.955 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-03T16:28:45.956 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2024-05-03T16:28:45.961 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2024-05-03T16:28:45.980 INFO:teuthology.orchestra.run.smithi146.stdout:check_obsoletes = 1 2024-05-03T16:28:45.984 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum clean all 2024-05-03T16:28:46.033 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-05-03T16:28:46.038 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-05-03T16:28:46.278 INFO:teuthology.orchestra.run.smithi081.stdout:50 files removed 2024-05-03T16:28:46.311 INFO:teuthology.orchestra.run.smithi146.stdout:50 files removed 2024-05-03T16:28:46.319 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-03T16:28:46.350 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-03T16:28:46.364 INFO:teuthology.orchestra.run.smithi134.stdout:50 files removed 2024-05-03T16:28:46.403 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-03T16:28:47.225 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 217 kB/s | 84 kB 00:00 2024-05-03T16:28:47.240 INFO:teuthology.orchestra.run.smithi146.stdout:ceph packages for x86_64 184 kB/s | 84 kB 00:00 2024-05-03T16:28:47.296 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 154 kB/s | 84 kB 00:00 2024-05-03T16:28:47.731 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 29 kB/s | 12 kB 00:00 2024-05-03T16:28:47.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph noarch packages 23 kB/s | 12 kB 00:00 2024-05-03T16:28:48.080 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 17 kB/s | 12 kB 00:00 2024-05-03T16:28:48.243 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 4.4 kB/s | 1.9 kB 00:00 2024-05-03T16:28:48.384 INFO:teuthology.orchestra.run.smithi146.stdout:ceph source packages 4.3 kB/s | 1.9 kB 00:00 2024-05-03T16:28:48.556 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2024-05-03T16:28:49.246 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-05-03T16:28:49.266 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 8.6 MB/s | 8.0 MB 00:00 2024-05-03T16:28:49.557 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - BaseOS 7.4 MB/s | 8.0 MB 00:01 2024-05-03T16:28:51.425 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-05-03T16:28:51.734 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-05-03T16:28:51.786 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:01 2024-05-03T16:28:55.893 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-05-03T16:28:56.156 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-05-03T16:28:56.472 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.2 MB 00:00 2024-05-03T16:28:57.603 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 16 kB 00:00 2024-05-03T16:28:58.060 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 16 kB 00:00 2024-05-03T16:28:58.679 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 24 MB/s | 21 MB 00:00 2024-05-03T16:28:58.790 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 16 kB 00:01 2024-05-03T16:28:59.436 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-05-03T16:28:59.892 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 23 MB/s | 21 MB 00:00 2024-05-03T16:29:04.604 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-03T16:29:05.394 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-05-03T16:29:05.884 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-05-03T16:29:06.963 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-03T16:29:06.964 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-03T16:29:06.981 INFO:teuthology.orchestra.run.smithi134.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-03T16:29:06.982 INFO:teuthology.orchestra.run.smithi134.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-03T16:29:06.983 INFO:teuthology.orchestra.run.smithi134.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-03T16:29:06.984 INFO:teuthology.orchestra.run.smithi134.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-03T16:29:06.986 INFO:teuthology.orchestra.run.smithi134.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-03T16:29:06.989 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-03T16:29:06.990 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-03T16:29:07.056 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-05-03T16:29:07.081 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-05-03T16:29:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-05-03T16:29:07.082 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-05-03T16:29:07.082 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-05-03T16:29:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-03T16:29:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 6.6 k 2024-05-03T16:29:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 5.4 M 2024-05-03T16:29:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 891 k 2024-05-03T16:29:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 145 k 2024-05-03T16:29:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 1.5 M 2024-05-03T16:29:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 142 k 2024-05-03T16:29:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 3.5 M 2024-05-03T16:29:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 7.4 M 2024-05-03T16:29:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 49 k 2024-05-03T16:29:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 11 M 2024-05-03T16:29:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 49 M 2024-05-03T16:29:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 273 k 2024-05-03T16:29:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 763 k 2024-05-03T16:29:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 225 k 2024-05-03T16:29:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 27 k 2024-05-03T16:29:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 18 k 2024-05-03T16:29:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-03T16:29:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-03T16:29:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-03T16:29:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 32 k 2024-05-03T16:29:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 747 k 2024-05-03T16:29:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 127 k 2024-05-03T16:29:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-03T16:29:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-03T16:29:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-03T16:29:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-03T16:29:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-03T16:29:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-03T16:29:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 161 k 2024-05-03T16:29:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 320 k 2024-05-03T16:29:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 298 k 2024-05-03T16:29:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 100 k 2024-05-03T16:29:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 85 k 2024-05-03T16:29:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.1 M 2024-05-03T16:29:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 170 k 2024-05-03T16:29:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-03T16:29:07.084 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-05-03T16:29:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.4 M 2024-05-03T16:29:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.1 M 2024-05-03T16:29:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-03T16:29:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-03T16:29:07.085 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-05-03T16:29:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-03T16:29:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-03T16:29:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-03T16:29:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 21 M 2024-05-03T16:29:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 34 k 2024-05-03T16:29:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 2.4 M 2024-05-03T16:29:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 274 k 2024-05-03T16:29:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 4.7 M 2024-05-03T16:29:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 17 M 2024-05-03T16:29:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 16 k 2024-05-03T16:29:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 25 k 2024-05-03T16:29:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-03T16:29:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-03T16:29:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-03T16:29:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-03T16:29:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-03T16:29:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-03T16:29:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-03T16:29:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-03T16:29:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 163 k 2024-05-03T16:29:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-03T16:29:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-03T16:29:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-03T16:29:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-03T16:29:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-03T16:29:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 500 k 2024-05-03T16:29:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-03T16:29:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 5.4 M 2024-05-03T16:29:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-03T16:29:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-03T16:29:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-03T16:29:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-03T16:29:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-03T16:29:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-03T16:29:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-03T16:29:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-03T16:29:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-03T16:29:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-03T16:29:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-03T16:29:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-03T16:29:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-03T16:29:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-03T16:29:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-03T16:29:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-03T16:29:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-03T16:29:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 45 k 2024-05-03T16:29:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 135 k 2024-05-03T16:29:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-03T16:29:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-03T16:29:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-03T16:29:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-03T16:29:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-03T16:29:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-03T16:29:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-03T16:29:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-03T16:29:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-03T16:29:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-03T16:29:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-03T16:29:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-03T16:29:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-03T16:29:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-03T16:29:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-03T16:29:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-03T16:29:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-03T16:29:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-03T16:29:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-03T16:29:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-03T16:29:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-03T16:29:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-03T16:29:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-03T16:29:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-03T16:29:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-03T16:29:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-03T16:29:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-03T16:29:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-03T16:29:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-03T16:29:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-03T16:29:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-03T16:29:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-03T16:29:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-03T16:29:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-03T16:29:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-03T16:29:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-03T16:29:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-03T16:29:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-03T16:29:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-03T16:29:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-03T16:29:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-03T16:29:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-03T16:29:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-03T16:29:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-03T16:29:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-03T16:29:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-03T16:29:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-03T16:29:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-03T16:29:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-03T16:29:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-03T16:29:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-03T16:29:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-03T16:29:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-03T16:29:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-03T16:29:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-03T16:29:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-03T16:29:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-03T16:29:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-03T16:29:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-03T16:29:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-03T16:29:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-03T16:29:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-03T16:29:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-03T16:29:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-05-03T16:29:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-03T16:29:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-03T16:29:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-05-03T16:29:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-05-03T16:29:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:Install 148 Packages 2024-05-03T16:29:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 4 Packages 2024-05-03T16:29:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-03T16:29:07.094 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 222 M 2024-05-03T16:29:07.094 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-05-03T16:29:07.722 INFO:teuthology.orchestra.run.smithi134.stdout:(1/152): ceph-19.0.0-3450.g9a047fe7.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2024-05-03T16:29:07.821 INFO:teuthology.orchestra.run.smithi146.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-03T16:29:07.822 INFO:teuthology.orchestra.run.smithi146.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-03T16:29:07.844 INFO:teuthology.orchestra.run.smithi146.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-03T16:29:07.845 INFO:teuthology.orchestra.run.smithi146.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-03T16:29:07.846 INFO:teuthology.orchestra.run.smithi146.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-03T16:29:07.848 INFO:teuthology.orchestra.run.smithi146.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-03T16:29:07.850 INFO:teuthology.orchestra.run.smithi146.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-03T16:29:07.853 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-03T16:29:07.855 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-03T16:29:07.926 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-05-03T16:29:07.939 INFO:teuthology.orchestra.run.smithi146.stdout:======================================================================================= 2024-05-03T16:29:07.939 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2024-05-03T16:29:07.939 INFO:teuthology.orchestra.run.smithi146.stdout:======================================================================================= 2024-05-03T16:29:07.940 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-05-03T16:29:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-03T16:29:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: ceph x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 6.6 k 2024-05-03T16:29:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 5.4 M 2024-05-03T16:29:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 891 k 2024-05-03T16:29:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 145 k 2024-05-03T16:29:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 1.5 M 2024-05-03T16:29:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 142 k 2024-05-03T16:29:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 3.5 M 2024-05-03T16:29:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 7.4 M 2024-05-03T16:29:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 49 k 2024-05-03T16:29:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 11 M 2024-05-03T16:29:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 49 M 2024-05-03T16:29:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 273 k 2024-05-03T16:29:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 763 k 2024-05-03T16:29:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 225 k 2024-05-03T16:29:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-shell x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 27 k 2024-05-03T16:29:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 18 k 2024-05-03T16:29:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-03T16:29:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-03T16:29:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-03T16:29:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 32 k 2024-05-03T16:29:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 747 k 2024-05-03T16:29:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 127 k 2024-05-03T16:29:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-03T16:29:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-03T16:29:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-03T16:29:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-03T16:29:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-03T16:29:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-03T16:29:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 161 k 2024-05-03T16:29:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 320 k 2024-05-03T16:29:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 298 k 2024-05-03T16:29:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 100 k 2024-05-03T16:29:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 85 k 2024-05-03T16:29:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.1 M 2024-05-03T16:29:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 170 k 2024-05-03T16:29:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-03T16:29:07.942 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrading: 2024-05-03T16:29:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: librados2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.4 M 2024-05-03T16:29:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.1 M 2024-05-03T16:29:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-03T16:29:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-03T16:29:07.943 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-05-03T16:29:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-03T16:29:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-03T16:29:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-03T16:29:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 21 M 2024-05-03T16:29:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 34 k 2024-05-03T16:29:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 2.4 M 2024-05-03T16:29:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 274 k 2024-05-03T16:29:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 4.7 M 2024-05-03T16:29:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 17 M 2024-05-03T16:29:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 16 k 2024-05-03T16:29:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 25 k 2024-05-03T16:29:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-03T16:29:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-03T16:29:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-03T16:29:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-03T16:29:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-03T16:29:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-03T16:29:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-03T16:29:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-03T16:29:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 163 k 2024-05-03T16:29:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-03T16:29:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-03T16:29:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-03T16:29:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-03T16:29:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-03T16:29:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 500 k 2024-05-03T16:29:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-03T16:29:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 5.4 M 2024-05-03T16:29:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-03T16:29:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-03T16:29:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-03T16:29:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-03T16:29:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-03T16:29:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-03T16:29:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-03T16:29:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-03T16:29:07.946 INFO:teuthology.orchestra.run.smithi146.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-03T16:29:07.946 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-03T16:29:07.946 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-03T16:29:07.946 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-03T16:29:07.946 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-03T16:29:07.946 INFO:teuthology.orchestra.run.smithi146.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-03T16:29:07.946 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-03T16:29:07.946 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-03T16:29:07.946 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-03T16:29:07.946 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 45 k 2024-05-03T16:29:07.946 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 135 k 2024-05-03T16:29:07.946 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-03T16:29:07.946 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-03T16:29:07.946 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-03T16:29:07.947 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-03T16:29:07.947 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-03T16:29:07.947 INFO:teuthology.orchestra.run.smithi146.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-03T16:29:07.947 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-03T16:29:07.947 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-03T16:29:07.947 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-03T16:29:07.947 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-03T16:29:07.947 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-03T16:29:07.947 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-03T16:29:07.947 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-03T16:29:07.947 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-03T16:29:07.947 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-03T16:29:07.947 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-03T16:29:07.947 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-03T16:29:07.948 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-03T16:29:07.948 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-03T16:29:07.948 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-03T16:29:07.948 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-03T16:29:07.948 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-03T16:29:07.948 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-03T16:29:07.948 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-03T16:29:07.948 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-03T16:29:07.948 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-03T16:29:07.948 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-03T16:29:07.948 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-03T16:29:07.948 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-03T16:29:07.948 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-03T16:29:07.949 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-03T16:29:07.949 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-03T16:29:07.949 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-03T16:29:07.949 INFO:teuthology.orchestra.run.smithi146.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-03T16:29:07.949 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-03T16:29:07.949 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-03T16:29:07.949 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-03T16:29:07.949 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-03T16:29:07.949 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-03T16:29:07.949 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-03T16:29:07.949 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-03T16:29:07.949 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-03T16:29:07.949 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-03T16:29:07.949 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-03T16:29:07.949 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-03T16:29:07.950 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-03T16:29:07.950 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-03T16:29:07.950 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-03T16:29:07.950 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-03T16:29:07.950 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-03T16:29:07.950 INFO:teuthology.orchestra.run.smithi146.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-03T16:29:07.950 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-03T16:29:07.950 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-03T16:29:07.950 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-03T16:29:07.950 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-03T16:29:07.950 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-03T16:29:07.950 INFO:teuthology.orchestra.run.smithi146.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-03T16:29:07.950 INFO:teuthology.orchestra.run.smithi146.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-03T16:29:07.950 INFO:teuthology.orchestra.run.smithi146.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-03T16:29:07.951 INFO:teuthology.orchestra.run.smithi146.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-03T16:29:07.951 INFO:teuthology.orchestra.run.smithi146.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-03T16:29:07.951 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-03T16:29:07.951 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-03T16:29:07.951 INFO:teuthology.orchestra.run.smithi146.stdout:Installing weak dependencies: 2024-05-03T16:29:07.951 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-03T16:29:07.951 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:29:07.951 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-05-03T16:29:07.951 INFO:teuthology.orchestra.run.smithi146.stdout:======================================================================================= 2024-05-03T16:29:07.951 INFO:teuthology.orchestra.run.smithi146.stdout:Install 148 Packages 2024-05-03T16:29:07.951 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade 4 Packages 2024-05-03T16:29:07.951 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:29:07.952 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 222 M 2024-05-03T16:29:07.952 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-05-03T16:29:08.164 INFO:teuthology.orchestra.run.smithi134.stdout:(2/152): ceph-base-19.0.0-3450.g9a047fe7.el9.x8 7.3 MB/s | 5.4 MB 00:00 2024-05-03T16:29:08.223 INFO:teuthology.orchestra.run.smithi134.stdout:(3/152): ceph-immutable-object-cache-19.0.0-345 2.5 MB/s | 145 kB 00:00 2024-05-03T16:29:08.299 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-03T16:29:08.301 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-03T16:29:08.321 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-03T16:29:08.322 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-03T16:29:08.324 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-03T16:29:08.325 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-03T16:29:08.327 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-03T16:29:08.331 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-03T16:29:08.332 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-03T16:29:08.403 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-05-03T16:29:08.425 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-05-03T16:29:08.425 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-05-03T16:29:08.426 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-05-03T16:29:08.426 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-05-03T16:29:08.426 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-03T16:29:08.426 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 6.6 k 2024-05-03T16:29:08.426 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 5.4 M 2024-05-03T16:29:08.426 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 891 k 2024-05-03T16:29:08.426 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 145 k 2024-05-03T16:29:08.426 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 1.5 M 2024-05-03T16:29:08.426 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 142 k 2024-05-03T16:29:08.426 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 3.5 M 2024-05-03T16:29:08.426 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 7.4 M 2024-05-03T16:29:08.426 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 49 k 2024-05-03T16:29:08.426 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 11 M 2024-05-03T16:29:08.427 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 49 M 2024-05-03T16:29:08.427 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 273 k 2024-05-03T16:29:08.427 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 763 k 2024-05-03T16:29:08.427 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 225 k 2024-05-03T16:29:08.427 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 27 k 2024-05-03T16:29:08.427 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 18 k 2024-05-03T16:29:08.427 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-03T16:29:08.427 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-03T16:29:08.427 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-03T16:29:08.427 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 32 k 2024-05-03T16:29:08.427 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 747 k 2024-05-03T16:29:08.427 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 127 k 2024-05-03T16:29:08.427 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-03T16:29:08.427 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-03T16:29:08.428 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-03T16:29:08.428 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-03T16:29:08.428 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-03T16:29:08.428 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-03T16:29:08.428 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 161 k 2024-05-03T16:29:08.428 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 320 k 2024-05-03T16:29:08.428 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 298 k 2024-05-03T16:29:08.428 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 100 k 2024-05-03T16:29:08.428 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 85 k 2024-05-03T16:29:08.428 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.1 M 2024-05-03T16:29:08.428 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 170 k 2024-05-03T16:29:08.428 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-03T16:29:08.428 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2024-05-03T16:29:08.428 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.4 M 2024-05-03T16:29:08.428 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.1 M 2024-05-03T16:29:08.429 INFO:teuthology.orchestra.run.smithi081.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-03T16:29:08.429 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-03T16:29:08.429 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-05-03T16:29:08.429 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-03T16:29:08.429 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-03T16:29:08.429 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-03T16:29:08.429 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 21 M 2024-05-03T16:29:08.429 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 34 k 2024-05-03T16:29:08.429 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 2.4 M 2024-05-03T16:29:08.429 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 274 k 2024-05-03T16:29:08.429 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 4.7 M 2024-05-03T16:29:08.429 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 17 M 2024-05-03T16:29:08.429 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 16 k 2024-05-03T16:29:08.429 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 25 k 2024-05-03T16:29:08.430 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-03T16:29:08.430 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-03T16:29:08.430 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-03T16:29:08.430 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-03T16:29:08.430 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-03T16:29:08.430 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-03T16:29:08.430 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-03T16:29:08.430 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-03T16:29:08.430 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 163 k 2024-05-03T16:29:08.430 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-03T16:29:08.430 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-03T16:29:08.430 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-03T16:29:08.430 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-03T16:29:08.431 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-03T16:29:08.431 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 500 k 2024-05-03T16:29:08.431 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-03T16:29:08.431 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 5.4 M 2024-05-03T16:29:08.431 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-03T16:29:08.431 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-03T16:29:08.431 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-03T16:29:08.431 INFO:teuthology.orchestra.run.smithi081.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-03T16:29:08.431 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-03T16:29:08.431 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-03T16:29:08.431 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-03T16:29:08.431 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-03T16:29:08.431 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-03T16:29:08.431 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-03T16:29:08.431 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-03T16:29:08.432 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-03T16:29:08.432 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-03T16:29:08.432 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-03T16:29:08.432 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-03T16:29:08.432 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-03T16:29:08.432 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-03T16:29:08.432 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 45 k 2024-05-03T16:29:08.432 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 135 k 2024-05-03T16:29:08.432 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-03T16:29:08.432 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-03T16:29:08.432 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-03T16:29:08.432 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-03T16:29:08.432 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-03T16:29:08.432 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-03T16:29:08.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-03T16:29:08.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-03T16:29:08.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-03T16:29:08.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-03T16:29:08.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-03T16:29:08.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-03T16:29:08.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-03T16:29:08.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-03T16:29:08.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-03T16:29:08.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-03T16:29:08.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-03T16:29:08.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-03T16:29:08.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-03T16:29:08.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-03T16:29:08.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-03T16:29:08.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-03T16:29:08.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-03T16:29:08.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-03T16:29:08.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-03T16:29:08.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-03T16:29:08.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-03T16:29:08.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-03T16:29:08.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-03T16:29:08.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-03T16:29:08.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-03T16:29:08.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-03T16:29:08.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-03T16:29:08.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-03T16:29:08.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-03T16:29:08.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-03T16:29:08.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-03T16:29:08.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-03T16:29:08.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-03T16:29:08.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-03T16:29:08.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-03T16:29:08.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-03T16:29:08.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-03T16:29:08.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-03T16:29:08.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-03T16:29:08.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-03T16:29:08.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-03T16:29:08.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-03T16:29:08.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-03T16:29:08.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-03T16:29:08.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-03T16:29:08.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-03T16:29:08.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-03T16:29:08.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-03T16:29:08.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-03T16:29:08.436 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-03T16:29:08.436 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-03T16:29:08.436 INFO:teuthology.orchestra.run.smithi081.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-03T16:29:08.436 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-03T16:29:08.436 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-03T16:29:08.436 INFO:teuthology.orchestra.run.smithi081.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-03T16:29:08.436 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-03T16:29:08.436 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-03T16:29:08.437 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2024-05-03T16:29:08.437 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-03T16:29:08.437 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:29:08.437 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-05-03T16:29:08.437 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-05-03T16:29:08.437 INFO:teuthology.orchestra.run.smithi081.stdout:Install 148 Packages 2024-05-03T16:29:08.437 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 4 Packages 2024-05-03T16:29:08.437 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:29:08.437 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 222 M 2024-05-03T16:29:08.438 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-05-03T16:29:08.456 INFO:teuthology.orchestra.run.smithi134.stdout:(4/152): ceph-mds-19.0.0-3450.g9a047fe7.el9.x86 10 MB/s | 2.4 MB 00:00 2024-05-03T16:29:08.590 INFO:teuthology.orchestra.run.smithi134.stdout:(5/152): ceph-fuse-19.0.0-3450.g9a047fe7.el9.x8 1.0 MB/s | 891 kB 00:00 2024-05-03T16:29:08.657 INFO:teuthology.orchestra.run.smithi134.stdout:(6/152): ceph-mgr-19.0.0-3450.g9a047fe7.el9.x86 7.6 MB/s | 1.5 MB 00:00 2024-05-03T16:29:09.079 INFO:teuthology.orchestra.run.smithi146.stdout:(1/152): ceph-19.0.0-3450.g9a047fe7.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-05-03T16:29:09.411 INFO:teuthology.orchestra.run.smithi081.stdout:(1/152): ceph-19.0.0-3450.g9a047fe7.el9.x86_64. 16 kB/s | 6.6 kB 00:00 2024-05-03T16:29:09.699 INFO:teuthology.orchestra.run.smithi134.stdout:(7/152): ceph-common-19.0.0-3450.g9a047fe7.el9. 9.3 MB/s | 21 MB 00:02 2024-05-03T16:29:09.712 INFO:teuthology.orchestra.run.smithi146.stdout:(2/152): ceph-fuse-19.0.0-3450.g9a047fe7.el9.x8 1.4 MB/s | 891 kB 00:00 2024-05-03T16:29:09.888 INFO:teuthology.orchestra.run.smithi146.stdout:(3/152): ceph-immutable-object-cache-19.0.0-345 831 kB/s | 145 kB 00:00 2024-05-03T16:29:09.953 INFO:teuthology.orchestra.run.smithi081.stdout:(2/152): ceph-fuse-19.0.0-3450.g9a047fe7.el9.x8 1.6 MB/s | 891 kB 00:00 2024-05-03T16:29:10.024 INFO:teuthology.orchestra.run.smithi134.stdout:(8/152): ceph-osd-19.0.0-3450.g9a047fe7.el9.x86 12 MB/s | 17 MB 00:01 2024-05-03T16:29:10.062 INFO:teuthology.orchestra.run.smithi081.stdout:(3/152): ceph-immutable-object-cache-19.0.0-345 1.3 MB/s | 145 kB 00:00 2024-05-03T16:29:10.541 INFO:teuthology.orchestra.run.smithi134.stdout:(9/152): ceph-selinux-19.0.0-3450.g9a047fe7.el9 49 kB/s | 25 kB 00:00 2024-05-03T16:29:10.741 INFO:teuthology.orchestra.run.smithi134.stdout:(10/152): ceph-mon-19.0.0-3450.g9a047fe7.el9.x8 2.2 MB/s | 4.7 MB 00:02 2024-05-03T16:29:10.858 INFO:teuthology.orchestra.run.smithi134.stdout:(11/152): cephfs-mirror-19.0.0-3450.g9a047fe7.e 1.9 MB/s | 225 kB 00:00 2024-05-03T16:29:10.905 INFO:teuthology.orchestra.run.smithi146.stdout:(4/152): ceph-base-19.0.0-3450.g9a047fe7.el9.x8 2.4 MB/s | 5.4 MB 00:02 2024-05-03T16:29:10.958 INFO:teuthology.orchestra.run.smithi134.stdout:(12/152): cephfs-shell-19.0.0-3450.g9a047fe7.el 273 kB/s | 27 kB 00:00 2024-05-03T16:29:11.125 INFO:teuthology.orchestra.run.smithi134.stdout:(13/152): ceph-radosgw-19.0.0-3450.g9a047fe7.el 7.4 MB/s | 11 MB 00:01 2024-05-03T16:29:11.153 INFO:teuthology.orchestra.run.smithi081.stdout:(4/152): ceph-mds-19.0.0-3450.g9a047fe7.el9.x86 2.2 MB/s | 2.4 MB 00:01 2024-05-03T16:29:11.172 INFO:teuthology.orchestra.run.smithi146.stdout:(5/152): ceph-mgr-19.0.0-3450.g9a047fe7.el9.x86 5.7 MB/s | 1.5 MB 00:00 2024-05-03T16:29:11.251 INFO:teuthology.orchestra.run.smithi134.stdout:(14/152): libcephfs2-19.0.0-3450.g9a047fe7.el9. 5.9 MB/s | 747 kB 00:00 2024-05-03T16:29:11.298 INFO:teuthology.orchestra.run.smithi146.stdout:(6/152): ceph-mds-19.0.0-3450.g9a047fe7.el9.x86 1.7 MB/s | 2.4 MB 00:01 2024-05-03T16:29:11.317 INFO:teuthology.orchestra.run.smithi134.stdout:(15/152): libcephfs-devel-19.0.0-3450.g9a047fe7 89 kB/s | 32 kB 00:00 2024-05-03T16:29:11.426 INFO:teuthology.orchestra.run.smithi134.stdout:(16/152): librados-devel-19.0.0-3450.g9a047fe7. 1.1 MB/s | 127 kB 00:00 2024-05-03T16:29:11.593 INFO:teuthology.orchestra.run.smithi134.stdout:(17/152): libcephsqlite-19.0.0-3450.g9a047fe7.e 478 kB/s | 163 kB 00:00 2024-05-03T16:29:11.635 INFO:teuthology.orchestra.run.smithi134.stdout:(18/152): libradosstriper1-19.0.0-3450.g9a047fe 2.3 MB/s | 500 kB 00:00 2024-05-03T16:29:11.752 INFO:teuthology.orchestra.run.smithi134.stdout:(19/152): python3-ceph-argparse-19.0.0-3450.g9a 389 kB/s | 45 kB 00:00 2024-05-03T16:29:11.845 INFO:teuthology.orchestra.run.smithi081.stdout:(5/152): ceph-mgr-19.0.0-3450.g9a047fe7.el9.x86 2.2 MB/s | 1.5 MB 00:00 2024-05-03T16:29:11.861 INFO:teuthology.orchestra.run.smithi134.stdout:(20/152): python3-ceph-common-19.0.0-3450.g9a04 1.2 MB/s | 135 kB 00:00 2024-05-03T16:29:11.961 INFO:teuthology.orchestra.run.smithi134.stdout:(21/152): python3-cephfs-19.0.0-3450.g9a047fe7. 1.6 MB/s | 161 kB 00:00 2024-05-03T16:29:12.089 INFO:teuthology.orchestra.run.smithi146.stdout:(7/152): ceph-mon-19.0.0-3450.g9a047fe7.el9.x86 5.1 MB/s | 4.7 MB 00:00 2024-05-03T16:29:12.119 INFO:teuthology.orchestra.run.smithi134.stdout:(22/152): python3-rados-19.0.0-3450.g9a047fe7.e 2.0 MB/s | 320 kB 00:00 2024-05-03T16:29:12.320 INFO:teuthology.orchestra.run.smithi134.stdout:(23/152): python3-rbd-19.0.0-3450.g9a047fe7.el9 1.5 MB/s | 298 kB 00:00 2024-05-03T16:29:12.437 INFO:teuthology.orchestra.run.smithi134.stdout:(24/152): python3-rgw-19.0.0-3450.g9a047fe7.el9 863 kB/s | 100 kB 00:00 2024-05-03T16:29:12.637 INFO:teuthology.orchestra.run.smithi134.stdout:(25/152): librgw2-19.0.0-3450.g9a047fe7.el9.x86 5.2 MB/s | 5.4 MB 00:01 2024-05-03T16:29:12.662 INFO:teuthology.orchestra.run.smithi134.stdout:(26/152): rbd-fuse-19.0.0-3450.g9a047fe7.el9.x8 379 kB/s | 85 kB 00:00 2024-05-03T16:29:12.796 INFO:teuthology.orchestra.run.smithi134.stdout:(27/152): rbd-nbd-19.0.0-3450.g9a047fe7.el9.x86 1.3 MB/s | 170 kB 00:00 2024-05-03T16:29:12.879 INFO:teuthology.orchestra.run.smithi081.stdout:(6/152): ceph-base-19.0.0-3450.g9a047fe7.el9.x8 1.4 MB/s | 5.4 MB 00:03 2024-05-03T16:29:12.896 INFO:teuthology.orchestra.run.smithi134.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3450.g 344 kB/s | 34 kB 00:00 2024-05-03T16:29:13.021 INFO:teuthology.orchestra.run.smithi134.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3450.g9a047fe 1.1 MB/s | 142 kB 00:00 2024-05-03T16:29:13.280 INFO:teuthology.orchestra.run.smithi134.stdout:(30/152): rbd-mirror-19.0.0-3450.g9a047fe7.el9. 4.8 MB/s | 3.1 MB 00:00 2024-05-03T16:29:13.562 INFO:teuthology.orchestra.run.smithi081.stdout:(7/152): ceph-common-19.0.0-3450.g9a047fe7.el9. 4.6 MB/s | 21 MB 00:04 2024-05-03T16:29:13.564 INFO:teuthology.orchestra.run.smithi146.stdout:(8/152): ceph-radosgw-19.0.0-3450.g9a047fe7.el9 7.2 MB/s | 11 MB 00:01 2024-05-03T16:29:13.647 INFO:teuthology.orchestra.run.smithi146.stdout:(9/152): ceph-selinux-19.0.0-3450.g9a047fe7.el9 306 kB/s | 25 kB 00:00 2024-05-03T16:29:13.763 INFO:teuthology.orchestra.run.smithi081.stdout:(8/152): ceph-mon-19.0.0-3450.g9a047fe7.el9.x86 2.5 MB/s | 4.7 MB 00:01 2024-05-03T16:29:13.871 INFO:teuthology.orchestra.run.smithi081.stdout:(9/152): ceph-selinux-19.0.0-3450.g9a047fe7.el9 234 kB/s | 25 kB 00:00 2024-05-03T16:29:14.280 INFO:teuthology.orchestra.run.smithi134.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3450.g9a047 2.8 MB/s | 3.5 MB 00:01 2024-05-03T16:29:14.397 INFO:teuthology.orchestra.run.smithi134.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3450.g9a 2.3 MB/s | 274 kB 00:00 2024-05-03T16:29:14.598 INFO:teuthology.orchestra.run.smithi134.stdout:(33/152): ceph-mgr-diskprediction-local-19.0.0- 5.6 MB/s | 7.4 MB 00:01 2024-05-03T16:29:14.623 INFO:teuthology.orchestra.run.smithi134.stdout:(34/152): ceph-mgr-rook-19.0.0-3450.g9a047fe7.e 219 kB/s | 49 kB 00:00 2024-05-03T16:29:14.673 INFO:teuthology.orchestra.run.smithi134.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3450.g9 222 kB/s | 16 kB 00:00 2024-05-03T16:29:14.732 INFO:teuthology.orchestra.run.smithi134.stdout:(36/152): ceph-volume-19.0.0-3450.g9a047fe7.el9 2.5 MB/s | 273 kB 00:00 2024-05-03T16:29:14.841 INFO:teuthology.orchestra.run.smithi134.stdout:(37/152): cephadm-19.0.0-3450.g9a047fe7.el9.noa 4.5 MB/s | 763 kB 00:00 2024-05-03T16:29:14.866 INFO:teuthology.orchestra.run.smithi134.stdout:(38/152): cephfs-top-19.0.0-3450.g9a047fe7.el9. 137 kB/s | 18 kB 00:00 2024-05-03T16:29:15.216 INFO:teuthology.orchestra.run.smithi134.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 215 kB/s | 80 kB 00:00 2024-05-03T16:29:15.730 INFO:teuthology.orchestra.run.smithi081.stdout:(10/152): ceph-radosgw-19.0.0-3450.g9a047fe7.el 4.9 MB/s | 11 MB 00:02 2024-05-03T16:29:15.783 INFO:teuthology.orchestra.run.smithi134.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 877 kB/s | 803 kB 00:00 2024-05-03T16:29:15.813 INFO:teuthology.orchestra.run.smithi081.stdout:(11/152): cephfs-mirror-19.0.0-3450.g9a047fe7.e 2.7 MB/s | 225 kB 00:00 2024-05-03T16:29:15.825 INFO:teuthology.orchestra.run.smithi134.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 321 kB/s | 195 kB 00:00 2024-05-03T16:29:15.889 INFO:teuthology.orchestra.run.smithi081.stdout:(12/152): cephfs-shell-19.0.0-3450.g9a047fe7.el 364 kB/s | 27 kB 00:00 2024-05-03T16:29:15.956 INFO:teuthology.orchestra.run.smithi081.stdout:(13/152): libcephfs-devel-19.0.0-3450.g9a047fe7 482 kB/s | 32 kB 00:00 2024-05-03T16:29:16.148 INFO:teuthology.orchestra.run.smithi081.stdout:(14/152): libcephfs2-19.0.0-3450.g9a047fe7.el9. 3.8 MB/s | 747 kB 00:00 2024-05-03T16:29:16.254 INFO:teuthology.orchestra.run.smithi081.stdout:(15/152): libcephsqlite-19.0.0-3450.g9a047fe7.e 1.5 MB/s | 163 kB 00:00 2024-05-03T16:29:16.323 INFO:teuthology.orchestra.run.smithi081.stdout:(16/152): librados-devel-19.0.0-3450.g9a047fe7. 1.8 MB/s | 127 kB 00:00 2024-05-03T16:29:16.457 INFO:teuthology.orchestra.run.smithi081.stdout:(17/152): libradosstriper1-19.0.0-3450.g9a047fe 3.7 MB/s | 500 kB 00:00 2024-05-03T16:29:16.550 INFO:teuthology.orchestra.run.smithi134.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 330 kB/s | 253 kB 00:00 2024-05-03T16:29:16.975 INFO:teuthology.orchestra.run.smithi134.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 251 kB/s | 106 kB 00:00 2024-05-03T16:29:17.476 INFO:teuthology.orchestra.run.smithi134.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 270 kB/s | 135 kB 00:00 2024-05-03T16:29:17.516 INFO:teuthology.orchestra.run.smithi081.stdout:(18/152): librgw2-19.0.0-3450.g9a047fe7.el9.x86 5.1 MB/s | 5.4 MB 00:01 2024-05-03T16:29:17.523 INFO:teuthology.orchestra.run.smithi146.stdout:(10/152): ceph-osd-19.0.0-3450.g9a047fe7.el9.x8 2.7 MB/s | 17 MB 00:06 2024-05-03T16:29:17.574 INFO:teuthology.orchestra.run.smithi081.stdout:(19/152): python3-ceph-argparse-19.0.0-3450.g9a 788 kB/s | 45 kB 00:00 2024-05-03T16:29:17.631 INFO:teuthology.orchestra.run.smithi146.stdout:(11/152): cephfs-mirror-19.0.0-3450.g9a047fe7.e 2.1 MB/s | 225 kB 00:00 2024-05-03T16:29:17.649 INFO:teuthology.orchestra.run.smithi081.stdout:(20/152): python3-ceph-common-19.0.0-3450.g9a04 1.8 MB/s | 135 kB 00:00 2024-05-03T16:29:17.698 INFO:teuthology.orchestra.run.smithi146.stdout:(12/152): cephfs-shell-19.0.0-3450.g9a047fe7.el 411 kB/s | 27 kB 00:00 2024-05-03T16:29:17.725 INFO:teuthology.orchestra.run.smithi081.stdout:(21/152): python3-cephfs-19.0.0-3450.g9a047fe7. 2.1 MB/s | 161 kB 00:00 2024-05-03T16:29:17.765 INFO:teuthology.orchestra.run.smithi146.stdout:(13/152): libcephfs-devel-19.0.0-3450.g9a047fe7 483 kB/s | 32 kB 00:00 2024-05-03T16:29:17.809 INFO:teuthology.orchestra.run.smithi081.stdout:(22/152): python3-rados-19.0.0-3450.g9a047fe7.e 3.8 MB/s | 320 kB 00:00 2024-05-03T16:29:17.917 INFO:teuthology.orchestra.run.smithi081.stdout:(23/152): python3-rbd-19.0.0-3450.g9a047fe7.el9 2.7 MB/s | 298 kB 00:00 2024-05-03T16:29:17.976 INFO:teuthology.orchestra.run.smithi134.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 250 kB/s | 125 kB 00:00 2024-05-03T16:29:17.993 INFO:teuthology.orchestra.run.smithi081.stdout:(24/152): python3-rgw-19.0.0-3450.g9a047fe7.el9 1.3 MB/s | 100 kB 00:00 2024-05-03T16:29:18.015 INFO:teuthology.orchestra.run.smithi146.stdout:(14/152): libcephfs2-19.0.0-3450.g9a047fe7.el9. 2.9 MB/s | 747 kB 00:00 2024-05-03T16:29:18.017 INFO:teuthology.orchestra.run.smithi134.stdout:(46/152): python3-cryptography-36.0.1-4.el9.x86 573 kB/s | 1.2 MB 00:02 2024-05-03T16:29:18.051 INFO:teuthology.orchestra.run.smithi081.stdout:(25/152): rbd-fuse-19.0.0-3450.g9a047fe7.el9.x8 1.4 MB/s | 85 kB 00:00 2024-05-03T16:29:18.091 INFO:teuthology.orchestra.run.smithi146.stdout:(15/152): libcephsqlite-19.0.0-3450.g9a047fe7.e 2.1 MB/s | 163 kB 00:00 2024-05-03T16:29:18.174 INFO:teuthology.orchestra.run.smithi146.stdout:(16/152): librados-devel-19.0.0-3450.g9a047fe7. 1.5 MB/s | 127 kB 00:00 2024-05-03T16:29:18.450 INFO:teuthology.orchestra.run.smithi146.stdout:(17/152): libradosstriper1-19.0.0-3450.g9a047fe 1.8 MB/s | 500 kB 00:00 2024-05-03T16:29:18.676 INFO:teuthology.orchestra.run.smithi081.stdout:(26/152): rbd-mirror-19.0.0-3450.g9a047fe7.el9. 5.0 MB/s | 3.1 MB 00:00 2024-05-03T16:29:18.735 INFO:teuthology.orchestra.run.smithi081.stdout:(27/152): rbd-nbd-19.0.0-3450.g9a047fe7.el9.x86 2.9 MB/s | 170 kB 00:00 2024-05-03T16:29:18.751 INFO:teuthology.orchestra.run.smithi134.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 277 kB/s | 215 kB 00:00 2024-05-03T16:29:18.785 INFO:teuthology.orchestra.run.smithi081.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3450.g 693 kB/s | 34 kB 00:00 2024-05-03T16:29:18.861 INFO:teuthology.orchestra.run.smithi081.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3450.g9a047fe 1.9 MB/s | 142 kB 00:00 2024-05-03T16:29:18.900 INFO:teuthology.orchestra.run.smithi146.stdout:(18/152): ceph-common-19.0.0-3450.g9a047fe7.el9 2.1 MB/s | 21 MB 00:10 2024-05-03T16:29:18.983 INFO:teuthology.orchestra.run.smithi146.stdout:(19/152): python3-ceph-argparse-19.0.0-3450.g9a 550 kB/s | 45 kB 00:00 2024-05-03T16:29:18.993 INFO:teuthology.orchestra.run.smithi134.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 707 kB/s | 689 kB 00:00 2024-05-03T16:29:19.145 INFO:teuthology.orchestra.run.smithi146.stdout:(20/152): python3-ceph-common-19.0.0-3450.g9a04 909 kB/s | 135 kB 00:00 2024-05-03T16:29:19.453 INFO:teuthology.orchestra.run.smithi081.stdout:(30/152): ceph-mgr-dashboard-19.0.0-3450.g9a047 6.0 MB/s | 3.5 MB 00:00 2024-05-03T16:29:19.726 INFO:teuthology.orchestra.run.smithi146.stdout:(21/152): ceph-test-19.0.0-3450.g9a047fe7.el9.x 8.1 MB/s | 49 MB 00:06 2024-05-03T16:29:19.759 INFO:teuthology.orchestra.run.smithi146.stdout:(22/152): python3-cephfs-19.0.0-3450.g9a047fe7. 258 kB/s | 161 kB 00:00 2024-05-03T16:29:19.818 INFO:teuthology.orchestra.run.smithi134.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 141 kB/s | 107 kB 00:00 2024-05-03T16:29:19.859 INFO:teuthology.orchestra.run.smithi146.stdout:(23/152): python3-rados-19.0.0-3450.g9a047fe7.e 2.4 MB/s | 320 kB 00:00 2024-05-03T16:29:19.868 INFO:teuthology.orchestra.run.smithi134.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 845 kB/s | 943 kB 00:01 2024-05-03T16:29:19.926 INFO:teuthology.orchestra.run.smithi146.stdout:(24/152): python3-rgw-19.0.0-3450.g9a047fe7.el9 1.5 MB/s | 100 kB 00:00 2024-05-03T16:29:19.968 INFO:teuthology.orchestra.run.smithi146.stdout:(25/152): python3-rbd-19.0.0-3450.g9a047fe7.el9 1.4 MB/s | 298 kB 00:00 2024-05-03T16:29:19.994 INFO:teuthology.orchestra.run.smithi146.stdout:(26/152): rbd-fuse-19.0.0-3450.g9a047fe7.el9.x8 1.3 MB/s | 85 kB 00:00 2024-05-03T16:29:20.136 INFO:teuthology.orchestra.run.smithi146.stdout:(27/152): librgw2-19.0.0-3450.g9a047fe7.el9.x86 3.2 MB/s | 5.4 MB 00:01 2024-05-03T16:29:20.169 INFO:teuthology.orchestra.run.smithi146.stdout:(28/152): rbd-nbd-19.0.0-3450.g9a047fe7.el9.x86 977 kB/s | 170 kB 00:00 2024-05-03T16:29:20.194 INFO:teuthology.orchestra.run.smithi146.stdout:(29/152): ceph-grafana-dashboards-19.0.0-3450.g 594 kB/s | 34 kB 00:00 2024-05-03T16:29:20.236 INFO:teuthology.orchestra.run.smithi146.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3450.g9a047fe 2.1 MB/s | 142 kB 00:00 2024-05-03T16:29:20.395 INFO:teuthology.orchestra.run.smithi081.stdout:(31/152): ceph-osd-19.0.0-3450.g9a047fe7.el9.x8 2.2 MB/s | 17 MB 00:07 2024-05-03T16:29:20.435 INFO:teuthology.orchestra.run.smithi134.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 35 kB/s | 21 kB 00:00 2024-05-03T16:29:20.545 INFO:teuthology.orchestra.run.smithi081.stdout:(32/152): ceph-mgr-diskprediction-local-19.0.0- 6.8 MB/s | 7.4 MB 00:01 2024-05-03T16:29:20.637 INFO:teuthology.orchestra.run.smithi081.stdout:(33/152): ceph-mgr-modules-core-19.0.0-3450.g9a 1.1 MB/s | 274 kB 00:00 2024-05-03T16:29:20.729 INFO:teuthology.orchestra.run.smithi081.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3450.g9 180 kB/s | 16 kB 00:00 2024-05-03T16:29:20.752 INFO:teuthology.orchestra.run.smithi134.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 355 kB/s | 313 kB 00:00 2024-05-03T16:29:20.862 INFO:teuthology.orchestra.run.smithi081.stdout:(35/152): ceph-mgr-rook-19.0.0-3450.g9a047fe7.e 156 kB/s | 49 kB 00:00 2024-05-03T16:29:20.895 INFO:teuthology.orchestra.run.smithi146.stdout:(31/152): rbd-mirror-19.0.0-3450.g9a047fe7.el9. 3.3 MB/s | 3.1 MB 00:00 2024-05-03T16:29:20.896 INFO:teuthology.orchestra.run.smithi081.stdout:(36/152): ceph-volume-19.0.0-3450.g9a047fe7.el9 1.6 MB/s | 273 kB 00:00 2024-05-03T16:29:20.996 INFO:teuthology.orchestra.run.smithi081.stdout:(37/152): cephfs-top-19.0.0-3450.g9a047fe7.el9. 184 kB/s | 18 kB 00:00 2024-05-03T16:29:21.038 INFO:teuthology.orchestra.run.smithi081.stdout:(38/152): cephadm-19.0.0-3450.g9a047fe7.el9.noa 4.3 MB/s | 763 kB 00:00 2024-05-03T16:29:21.086 INFO:teuthology.orchestra.run.smithi134.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 50 kB/s | 33 kB 00:00 2024-05-03T16:29:21.112 INFO:teuthology.orchestra.run.smithi146.stdout:(32/152): ceph-mgr-diskprediction-local-19.0.0- 8.5 MB/s | 7.4 MB 00:00 2024-05-03T16:29:21.155 INFO:teuthology.orchestra.run.smithi081.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 510 kB/s | 80 kB 00:00 2024-05-03T16:29:21.204 INFO:teuthology.orchestra.run.smithi146.stdout:(33/152): ceph-mgr-dashboard-19.0.0-3450.g9a047 3.5 MB/s | 3.5 MB 00:01 2024-05-03T16:29:21.220 INFO:teuthology.orchestra.run.smithi146.stdout:(34/152): ceph-mgr-rook-19.0.0-3450.g9a047fe7.e 459 kB/s | 49 kB 00:00 2024-05-03T16:29:21.246 INFO:teuthology.orchestra.run.smithi146.stdout:(35/152): ceph-mgr-modules-core-19.0.0-3450.g9a 784 kB/s | 274 kB 00:00 2024-05-03T16:29:21.256 INFO:teuthology.orchestra.run.smithi081.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2024-05-03T16:29:21.265 INFO:teuthology.orchestra.run.smithi146.stdout:(36/152): ceph-prometheus-alerts-19.0.0-3450.g9 284 kB/s | 16 kB 00:00 2024-05-03T16:29:21.296 INFO:teuthology.orchestra.run.smithi146.stdout:(37/152): ceph-volume-19.0.0-3450.g9a047fe7.el9 3.6 MB/s | 273 kB 00:00 2024-05-03T16:29:21.314 INFO:teuthology.orchestra.run.smithi081.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-05-03T16:29:21.322 INFO:teuthology.orchestra.run.smithi146.stdout:(38/152): cephfs-top-19.0.0-3450.g9a047fe7.el9. 314 kB/s | 18 kB 00:00 2024-05-03T16:29:21.348 INFO:teuthology.orchestra.run.smithi081.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-05-03T16:29:21.406 INFO:teuthology.orchestra.run.smithi146.stdout:(39/152): cephadm-19.0.0-3450.g9a047fe7.el9.noa 4.7 MB/s | 763 kB 00:00 2024-05-03T16:29:21.464 INFO:teuthology.orchestra.run.smithi146.stdout:(40/152): fuse-2.9.9-15.el9.x86_64.rpm 483 kB/s | 80 kB 00:00 2024-05-03T16:29:21.473 INFO:teuthology.orchestra.run.smithi081.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 858 kB/s | 106 kB 00:00 2024-05-03T16:29:21.532 INFO:teuthology.orchestra.run.smithi081.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 5.7 MB/s | 1.2 MB 00:00 2024-05-03T16:29:21.581 INFO:teuthology.orchestra.run.smithi146.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-05-03T16:29:21.605 INFO:teuthology.orchestra.run.smithi081.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-05-03T16:29:21.606 INFO:teuthology.orchestra.run.smithi146.stdout:(42/152): libquadmath-11.4.1-3.el9.x86_64.rpm 980 kB/s | 195 kB 00:00 2024-05-03T16:29:21.633 INFO:teuthology.orchestra.run.smithi081.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-05-03T16:29:21.649 INFO:teuthology.orchestra.run.smithi146.stdout:(43/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.4 MB/s | 803 kB 00:00 2024-05-03T16:29:21.662 INFO:teuthology.orchestra.run.smithi134.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 32 kB/s | 18 kB 00:00 2024-05-03T16:29:21.666 INFO:teuthology.orchestra.run.smithi081.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.5 MB/s | 215 kB 00:00 2024-05-03T16:29:21.674 INFO:teuthology.orchestra.run.smithi146.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-05-03T16:29:21.707 INFO:teuthology.orchestra.run.smithi146.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-05-03T16:29:21.741 INFO:teuthology.orchestra.run.smithi146.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-05-03T16:29:21.774 INFO:teuthology.orchestra.run.smithi146.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 215 kB 00:00 2024-05-03T16:29:21.825 INFO:teuthology.orchestra.run.smithi146.stdout:(48/152): python3-cryptography-36.0.1-4.el9.x86 5.1 MB/s | 1.2 MB 00:00 2024-05-03T16:29:21.945 INFO:teuthology.orchestra.run.smithi134.stdout:(55/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.5 MB/s | 3.0 MB 00:01 2024-05-03T16:29:21.959 INFO:teuthology.orchestra.run.smithi146.stdout:(49/152): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-05-03T16:29:21.984 INFO:teuthology.orchestra.run.smithi146.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 676 kB/s | 107 kB 00:00 2024-05-03T16:29:22.018 INFO:teuthology.orchestra.run.smithi146.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 372 kB/s | 21 kB 00:00 2024-05-03T16:29:22.060 INFO:teuthology.orchestra.run.smithi146.stdout:(52/152): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-05-03T16:29:22.085 INFO:teuthology.orchestra.run.smithi146.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 495 kB/s | 33 kB 00:00 2024-05-03T16:29:22.118 INFO:teuthology.orchestra.run.smithi146.stdout:(54/152): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-05-03T16:29:22.144 INFO:teuthology.orchestra.run.smithi146.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 314 kB/s | 18 kB 00:00 2024-05-03T16:29:22.202 INFO:teuthology.orchestra.run.smithi146.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-05-03T16:29:22.244 INFO:teuthology.orchestra.run.smithi146.stdout:(57/152): libaio-devel-0.3.111-13.el9.x86_64.rp 89 kB/s | 11 kB 00:00 2024-05-03T16:29:22.303 INFO:teuthology.orchestra.run.smithi146.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 453 kB/s | 45 kB 00:00 2024-05-03T16:29:22.370 INFO:teuthology.orchestra.run.smithi146.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-05-03T16:29:22.428 INFO:teuthology.orchestra.run.smithi081.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 867 kB/s | 689 kB 00:00 2024-05-03T16:29:22.490 INFO:teuthology.orchestra.run.smithi134.stdout:(56/152): ceph-test-19.0.0-3450.g9a047fe7.el9.x 4.1 MB/s | 49 MB 00:11 2024-05-03T16:29:22.495 INFO:teuthology.orchestra.run.smithi146.stdout:(60/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.9 MB/s | 3.0 MB 00:00 2024-05-03T16:29:22.520 INFO:teuthology.orchestra.run.smithi146.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 170 kB/s | 25 kB 00:00 2024-05-03T16:29:22.550 INFO:teuthology.orchestra.run.smithi081.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-05-03T16:29:22.562 INFO:teuthology.orchestra.run.smithi146.stdout:(62/152): libtool-2.4.6-45.el9.x86_64.rpm 2.2 MB/s | 582 kB 00:00 2024-05-03T16:29:22.576 INFO:teuthology.orchestra.run.smithi081.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 731 kB/s | 107 kB 00:00 2024-05-03T16:29:22.604 INFO:teuthology.orchestra.run.smithi146.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 439 kB/s | 47 kB 00:00 2024-05-03T16:29:22.637 INFO:teuthology.orchestra.run.smithi146.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-05-03T16:29:22.660 INFO:teuthology.orchestra.run.smithi081.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 199 kB/s | 21 kB 00:00 2024-05-03T16:29:22.663 INFO:teuthology.orchestra.run.smithi146.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 610 kB/s | 35 kB 00:00 2024-05-03T16:29:22.697 INFO:teuthology.orchestra.run.smithi146.stdout:(66/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-05-03T16:29:22.737 INFO:teuthology.orchestra.run.smithi134.stdout:(57/152): libaio-devel-0.3.111-13.el9.x86_64.rp 10 kB/s | 11 kB 00:01 2024-05-03T16:29:22.989 INFO:teuthology.orchestra.run.smithi146.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 5.5 MB/s | 1.6 MB 00:00 2024-05-03T16:29:23.139 INFO:teuthology.orchestra.run.smithi146.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 6.0 MB/s | 911 kB 00:00 2024-05-03T16:29:23.160 INFO:teuthology.orchestra.run.smithi081.stdout:(52/152): ceph-test-19.0.0-3450.g9a047fe7.el9.x 5.3 MB/s | 49 MB 00:09 2024-05-03T16:29:23.185 INFO:teuthology.orchestra.run.smithi081.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 62 kB/s | 33 kB 00:00 2024-05-03T16:29:23.219 INFO:teuthology.orchestra.run.smithi081.stdout:(54/152): flex-2.6.4-9.el9.x86_64.rpm 488 kB/s | 313 kB 00:00 2024-05-03T16:29:23.237 INFO:teuthology.orchestra.run.smithi134.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 61 kB/s | 45 kB 00:00 2024-05-03T16:29:23.239 INFO:teuthology.orchestra.run.smithi146.stdout:(69/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 7.7 MB/s | 4.4 MB 00:00 2024-05-03T16:29:23.265 INFO:teuthology.orchestra.run.smithi146.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.0 MB/s | 133 kB 00:00 2024-05-03T16:29:23.294 INFO:teuthology.orchestra.run.smithi081.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-05-03T16:29:23.328 INFO:teuthology.orchestra.run.smithi081.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-05-03T16:29:23.338 INFO:teuthology.orchestra.run.smithi134.stdout:(59/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 120 kB/s | 160 kB 00:01 2024-05-03T16:29:23.390 INFO:teuthology.orchestra.run.smithi146.stdout:(71/152): openblas-openmp-0.3.21-2.el9.x86_64.r 6.3 MB/s | 4.7 MB 00:00 2024-05-03T16:29:23.403 INFO:teuthology.orchestra.run.smithi081.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-05-03T16:29:23.428 INFO:teuthology.orchestra.run.smithi081.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 454 kB/s | 45 kB 00:00 2024-05-03T16:29:23.448 INFO:teuthology.orchestra.run.smithi146.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-05-03T16:29:23.499 INFO:teuthology.orchestra.run.smithi146.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 4.3 MB/s | 1.0 MB 00:00 2024-05-03T16:29:23.566 INFO:teuthology.orchestra.run.smithi146.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2024-05-03T16:29:23.633 INFO:teuthology.orchestra.run.smithi146.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 3.7 MB/s | 248 kB 00:00 2024-05-03T16:29:23.687 INFO:teuthology.orchestra.run.smithi081.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 2.3 MB/s | 662 kB 00:00 2024-05-03T16:29:23.691 INFO:teuthology.orchestra.run.smithi146.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 445 kB/s | 26 kB 00:00 2024-05-03T16:29:23.729 INFO:teuthology.orchestra.run.smithi081.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 1.9 MB/s | 582 kB 00:00 2024-05-03T16:29:23.741 INFO:teuthology.orchestra.run.smithi146.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 389 kB/s | 19 kB 00:00 2024-05-03T16:29:23.787 INFO:teuthology.orchestra.run.smithi081.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 256 kB/s | 25 kB 00:00 2024-05-03T16:29:23.805 INFO:teuthology.orchestra.run.smithi134.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 621 kB/s | 662 kB 00:01 2024-05-03T16:29:23.808 INFO:teuthology.orchestra.run.smithi146.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.6 MB/s | 172 kB 00:00 2024-05-03T16:29:23.830 INFO:teuthology.orchestra.run.smithi081.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 476 kB/s | 47 kB 00:00 2024-05-03T16:29:23.859 INFO:teuthology.orchestra.run.smithi146.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 707 kB/s | 35 kB 00:00 2024-05-03T16:29:23.921 INFO:teuthology.orchestra.run.smithi081.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-05-03T16:29:23.955 INFO:teuthology.orchestra.run.smithi134.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 41 kB/s | 25 kB 00:00 2024-05-03T16:29:23.955 INFO:teuthology.orchestra.run.smithi081.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-05-03T16:29:23.976 INFO:teuthology.orchestra.run.smithi146.stdout:(80/152): postgresql-server-13.14-1.el9.x86_64. 7.9 MB/s | 5.8 MB 00:00 2024-05-03T16:29:24.030 INFO:teuthology.orchestra.run.smithi081.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 326 kB/s | 35 kB 00:00 2024-05-03T16:29:24.051 INFO:teuthology.orchestra.run.smithi146.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-05-03T16:29:24.118 INFO:teuthology.orchestra.run.smithi146.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-05-03T16:29:24.222 INFO:teuthology.orchestra.run.smithi081.stdout:(66/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-05-03T16:29:24.243 INFO:teuthology.orchestra.run.smithi146.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 621 kB/s | 77 kB 00:00 2024-05-03T16:29:24.280 INFO:teuthology.orchestra.run.smithi134.stdout:(62/152): libtool-2.4.6-45.el9.x86_64.rpm 559 kB/s | 582 kB 00:01 2024-05-03T16:29:24.352 INFO:teuthology.orchestra.run.smithi146.stdout:(84/152): python3-babel-2.9.1-2.el9.noarch.rpm 6.6 MB/s | 6.0 MB 00:00 2024-05-03T16:29:24.409 INFO:teuthology.orchestra.run.smithi146.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 256 kB/s | 42 kB 00:00 2024-05-03T16:29:24.448 INFO:teuthology.orchestra.run.smithi081.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 7.1 MB/s | 1.6 MB 00:00 2024-05-03T16:29:24.453 INFO:teuthology.orchestra.run.smithi146.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-05-03T16:29:24.511 INFO:teuthology.orchestra.run.smithi146.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-05-03T16:29:24.545 INFO:teuthology.orchestra.run.smithi146.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-05-03T16:29:24.579 INFO:teuthology.orchestra.run.smithi146.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 771 kB/s | 51 kB 00:00 2024-05-03T16:29:24.598 INFO:teuthology.orchestra.run.smithi081.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 6.0 MB/s | 911 kB 00:00 2024-05-03T16:29:24.604 INFO:teuthology.orchestra.run.smithi146.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 928 kB/s | 54 kB 00:00 2024-05-03T16:29:24.614 INFO:teuthology.orchestra.run.smithi134.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 59 kB/s | 47 kB 00:00 2024-05-03T16:29:24.698 INFO:teuthology.orchestra.run.smithi081.stdout:(69/152): openblas-openmp-0.3.21-2.el9.x86_64.r 6.4 MB/s | 4.7 MB 00:00 2024-05-03T16:29:24.712 INFO:teuthology.orchestra.run.smithi146.stdout:(91/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.0 MB/s | 5.1 MB 00:00 2024-05-03T16:29:24.740 INFO:teuthology.orchestra.run.smithi081.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 944 kB/s | 133 kB 00:00 2024-05-03T16:29:24.762 INFO:teuthology.orchestra.run.smithi146.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 263 kB/s | 42 kB 00:00 2024-05-03T16:29:24.788 INFO:teuthology.orchestra.run.smithi146.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 594 kB/s | 44 kB 00:00 2024-05-03T16:29:24.830 INFO:teuthology.orchestra.run.smithi146.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.3 MB/s | 221 kB 00:00 2024-05-03T16:29:24.855 INFO:teuthology.orchestra.run.smithi146.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 539 kB/s | 36 kB 00:00 2024-05-03T16:29:24.889 INFO:teuthology.orchestra.run.smithi146.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 813 kB/s | 47 kB 00:00 2024-05-03T16:29:24.922 INFO:teuthology.orchestra.run.smithi146.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-05-03T16:29:24.939 INFO:teuthology.orchestra.run.smithi134.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 298 kB/s | 292 kB 00:00 2024-05-03T16:29:24.950 INFO:teuthology.orchestra.run.smithi146.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-05-03T16:29:24.981 INFO:teuthology.orchestra.run.smithi146.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-05-03T16:29:25.007 INFO:teuthology.orchestra.run.smithi146.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-05-03T16:29:25.041 INFO:teuthology.orchestra.run.smithi146.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 776 kB/s | 45 kB 00:00 2024-05-03T16:29:25.041 INFO:teuthology.orchestra.run.smithi081.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 3.4 MB/s | 1.0 MB 00:00 2024-05-03T16:29:25.091 INFO:teuthology.orchestra.run.smithi146.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 269 kB/s | 22 kB 00:00 2024-05-03T16:29:25.157 INFO:teuthology.orchestra.run.smithi081.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 753 kB/s | 87 kB 00:00 2024-05-03T16:29:25.166 INFO:teuthology.orchestra.run.smithi146.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 6.8 MB/s | 863 kB 00:00 2024-05-03T16:29:25.181 INFO:teuthology.orchestra.run.smithi134.stdout:(65/152): lua-5.4.4-4.el9.x86_64.rpm 210 kB/s | 188 kB 00:00 2024-05-03T16:29:25.281 INFO:teuthology.orchestra.run.smithi134.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 53 kB/s | 35 kB 00:00 2024-05-03T16:29:25.308 INFO:teuthology.orchestra.run.smithi081.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 9.5 MB/s | 5.8 MB 00:00 2024-05-03T16:29:25.416 INFO:teuthology.orchestra.run.smithi081.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-05-03T16:29:25.449 INFO:teuthology.orchestra.run.smithi146.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.5 MB/s | 548 kB 00:00 2024-05-03T16:29:25.500 INFO:teuthology.orchestra.run.smithi146.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 929 kB/s | 309 kB 00:00 2024-05-03T16:29:25.525 INFO:teuthology.orchestra.run.smithi146.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 261 kB/s | 19 kB 00:00 2024-05-03T16:29:25.592 INFO:teuthology.orchestra.run.smithi146.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 394 kB/s | 26 kB 00:00 2024-05-03T16:29:25.659 INFO:teuthology.orchestra.run.smithi146.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 738 kB/s | 49 kB 00:00 2024-05-03T16:29:25.726 INFO:teuthology.orchestra.run.smithi146.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-05-03T16:29:25.767 INFO:teuthology.orchestra.run.smithi081.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 709 kB/s | 248 kB 00:00 2024-05-03T16:29:25.851 INFO:teuthology.orchestra.run.smithi146.stdout:(110/152): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-05-03T16:29:25.884 INFO:teuthology.orchestra.run.smithi081.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 221 kB/s | 26 kB 00:00 2024-05-03T16:29:25.885 INFO:teuthology.orchestra.run.smithi146.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 958 kB/s | 151 kB 00:00 2024-05-03T16:29:25.952 INFO:teuthology.orchestra.run.smithi146.stdout:(112/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.3 MB/s | 839 kB 00:00 2024-05-03T16:29:25.994 INFO:teuthology.orchestra.run.smithi146.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 5.0 MB/s | 548 kB 00:00 2024-05-03T16:29:26.017 INFO:teuthology.orchestra.run.smithi081.stdout:(77/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 2.2 MB/s | 4.4 MB 00:01 2024-05-03T16:29:26.019 INFO:teuthology.orchestra.run.smithi146.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 657 kB/s | 43 kB 00:00 2024-05-03T16:29:26.043 INFO:teuthology.orchestra.run.smithi081.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 121 kB/s | 19 kB 00:00 2024-05-03T16:29:26.061 INFO:teuthology.orchestra.run.smithi146.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 488 kB/s | 32 kB 00:00 2024-05-03T16:29:26.087 INFO:teuthology.orchestra.run.smithi146.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 226 kB/s | 15 kB 00:00 2024-05-03T16:29:26.137 INFO:teuthology.orchestra.run.smithi146.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.3 MB/s | 172 kB 00:00 2024-05-03T16:29:26.160 INFO:teuthology.orchestra.run.smithi081.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 299 kB/s | 35 kB 00:00 2024-05-03T16:29:26.170 INFO:teuthology.orchestra.run.smithi146.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-05-03T16:29:26.220 INFO:teuthology.orchestra.run.smithi146.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.6 MB/s | 303 kB 00:00 2024-05-03T16:29:26.246 INFO:teuthology.orchestra.run.smithi146.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 473 kB/s | 35 kB 00:00 2024-05-03T16:29:26.293 INFO:teuthology.orchestra.run.smithi081.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 626 kB/s | 172 kB 00:00 2024-05-03T16:29:26.296 INFO:teuthology.orchestra.run.smithi146.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-05-03T16:29:26.388 INFO:teuthology.orchestra.run.smithi146.stdout:(122/152): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-05-03T16:29:26.422 INFO:teuthology.orchestra.run.smithi146.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-05-03T16:29:26.447 INFO:teuthology.orchestra.run.smithi146.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 184 kB/s | 11 kB 00:00 2024-05-03T16:29:26.465 INFO:teuthology.orchestra.run.smithi134.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 3.1 MB/s | 4.7 MB 00:01 2024-05-03T16:29:26.472 INFO:teuthology.orchestra.run.smithi146.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 355 kB/s | 18 kB 00:00 2024-05-03T16:29:26.497 INFO:teuthology.orchestra.run.smithi146.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 467 kB/s | 23 kB 00:00 2024-05-03T16:29:26.523 INFO:teuthology.orchestra.run.smithi146.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 393 kB/s | 19 kB 00:00 2024-05-03T16:29:26.573 INFO:teuthology.orchestra.run.smithi146.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 264 kB/s | 20 kB 00:00 2024-05-03T16:29:26.643 INFO:teuthology.orchestra.run.smithi134.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 1.2 MB/s | 1.6 MB 00:01 2024-05-03T16:29:26.648 INFO:teuthology.orchestra.run.smithi146.stdout:(129/152): python3-kubernetes-26.1.0-2.el9.noar 8.2 MB/s | 1.0 MB 00:00 2024-05-03T16:29:26.674 INFO:teuthology.orchestra.run.smithi146.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 466 kB/s | 46 kB 00:00 2024-05-03T16:29:26.716 INFO:teuthology.orchestra.run.smithi146.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-05-03T16:29:26.718 INFO:teuthology.orchestra.run.smithi081.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 590 kB/s | 250 kB 00:00 2024-05-03T16:29:26.741 INFO:teuthology.orchestra.run.smithi146.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 871 kB/s | 58 kB 00:00 2024-05-03T16:29:26.765 INFO:teuthology.orchestra.run.smithi134.stdout:(69/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 2.9 MB/s | 4.4 MB 00:01 2024-05-03T16:29:27.077 INFO:teuthology.orchestra.run.smithi146.stdout:(133/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.5 MB/s | 16 MB 00:02 2024-05-03T16:29:27.085 INFO:teuthology.orchestra.run.smithi081.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 607 kB/s | 222 kB 00:00 2024-05-03T16:29:27.192 INFO:teuthology.orchestra.run.smithi146.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 36 kB/s | 16 kB 00:00 2024-05-03T16:29:27.225 INFO:teuthology.orchestra.run.smithi146.stdout:(135/152): python3-pecan-1.4.2-3.el9.noarch.rpm 535 kB/s | 272 kB 00:00 2024-05-03T16:29:27.259 INFO:teuthology.orchestra.run.smithi146.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 427 kB/s | 28 kB 00:00 2024-05-03T16:29:27.277 INFO:teuthology.orchestra.run.smithi081.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 404 kB/s | 77 kB 00:00 2024-05-03T16:29:27.301 INFO:teuthology.orchestra.run.smithi146.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 412 kB/s | 31 kB 00:00 2024-05-03T16:29:27.360 INFO:teuthology.orchestra.run.smithi146.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-05-03T16:29:27.385 INFO:teuthology.orchestra.run.smithi146.stdout:(139/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 294 kB/s | 90 kB 00:00 2024-05-03T16:29:27.403 INFO:teuthology.orchestra.run.smithi081.stdout:(84/152): python3-prettytable-0.7.2-27.el9.noar 339 kB/s | 42 kB 00:00 2024-05-03T16:29:27.410 INFO:teuthology.orchestra.run.smithi146.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 546 kB/s | 59 kB 00:00 2024-05-03T16:29:27.435 INFO:teuthology.orchestra.run.smithi146.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 479 kB/s | 36 kB 00:00 2024-05-03T16:29:27.460 INFO:teuthology.orchestra.run.smithi146.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 681 kB/s | 51 kB 00:00 2024-05-03T16:29:27.502 INFO:teuthology.orchestra.run.smithi146.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-05-03T16:29:27.544 INFO:teuthology.orchestra.run.smithi146.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-05-03T16:29:27.557 INFO:teuthology.orchestra.run.smithi134.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 146 kB/s | 133 kB 00:00 2024-05-03T16:29:27.570 INFO:teuthology.orchestra.run.smithi146.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 302 kB/s | 20 kB 00:00 2024-05-03T16:29:27.595 INFO:teuthology.orchestra.run.smithi146.stdout:(146/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.2 MB/s | 230 kB 00:00 2024-05-03T16:29:27.629 INFO:teuthology.orchestra.run.smithi146.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.3 MB/s | 192 kB 00:00 2024-05-03T16:29:27.671 INFO:teuthology.orchestra.run.smithi134.stdout:(71/152): postgresql-contrib-13.14-1.el9.x86_64 757 kB/s | 911 kB 00:01 2024-05-03T16:29:27.729 INFO:teuthology.orchestra.run.smithi146.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-05-03T16:29:27.853 INFO:teuthology.orchestra.run.smithi081.stdout:(85/152): python3-protobuf-3.14.0-13.el9.noarch 600 kB/s | 269 kB 00:00 2024-05-03T16:29:27.954 INFO:teuthology.orchestra.run.smithi146.stdout:(149/152): librbd1-19.0.0-3450.g9a047fe7.el9.x8 9.7 MB/s | 3.1 MB 00:00 2024-05-03T16:29:28.145 INFO:teuthology.orchestra.run.smithi081.stdout:(86/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 544 kB/s | 159 kB 00:00 2024-05-03T16:29:28.163 INFO:teuthology.orchestra.run.smithi146.stdout:(150/152): librados2-19.0.0-3450.g9a047fe7.el9. 6.0 MB/s | 3.4 MB 00:00 2024-05-03T16:29:28.266 INFO:teuthology.orchestra.run.smithi134.stdout:(72/152): postgresql-server-13.14-1.el9.x86_64. 4.0 MB/s | 5.8 MB 00:01 2024-05-03T16:29:28.271 INFO:teuthology.orchestra.run.smithi146.stdout:(151/152): openssl-3.2.1-1.el9.x86_64.rpm 2.5 MB/s | 1.3 MB 00:00 2024-05-03T16:29:28.415 INFO:teuthology.orchestra.run.smithi146.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 5.2 MB/s | 2.4 MB 00:00 2024-05-03T16:29:28.421 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-05-03T16:29:28.422 INFO:teuthology.orchestra.run.smithi146.stdout:Total 11 MB/s | 222 MB 00:20 2024-05-03T16:29:28.433 INFO:teuthology.orchestra.run.smithi134.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 115 kB/s | 87 kB 00:00 2024-05-03T16:29:28.554 INFO:teuthology.orchestra.run.smithi081.stdout:(87/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.1 MB/s | 5.1 MB 00:02 2024-05-03T16:29:28.637 INFO:teuthology.orchestra.run.smithi081.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 568 kB/s | 279 kB 00:00 2024-05-03T16:29:28.663 INFO:teuthology.orchestra.run.smithi081.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 473 kB/s | 51 kB 00:00 2024-05-03T16:29:28.741 INFO:teuthology.orchestra.run.smithi134.stdout:(74/152): protobuf-3.14.0-13.el9.x86_64.rpm 874 kB/s | 1.0 MB 00:01 2024-05-03T16:29:28.755 INFO:teuthology.orchestra.run.smithi081.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 462 kB/s | 54 kB 00:00 2024-05-03T16:29:28.872 INFO:teuthology.orchestra.run.smithi081.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 360 kB/s | 42 kB 00:00 2024-05-03T16:29:28.980 INFO:teuthology.orchestra.run.smithi081.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 410 kB/s | 44 kB 00:00 2024-05-03T16:29:29.347 INFO:teuthology.orchestra.run.smithi081.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 603 kB/s | 221 kB 00:00 2024-05-03T16:29:29.433 INFO:teuthology.orchestra.run.smithi134.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 244 kB/s | 244 kB 00:00 2024-05-03T16:29:29.456 INFO:teuthology.orchestra.run.smithi081.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 333 kB/s | 36 kB 00:00 2024-05-03T16:29:29.556 INFO:teuthology.orchestra.run.smithi081.stdout:(95/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 476 kB/s | 47 kB 00:00 2024-05-03T16:29:29.625 INFO:teuthology.orchestra.run.smithi134.stdout:(76/152): python3-babel-2.9.1-2.el9.noarch.rpm 4.4 MB/s | 6.0 MB 00:01 2024-05-03T16:29:29.684 INFO:teuthology.orchestra.run.smithi134.stdout:(77/152): python3-jinja2-2.11.3-5.el9.noarch.rp 284 kB/s | 248 kB 00:00 2024-05-03T16:29:29.998 INFO:teuthology.orchestra.run.smithi081.stdout:(96/152): socat-1.7.4.1-5.el9.x86_64.rpm 691 kB/s | 305 kB 00:00 2024-05-03T16:29:30.115 INFO:teuthology.orchestra.run.smithi081.stdout:(97/152): uuid-1.6.2-55.el9.x86_64.rpm 499 kB/s | 58 kB 00:00 2024-05-03T16:29:30.192 INFO:teuthology.orchestra.run.smithi134.stdout:(78/152): python3-jsonpatch-1.21-16.el9.noarch. 34 kB/s | 26 kB 00:00 2024-05-03T16:29:30.324 INFO:teuthology.orchestra.run.smithi081.stdout:(98/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 450 kB/s | 94 kB 00:00 2024-05-03T16:29:30.368 INFO:teuthology.orchestra.run.smithi134.stdout:(79/152): python3-jsonpointer-2.0-4.el9.noarch. 26 kB/s | 19 kB 00:00 2024-05-03T16:29:30.526 INFO:teuthology.orchestra.run.smithi134.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 205 kB/s | 172 kB 00:00 2024-05-03T16:29:30.532 INFO:teuthology.orchestra.run.smithi081.stdout:(99/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 306 kB/s | 64 kB 00:00 2024-05-03T16:29:30.666 INFO:teuthology.orchestra.run.smithi081.stdout:(100/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 338 kB/s | 45 kB 00:00 2024-05-03T16:29:30.716 INFO:teuthology.orchestra.run.smithi081.stdout:(101/152): lua-devel-5.4.4-4.el9.x86_64.rpm 453 kB/s | 22 kB 00:00 2024-05-03T16:29:30.825 INFO:teuthology.orchestra.run.smithi081.stdout:(102/152): protobuf-compiler-3.14.0-13.el9.x86_ 7.8 MB/s | 863 kB 00:00 2024-05-03T16:29:30.918 INFO:teuthology.orchestra.run.smithi134.stdout:(81/152): python3-markupsafe-1.1.1-12.el9.x86_6 48 kB/s | 35 kB 00:00 2024-05-03T16:29:31.167 INFO:teuthology.orchestra.run.smithi081.stdout:(103/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.6 MB/s | 548 kB 00:00 2024-05-03T16:29:31.267 INFO:teuthology.orchestra.run.smithi081.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 3.0 MB/s | 309 kB 00:00 2024-05-03T16:29:31.300 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-05-03T16:29:31.343 INFO:teuthology.orchestra.run.smithi081.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 260 kB/s | 19 kB 00:00 2024-05-03T16:29:31.510 INFO:teuthology.orchestra.run.smithi134.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 255 kB/s | 250 kB 00:00 2024-05-03T16:29:31.532 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-05-03T16:29:31.532 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-05-03T16:29:31.551 INFO:teuthology.orchestra.run.smithi081.stdout:(106/152): python3-babel-2.9.1-2.el9.noarch.rpm 955 kB/s | 6.0 MB 00:06 2024-05-03T16:29:31.727 INFO:teuthology.orchestra.run.smithi134.stdout:(83/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.8 MB/s | 5.1 MB 00:01 2024-05-03T16:29:31.743 INFO:teuthology.orchestra.run.smithi081.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 136 kB/s | 26 kB 00:00 2024-05-03T16:29:31.827 INFO:teuthology.orchestra.run.smithi134.stdout:(84/152): python3-oauthlib-3.1.1-5.el9.noarch.r 245 kB/s | 222 kB 00:00 2024-05-03T16:29:31.844 INFO:teuthology.orchestra.run.smithi081.stdout:(108/152): libarrow-9.0.0-11.el9.x86_64.rpm 8.8 MB/s | 4.4 MB 00:00 2024-05-03T16:29:31.894 INFO:teuthology.orchestra.run.smithi081.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 325 kB/s | 49 kB 00:00 2024-05-03T16:29:31.919 INFO:teuthology.orchestra.run.smithi081.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 905 kB/s | 67 kB 00:00 2024-05-03T16:29:32.012 INFO:teuthology.orchestra.run.smithi081.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-05-03T16:29:32.070 INFO:teuthology.orchestra.run.smithi081.stdout:(112/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.5 MB/s | 839 kB 00:00 2024-05-03T16:29:32.145 INFO:teuthology.orchestra.run.smithi081.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 584 kB/s | 43 kB 00:00 2024-05-03T16:29:32.179 INFO:teuthology.orchestra.run.smithi081.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-05-03T16:29:32.237 INFO:teuthology.orchestra.run.smithi081.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 353 kB/s | 32 kB 00:00 2024-05-03T16:29:32.291 INFO:teuthology.orchestra.run.smithi081.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 135 kB/s | 15 kB 00:00 2024-05-03T16:29:32.330 INFO:teuthology.orchestra.run.smithi081.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-05-03T16:29:32.353 INFO:teuthology.orchestra.run.smithi134.stdout:(85/152): python3-packaging-20.9-5.el9.noarch.r 92 kB/s | 77 kB 00:00 2024-05-03T16:29:32.380 INFO:teuthology.orchestra.run.smithi081.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 4.0 MB/s | 358 kB 00:00 2024-05-03T16:29:32.422 INFO:teuthology.orchestra.run.smithi081.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-05-03T16:29:32.456 INFO:teuthology.orchestra.run.smithi081.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 472 kB/s | 35 kB 00:00 2024-05-03T16:29:32.507 INFO:teuthology.orchestra.run.smithi081.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 2.4 MB/s | 206 kB 00:00 2024-05-03T16:29:32.590 INFO:teuthology.orchestra.run.smithi081.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-05-03T16:29:32.594 INFO:teuthology.orchestra.run.smithi134.stdout:(86/152): python3-prettytable-0.7.2-27.el9.noar 49 kB/s | 42 kB 00:00 2024-05-03T16:29:32.665 INFO:teuthology.orchestra.run.smithi081.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 144 kB/s | 11 kB 00:00 2024-05-03T16:29:32.740 INFO:teuthology.orchestra.run.smithi081.stdout:(124/152): python3-grpcio-1.46.7-10.el9.x86_64. 7.2 MB/s | 2.0 MB 00:00 2024-05-03T16:29:32.757 INFO:teuthology.orchestra.run.smithi081.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 193 kB/s | 18 kB 00:00 2024-05-03T16:29:32.816 INFO:teuthology.orchestra.run.smithi081.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 309 kB/s | 23 kB 00:00 2024-05-03T16:29:32.841 INFO:teuthology.orchestra.run.smithi081.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 234 kB/s | 19 kB 00:00 2024-05-03T16:29:32.861 INFO:teuthology.orchestra.run.smithi134.stdout:(87/152): python3-protobuf-3.14.0-13.el9.noarch 279 kB/s | 269 kB 00:00 2024-05-03T16:29:32.900 INFO:teuthology.orchestra.run.smithi081.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 237 kB/s | 20 kB 00:00 2024-05-03T16:29:32.975 INFO:teuthology.orchestra.run.smithi081.stdout:(129/152): python3-kubernetes-26.1.0-2.el9.noar 7.7 MB/s | 1.0 MB 00:00 2024-05-03T16:29:33.009 INFO:teuthology.orchestra.run.smithi081.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 428 kB/s | 46 kB 00:00 2024-05-03T16:29:33.059 INFO:teuthology.orchestra.run.smithi081.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 943 kB/s | 79 kB 00:00 2024-05-03T16:29:33.134 INFO:teuthology.orchestra.run.smithi081.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 463 kB/s | 58 kB 00:00 2024-05-03T16:29:33.168 INFO:teuthology.orchestra.run.smithi081.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2024-05-03T16:29:33.218 INFO:teuthology.orchestra.run.smithi081.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 197 kB/s | 16 kB 00:00 2024-05-03T16:29:33.228 INFO:teuthology.orchestra.run.smithi134.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 182 kB/s | 159 kB 00:00 2024-05-03T16:29:33.244 INFO:teuthology.orchestra.run.smithi081.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-05-03T16:29:33.319 INFO:teuthology.orchestra.run.smithi081.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 283 kB/s | 28 kB 00:00 2024-05-03T16:29:33.344 INFO:teuthology.orchestra.run.smithi081.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 308 kB/s | 31 kB 00:00 2024-05-03T16:29:33.411 INFO:teuthology.orchestra.run.smithi081.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-05-03T16:29:33.436 INFO:teuthology.orchestra.run.smithi081.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 648 kB/s | 59 kB 00:00 2024-05-03T16:29:33.487 INFO:teuthology.orchestra.run.smithi081.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 480 kB/s | 36 kB 00:00 2024-05-03T16:29:33.529 INFO:teuthology.orchestra.run.smithi081.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 559 kB/s | 51 kB 00:00 2024-05-03T16:29:33.571 INFO:teuthology.orchestra.run.smithi081.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-05-03T16:29:33.612 INFO:teuthology.orchestra.run.smithi134.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 68 kB/s | 51 kB 00:00 2024-05-03T16:29:33.612 INFO:teuthology.orchestra.run.smithi081.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2024-05-03T16:29:33.662 INFO:teuthology.orchestra.run.smithi134.stdout:(90/152): python3-pyasn1-modules-0.4.8-6.el9.no 280 kB/s | 279 kB 00:00 2024-05-03T16:29:33.671 INFO:teuthology.orchestra.run.smithi081.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-05-03T16:29:33.697 INFO:teuthology.orchestra.run.smithi081.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 240 kB/s | 20 kB 00:00 2024-05-03T16:29:33.755 INFO:teuthology.orchestra.run.smithi081.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 2.3 MB/s | 192 kB 00:00 2024-05-03T16:29:33.847 INFO:teuthology.orchestra.run.smithi081.stdout:(147/152): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-05-03T16:29:33.996 INFO:teuthology.orchestra.run.smithi134.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 70 kB/s | 54 kB 00:00 2024-05-03T16:29:34.129 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-05-03T16:29:34.129 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-05-03T16:29:34.131 INFO:teuthology.orchestra.run.smithi081.stdout:(148/152): librados2-19.0.0-3450.g9a047fe7.el9. 9.1 MB/s | 3.4 MB 00:00 2024-05-03T16:29:34.346 INFO:teuthology.orchestra.run.smithi134.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 61 kB/s | 42 kB 00:00 2024-05-03T16:29:34.431 INFO:teuthology.orchestra.run.smithi081.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 4.5 MB/s | 1.3 MB 00:00 2024-05-03T16:29:34.671 INFO:teuthology.orchestra.run.smithi134.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 66 kB/s | 44 kB 00:00 2024-05-03T16:29:34.673 INFO:teuthology.orchestra.run.smithi081.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 9.9 MB/s | 2.4 MB 00:00 2024-05-03T16:29:34.772 INFO:teuthology.orchestra.run.smithi081.stdout:(151/152): librbd1-19.0.0-3450.g9a047fe7.el9.x8 3.4 MB/s | 3.1 MB 00:00 2024-05-03T16:29:35.255 INFO:teuthology.orchestra.run.smithi134.stdout:(94/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.9 MB/s | 16 MB 00:01 2024-05-03T16:29:35.289 INFO:teuthology.orchestra.run.smithi134.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 234 kB/s | 221 kB 00:00 2024-05-03T16:29:35.472 INFO:teuthology.orchestra.run.smithi134.stdout:(96/152): qatlib-service-24.02.0-1.el9.x86_64.r 45 kB/s | 36 kB 00:00 2024-05-03T16:29:35.939 INFO:teuthology.orchestra.run.smithi134.stdout:(97/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 69 kB/s | 47 kB 00:00 2024-05-03T16:29:36.264 INFO:teuthology.orchestra.run.smithi134.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 73 kB/s | 58 kB 00:00 2024-05-03T16:29:36.298 INFO:teuthology.orchestra.run.smithi134.stdout:(99/152): socat-1.7.4.1-5.el9.x86_64.rpm 302 kB/s | 305 kB 00:01 2024-05-03T16:29:36.740 INFO:teuthology.orchestra.run.smithi134.stdout:(100/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 117 kB/s | 94 kB 00:00 2024-05-03T16:29:36.832 INFO:teuthology.orchestra.run.smithi134.stdout:(101/152): lua-devel-5.4.4-4.el9.x86_64.rpm 246 kB/s | 22 kB 00:00 2024-05-03T16:29:36.990 INFO:teuthology.orchestra.run.smithi134.stdout:(102/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 88 kB/s | 64 kB 00:00 2024-05-03T16:29:37.015 INFO:teuthology.orchestra.run.smithi134.stdout:(103/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 62 kB/s | 45 kB 00:00 2024-05-03T16:29:37.057 INFO:teuthology.orchestra.run.smithi134.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 3.8 MB/s | 863 kB 00:00 2024-05-03T16:29:37.374 INFO:teuthology.orchestra.run.smithi134.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 61 kB/s | 19 kB 00:00 2024-05-03T16:29:37.466 INFO:teuthology.orchestra.run.smithi134.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 687 kB/s | 309 kB 00:00 2024-05-03T16:29:37.533 INFO:teuthology.orchestra.run.smithi134.stdout:(107/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-05-03T16:29:37.558 INFO:teuthology.orchestra.run.smithi134.stdout:(108/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 285 kB/s | 26 kB 00:00 2024-05-03T16:29:37.592 INFO:teuthology.orchestra.run.smithi134.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 842 kB/s | 49 kB 00:00 2024-05-03T16:29:37.617 INFO:teuthology.orchestra.run.smithi134.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-05-03T16:29:37.659 INFO:teuthology.orchestra.run.smithi134.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-05-03T16:29:37.759 INFO:teuthology.orchestra.run.smithi134.stdout:(112/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-05-03T16:29:37.801 INFO:teuthology.orchestra.run.smithi134.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-05-03T16:29:37.827 INFO:teuthology.orchestra.run.smithi134.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 655 kB/s | 43 kB 00:00 2024-05-03T16:29:37.860 INFO:teuthology.orchestra.run.smithi134.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 558 kB/s | 32 kB 00:00 2024-05-03T16:29:37.909 INFO:teuthology.orchestra.run.smithi134.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 184 kB/s | 15 kB 00:00 2024-05-03T16:29:37.945 INFO:teuthology.orchestra.run.smithi134.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-05-03T16:29:37.986 INFO:teuthology.orchestra.run.smithi134.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-05-03T16:29:38.020 INFO:teuthology.orchestra.run.smithi134.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.0 MB/s | 303 kB 00:00 2024-05-03T16:29:38.037 INFO:teuthology.orchestra.run.smithi134.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 711 kB/s | 35 kB 00:00 2024-05-03T16:29:38.146 INFO:teuthology.orchestra.run.smithi134.stdout:(121/152): libarrow-9.0.0-11.el9.x86_64.rpm 5.7 MB/s | 4.4 MB 00:00 2024-05-03T16:29:38.179 INFO:teuthology.orchestra.run.smithi134.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 1.3 MB/s | 206 kB 00:00 2024-05-03T16:29:38.213 INFO:teuthology.orchestra.run.smithi134.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-05-03T16:29:38.238 INFO:teuthology.orchestra.run.smithi134.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 188 kB/s | 11 kB 00:00 2024-05-03T16:29:38.272 INFO:teuthology.orchestra.run.smithi134.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 306 kB/s | 18 kB 00:00 2024-05-03T16:29:38.297 INFO:teuthology.orchestra.run.smithi134.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 400 kB/s | 23 kB 00:00 2024-05-03T16:29:38.339 INFO:teuthology.orchestra.run.smithi134.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 294 kB/s | 19 kB 00:00 2024-05-03T16:29:38.364 INFO:teuthology.orchestra.run.smithi134.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 297 kB/s | 20 kB 00:00 2024-05-03T16:29:38.448 INFO:teuthology.orchestra.run.smithi134.stdout:(129/152): python3-grpcio-1.46.7-10.el9.x86_64. 5.0 MB/s | 2.0 MB 00:00 2024-05-03T16:29:38.473 INFO:teuthology.orchestra.run.smithi134.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 429 kB/s | 46 kB 00:00 2024-05-03T16:29:38.507 INFO:teuthology.orchestra.run.smithi134.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-05-03T16:29:38.532 INFO:teuthology.orchestra.run.smithi134.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 997 kB/s | 58 kB 00:00 2024-05-03T16:29:38.582 INFO:teuthology.orchestra.run.smithi134.stdout:(133/152): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-05-03T16:29:38.607 INFO:teuthology.orchestra.run.smithi134.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 220 kB/s | 16 kB 00:00 2024-05-03T16:29:38.642 INFO:teuthology.orchestra.run.smithi134.stdout:(135/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-05-03T16:29:38.666 INFO:teuthology.orchestra.run.smithi134.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 488 kB/s | 28 kB 00:00 2024-05-03T16:29:38.692 INFO:teuthology.orchestra.run.smithi134.stdout:(137/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 831 kB/s | 90 kB 00:00 2024-05-03T16:29:38.717 INFO:teuthology.orchestra.run.smithi134.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 412 kB/s | 31 kB 00:00 2024-05-03T16:29:38.742 INFO:teuthology.orchestra.run.smithi134.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-05-03T16:29:38.767 INFO:teuthology.orchestra.run.smithi134.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 791 kB/s | 59 kB 00:00 2024-05-03T16:29:38.793 INFO:teuthology.orchestra.run.smithi134.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 478 kB/s | 36 kB 00:00 2024-05-03T16:29:38.818 INFO:teuthology.orchestra.run.smithi134.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 681 kB/s | 51 kB 00:00 2024-05-03T16:29:38.851 INFO:teuthology.orchestra.run.smithi134.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-05-03T16:29:38.885 INFO:teuthology.orchestra.run.smithi134.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 981 kB/s | 90 kB 00:00 2024-05-03T16:29:38.935 INFO:teuthology.orchestra.run.smithi134.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 243 kB/s | 20 kB 00:00 2024-05-03T16:29:38.969 INFO:teuthology.orchestra.run.smithi134.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 2.3 MB/s | 192 kB 00:00 2024-05-03T16:29:39.003 INFO:teuthology.orchestra.run.smithi134.stdout:(147/152): python3-werkzeug-2.0.3-3.el9.1.noarc 2.3 MB/s | 427 kB 00:00 2024-05-03T16:29:39.120 INFO:teuthology.orchestra.run.smithi134.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-05-03T16:29:39.420 INFO:teuthology.orchestra.run.smithi134.stdout:(149/152): librbd1-19.0.0-3450.g9a047fe7.el9.x8 7.6 MB/s | 3.1 MB 00:00 2024-05-03T16:29:39.612 INFO:teuthology.orchestra.run.smithi134.stdout:(150/152): librados2-19.0.0-3450.g9a047fe7.el9. 5.3 MB/s | 3.4 MB 00:00 2024-05-03T16:29:40.580 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-05-03T16:29:40.670 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-05-03T16:29:40.795 INFO:teuthology.orchestra.run.smithi134.stdout:(151/152): openssl-3.2.1-1.el9.x86_64.rpm 825 kB/s | 1.3 MB 00:01 2024-05-03T16:29:40.933 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-05-03T16:29:41.091 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-05-03T16:29:41.161 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-05-03T16:29:41.206 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-05-03T16:29:41.343 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-05-03T16:29:41.775 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-05-03T16:29:41.878 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T16:29:41.878 INFO:teuthology.orchestra.run.smithi134.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 998 kB/s | 2.4 MB 00:02 2024-05-03T16:29:41.894 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-05-03T16:29:41.894 INFO:teuthology.orchestra.run.smithi134.stdout:Total 6.4 MB/s | 222 MB 00:34 2024-05-03T16:29:42.057 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T16:29:42.087 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T16:29:42.237 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T16:29:42.270 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 10/156 2024-05-03T16:29:42.595 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-05-03T16:29:42.658 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-05-03T16:29:42.683 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T16:29:42.832 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T16:29:42.876 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 14/156 2024-05-03T16:29:42.963 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 14/156 2024-05-03T16:29:42.994 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-03T16:29:43.061 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-03T16:29:43.415 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-03T16:29:43.470 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-03T16:29:43.671 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-05-03T16:29:43.794 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-05-03T16:29:43.837 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-05-03T16:29:43.885 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-05-03T16:29:43.986 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-05-03T16:29:44.048 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-05-03T16:29:44.112 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-05-03T16:29:44.158 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-05-03T16:29:44.191 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-05-03T16:29:44.286 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-05-03T16:29:44.370 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-05-03T16:29:44.412 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-05-03T16:29:44.467 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-05-03T16:29:44.573 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-05-03T16:29:44.607 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9. 31/156 2024-05-03T16:29:44.657 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el 32/156 2024-05-03T16:29:44.705 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_6 33/156 2024-05-03T16:29:44.711 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-05-03T16:29:44.818 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-05-03T16:29:44.875 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-05-03T16:29:44.943 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-05-03T16:29:44.943 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-05-03T16:29:44.980 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-05-03T16:29:45.179 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-05-03T16:29:45.252 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-05-03T16:29:45.931 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-05-03T16:29:46.050 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-05-03T16:29:46.095 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-05-03T16:29:46.157 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-05-03T16:29:46.199 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_6 43/156 2024-05-03T16:29:46.268 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-05-03T16:29:46.501 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-05-03T16:29:46.563 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-05-03T16:29:46.621 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-05-03T16:29:46.721 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-05-03T16:29:46.763 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-05-03T16:29:46.802 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-05-03T16:29:46.903 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-05-03T16:29:46.945 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-05-03T16:29:47.008 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-05-03T16:29:47.072 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-05-03T16:29:47.268 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-05-03T16:29:47.325 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-05-03T16:29:47.363 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-05-03T16:29:47.428 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-05-03T16:29:47.523 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-05-03T16:29:47.524 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-05-03T16:29:47.557 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-05-03T16:29:47.605 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-05-03T16:29:47.652 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-05-03T16:29:47.684 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-05-03T16:29:47.719 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-05-03T16:29:47.924 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-05-03T16:29:48.107 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-05-03T16:29:48.150 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-05-03T16:29:48.189 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-05-03T16:29:48.244 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-05-03T16:29:48.329 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-05-03T16:29:48.391 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-05-03T16:29:48.434 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-05-03T16:29:48.483 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-05-03T16:29:48.542 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-05-03T16:29:48.617 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-05-03T16:29:48.673 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-05-03T16:29:48.819 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-05-03T16:29:48.876 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-05-03T16:29:48.929 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-05-03T16:29:48.999 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-05-03T16:29:49.156 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-05-03T16:29:49.226 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-05-03T16:29:50.202 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-05-03T16:29:50.268 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-05-03T16:29:50.301 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-05-03T16:29:50.413 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-05-03T16:29:50.503 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-05-03T16:29:50.565 INFO:teuthology.orchestra.run.smithi081.stdout:(152/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 760 kB/s | 16 MB 00:21 2024-05-03T16:29:50.572 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-05-03T16:29:50.572 INFO:teuthology.orchestra.run.smithi081.stdout:Total 5.3 MB/s | 222 MB 00:42 2024-05-03T16:29:50.603 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-05-03T16:29:50.643 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-05-03T16:29:50.880 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-05-03T16:29:50.924 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-05-03T16:29:51.030 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-05-03T16:29:51.844 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-05-03T16:29:52.004 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-05-03T16:29:53.440 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-05-03T16:29:53.581 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-05-03T16:29:53.673 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-05-03T16:29:53.673 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-05-03T16:29:53.680 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-05-03T16:29:53.720 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-05-03T16:29:53.751 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-05-03T16:29:53.764 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-05-03T16:29:53.879 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-05-03T16:29:53.957 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-05-03T16:29:54.060 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-05-03T16:29:54.114 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-05-03T16:29:54.145 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-05-03T16:29:54.180 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-05-03T16:29:54.226 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 99/156 2024-05-03T16:29:54.286 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-05-03T16:29:54.346 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 99/156 2024-05-03T16:29:54.382 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 100/156 2024-05-03T16:29:54.438 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-05-03T16:29:54.763 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-05-03T16:29:54.869 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T16:29:54.980 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-05-03T16:29:55.012 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 103/156 2024-05-03T16:29:55.051 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T16:29:55.078 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T16:29:55.112 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 103/156 2024-05-03T16:29:55.139 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 104/156 2024-05-03T16:29:55.207 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T16:29:55.269 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 10/156 2024-05-03T16:29:55.646 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-05-03T16:29:55.724 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-05-03T16:29:55.749 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T16:29:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T16:29:55.925 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 14/156 2024-05-03T16:29:56.011 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 14/156 2024-05-03T16:29:56.043 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-03T16:29:56.121 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-03T16:29:56.214 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-05-03T16:29:56.215 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-05-03T16:29:56.449 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-03T16:29:56.509 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-03T16:29:56.695 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-05-03T16:29:56.832 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-05-03T16:29:56.885 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-05-03T16:29:56.935 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-05-03T16:29:57.048 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-05-03T16:29:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-05-03T16:29:57.198 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-05-03T16:29:57.246 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-05-03T16:29:57.284 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-05-03T16:29:57.401 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-05-03T16:29:57.499 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-05-03T16:29:57.535 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-05-03T16:29:57.595 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-05-03T16:29:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-05-03T16:29:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9. 31/156 2024-05-03T16:29:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el 32/156 2024-05-03T16:29:57.816 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T16:29:57.819 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_6 33/156 2024-05-03T16:29:57.851 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T16:29:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-05-03T16:29:57.989 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-05-03T16:29:58.089 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-05-03T16:29:58.272 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-05-03T16:29:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-05-03T16:29:58.509 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T16:29:58.555 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 106/156 2024-05-03T16:29:58.707 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 106/156 2024-05-03T16:29:58.707 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-03T16:29:58.707 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-03T16:29:58.707 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:29:58.748 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 107/156 2024-05-03T16:29:59.068 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-05-03T16:29:59.173 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-05-03T16:29:59.209 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-05-03T16:29:59.253 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-05-03T16:29:59.293 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_6 43/156 2024-05-03T16:29:59.362 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-05-03T16:29:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-05-03T16:29:59.694 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-05-03T16:29:59.753 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-05-03T16:29:59.851 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-05-03T16:29:59.894 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-05-03T16:29:59.933 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-05-03T16:30:00.001 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-05-03T16:30:00.041 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-05-03T16:30:00.103 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-05-03T16:30:00.163 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-05-03T16:30:00.349 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-05-03T16:30:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-05-03T16:30:00.469 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-05-03T16:30:00.529 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-05-03T16:30:00.668 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-05-03T16:30:00.718 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-05-03T16:30:00.767 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-05-03T16:30:00.800 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-05-03T16:30:00.833 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-05-03T16:30:01.020 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-05-03T16:30:01.188 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-05-03T16:30:01.231 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-05-03T16:30:01.276 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-05-03T16:30:01.316 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-05-03T16:30:01.373 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-05-03T16:30:01.434 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-05-03T16:30:01.493 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-05-03T16:30:01.540 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-05-03T16:30:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-05-03T16:30:01.674 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-05-03T16:30:01.720 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-05-03T16:30:01.858 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-05-03T16:30:01.926 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-05-03T16:30:01.978 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-05-03T16:30:02.048 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-05-03T16:30:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-05-03T16:30:02.280 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-05-03T16:30:02.637 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-05-03T16:30:02.792 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-05-03T16:30:02.898 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-05-03T16:30:03.026 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-05-03T16:30:03.085 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-05-03T16:30:03.123 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-05-03T16:30:03.194 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-05-03T16:30:03.248 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-05-03T16:30:03.274 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-05-03T16:30:03.281 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-05-03T16:30:03.406 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-05-03T16:30:03.501 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-05-03T16:30:03.611 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-05-03T16:30:03.658 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-05-03T16:30:03.685 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-05-03T16:30:03.822 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T16:30:03.891 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-05-03T16:30:03.930 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-05-03T16:30:03.999 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T16:30:04.036 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-05-03T16:30:04.057 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T16:30:04.191 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T16:30:04.272 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 10/156 2024-05-03T16:30:04.645 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-05-03T16:30:04.703 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-05-03T16:30:04.735 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T16:30:04.872 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-05-03T16:30:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T16:30:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 14/156 2024-05-03T16:30:05.013 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 14/156 2024-05-03T16:30:05.018 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-05-03T16:30:05.037 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-03T16:30:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-03T16:30:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-03T16:30:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-03T16:30:05.746 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-05-03T16:30:05.876 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-05-03T16:30:05.922 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-05-03T16:30:05.979 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-05-03T16:30:06.083 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-05-03T16:30:06.142 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-05-03T16:30:06.208 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-05-03T16:30:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-05-03T16:30:06.295 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-05-03T16:30:06.412 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-05-03T16:30:06.472 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-05-03T16:30:06.535 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-05-03T16:30:06.602 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-05-03T16:30:06.625 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-05-03T16:30:06.716 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-05-03T16:30:06.727 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-05-03T16:30:06.759 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9. 31/156 2024-05-03T16:30:06.768 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-05-03T16:30:06.812 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-05-03T16:30:06.813 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el 32/156 2024-05-03T16:30:06.849 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_6 33/156 2024-05-03T16:30:06.962 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-05-03T16:30:07.028 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-05-03T16:30:07.136 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-05-03T16:30:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-05-03T16:30:07.241 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 99/156 2024-05-03T16:30:07.310 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-05-03T16:30:07.359 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 99/156 2024-05-03T16:30:07.388 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 100/156 2024-05-03T16:30:07.396 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-05-03T16:30:07.444 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-05-03T16:30:07.987 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-05-03T16:30:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 103/156 2024-05-03T16:30:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-05-03T16:30:08.108 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 103/156 2024-05-03T16:30:08.136 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 104/156 2024-05-03T16:30:08.153 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-05-03T16:30:08.197 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-05-03T16:30:08.250 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-05-03T16:30:08.292 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_6 43/156 2024-05-03T16:30:08.350 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-05-03T16:30:08.557 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-05-03T16:30:08.641 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-05-03T16:30:08.714 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-05-03T16:30:08.793 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-05-03T16:30:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-05-03T16:30:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-05-03T16:30:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-05-03T16:30:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-05-03T16:30:09.049 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-05-03T16:30:09.111 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-05-03T16:30:09.305 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-05-03T16:30:09.361 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-05-03T16:30:09.418 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-05-03T16:30:09.476 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-05-03T16:30:09.614 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-05-03T16:30:09.657 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-05-03T16:30:09.705 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-05-03T16:30:09.740 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-05-03T16:30:09.765 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-05-03T16:30:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-05-03T16:30:10.151 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-05-03T16:30:10.196 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-05-03T16:30:10.257 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-05-03T16:30:10.309 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-05-03T16:30:10.376 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-05-03T16:30:10.436 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-05-03T16:30:10.486 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-05-03T16:30:10.541 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-05-03T16:30:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-05-03T16:30:10.673 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-05-03T16:30:10.728 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-05-03T16:30:10.870 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-05-03T16:30:10.935 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-05-03T16:30:10.977 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-05-03T16:30:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-05-03T16:30:11.072 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T16:30:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T16:30:11.221 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-05-03T16:30:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-05-03T16:30:11.733 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 107/156 2024-05-03T16:30:11.733 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /sys 2024-05-03T16:30:11.733 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /proc 2024-05-03T16:30:11.733 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /mnt 2024-05-03T16:30:11.733 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /var/tmp 2024-05-03T16:30:11.733 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /home 2024-05-03T16:30:11.733 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /root 2024-05-03T16:30:11.733 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /tmp 2024-05-03T16:30:11.733 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:30:11.762 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T16:30:11.811 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 106/156 2024-05-03T16:30:11.949 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 106/156 2024-05-03T16:30:11.949 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-03T16:30:11.949 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-03T16:30:11.949 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-03T16:30:11.979 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 108/156 2024-05-03T16:30:12.003 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 107/156 2024-05-03T16:30:12.023 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 108/156 2024-05-03T16:30:12.023 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:12.023 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-03T16:30:12.023 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:30:12.255 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-05-03T16:30:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-05-03T16:30:12.366 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-05-03T16:30:12.477 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-05-03T16:30:12.542 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-05-03T16:30:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-05-03T16:30:12.683 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-05-03T16:30:12.941 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-05-03T16:30:12.980 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-05-03T16:30:13.086 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-05-03T16:30:13.614 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 109/156 2024-05-03T16:30:13.719 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 109/156 2024-05-03T16:30:13.720 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:13.720 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-03T16:30:13.720 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-03T16:30:13.720 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-03T16:30:13.720 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:30:13.944 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-05-03T16:30:13.989 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 110/156 2024-05-03T16:30:14.058 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 110/156 2024-05-03T16:30:14.058 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:14.058 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-03T16:30:14.058 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-03T16:30:14.058 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-03T16:30:14.058 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:30:14.092 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-05-03T16:30:14.565 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 111/156 2024-05-03T16:30:14.633 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 111/156 2024-05-03T16:30:14.634 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:14.634 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-03T16:30:14.634 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-03T16:30:14.634 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-03T16:30:14.634 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:30:14.756 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-05-03T16:30:14.816 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-05-03T16:30:14.900 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-05-03T16:30:15.136 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-05-03T16:30:15.217 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-05-03T16:30:15.310 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-05-03T16:30:15.424 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-03T16:30:15.587 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-03T16:30:15.652 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-05-03T16:30:15.667 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-05-03T16:30:15.693 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-05-03T16:30:15.737 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-05-03T16:30:16.067 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-05-03T16:30:16.123 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-05-03T16:30:16.178 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-05-03T16:30:16.418 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 123/156 2024-05-03T16:30:16.455 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 123/156 2024-05-03T16:30:16.509 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.e 124/156 2024-05-03T16:30:16.574 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-05-03T16:30:16.609 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 99/156 2024-05-03T16:30:16.615 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7. 125/156 2024-05-03T16:30:16.691 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 126/156 2024-05-03T16:30:16.728 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 99/156 2024-05-03T16:30:16.756 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 100/156 2024-05-03T16:30:16.810 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-05-03T16:30:17.344 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-05-03T16:30:17.378 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 103/156 2024-05-03T16:30:17.469 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 103/156 2024-05-03T16:30:17.497 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 104/156 2024-05-03T16:30:18.000 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 126/156 2024-05-03T16:30:18.040 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 127/156 2024-05-03T16:30:19.137 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 127/156 2024-05-03T16:30:19.190 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 128/156 2024-05-03T16:30:19.347 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 128/156 2024-05-03T16:30:19.520 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el 129/156 2024-05-03T16:30:19.568 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 130/156 2024-05-03T16:30:19.635 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 130/156 2024-05-03T16:30:19.636 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:19.636 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-03T16:30:19.636 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-03T16:30:19.636 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-03T16:30:19.636 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:30:19.685 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 131/156 2024-05-03T16:30:19.718 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 131/156 2024-05-03T16:30:19.832 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 132/156 2024-05-03T16:30:19.927 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 133/156 2024-05-03T16:30:20.169 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T16:30:20.212 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T16:30:20.859 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T16:30:20.924 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 106/156 2024-05-03T16:30:20.959 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-05-03T16:30:21.006 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 135/156 2024-05-03T16:30:21.085 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 106/156 2024-05-03T16:30:21.085 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-03T16:30:21.085 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-03T16:30:21.085 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:30:21.097 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 135/156 2024-05-03T16:30:21.097 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:21.097 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-03T16:30:21.097 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-03T16:30:21.097 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-03T16:30:21.098 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:30:21.124 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 107/156 2024-05-03T16:30:21.148 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3450.g9a047 136/156 2024-05-03T16:30:21.246 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3450.g9a047 136/156 2024-05-03T16:30:21.246 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:21.246 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-03T16:30:21.246 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:30:21.352 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 137/156 2024-05-03T16:30:21.460 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 137/156 2024-05-03T16:30:21.460 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:21.460 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-03T16:30:21.460 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-03T16:30:21.460 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-03T16:30:21.460 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:30:21.866 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 138/156 2024-05-03T16:30:21.959 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 138/156 2024-05-03T16:30:21.959 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:21.959 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-03T16:30:21.960 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-03T16:30:21.960 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-03T16:30:21.960 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:30:24.859 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 107/156 2024-05-03T16:30:24.860 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-05-03T16:30:24.860 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-05-03T16:30:24.860 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-05-03T16:30:24.860 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-05-03T16:30:24.860 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-05-03T16:30:24.860 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /root 2024-05-03T16:30:24.860 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-05-03T16:30:24.860 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-03T16:30:25.092 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 108/156 2024-05-03T16:30:25.138 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 108/156 2024-05-03T16:30:25.138 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:25.138 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-03T16:30:25.138 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-03T16:30:26.781 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 109/156 2024-05-03T16:30:26.862 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 109/156 2024-05-03T16:30:26.862 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:26.862 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-03T16:30:26.862 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-03T16:30:26.862 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-03T16:30:26.862 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-03T16:30:27.023 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 139/156 2024-05-03T16:30:27.076 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 140/156 2024-05-03T16:30:27.115 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 110/156 2024-05-03T16:30:27.184 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 110/156 2024-05-03T16:30:27.184 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:27.184 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-03T16:30:27.184 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-03T16:30:27.185 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-03T16:30:27.185 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-03T16:30:27.200 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 141/156 2024-05-03T16:30:27.246 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-05-03T16:30:27.293 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-05-03T16:30:27.653 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 144/156 2024-05-03T16:30:27.665 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 111/156 2024-05-03T16:30:27.701 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-05-03T16:30:27.729 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_ 146/156 2024-05-03T16:30:27.731 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 111/156 2024-05-03T16:30:27.731 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:27.731 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-03T16:30:27.731 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-03T16:30:27.731 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-03T16:30:27.731 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-03T16:30:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-05-03T16:30:27.928 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-05-03T16:30:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-05-03T16:30:28.235 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-05-03T16:30:28.311 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-05-03T16:30:28.398 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-05-03T16:30:28.523 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-03T16:30:28.614 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T16:30:28.660 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T16:30:28.691 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-03T16:30:28.721 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T16:30:28.739 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-05-03T16:30:28.776 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-05-03T16:30:28.818 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-05-03T16:30:29.446 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 123/156 2024-05-03T16:30:29.498 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 123/156 2024-05-03T16:30:29.544 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.e 124/156 2024-05-03T16:30:29.650 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7. 125/156 2024-05-03T16:30:29.682 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 126/156 2024-05-03T16:30:30.072 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 148/156 2024-05-03T16:30:30.191 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-05-03T16:30:30.277 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-05-03T16:30:30.468 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-05-03T16:30:30.523 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-05-03T16:30:30.524 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-03T16:30:30.649 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-03T16:30:30.696 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-03T16:30:30.697 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-03T16:30:30.845 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-03T16:30:30.983 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 126/156 2024-05-03T16:30:30.985 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T16:30:31.025 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 127/156 2024-05-03T16:30:31.311 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T16:30:31.311 INFO:teuthology.orchestra.run.smithi146.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-03T16:30:31.311 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:30:32.121 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 127/156 2024-05-03T16:30:32.150 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 128/156 2024-05-03T16:30:32.304 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 128/156 2024-05-03T16:30:32.504 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el 129/156 2024-05-03T16:30:32.536 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 130/156 2024-05-03T16:30:32.605 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 130/156 2024-05-03T16:30:32.605 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:32.605 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-03T16:30:32.605 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-03T16:30:32.605 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-03T16:30:32.605 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-03T16:30:32.662 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 131/156 2024-05-03T16:30:32.700 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 131/156 2024-05-03T16:30:32.812 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 132/156 2024-05-03T16:30:32.881 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 133/156 2024-05-03T16:30:33.872 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-05-03T16:30:33.914 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 135/156 2024-05-03T16:30:33.982 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 135/156 2024-05-03T16:30:33.982 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:33.982 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-03T16:30:33.982 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-03T16:30:33.982 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-03T16:30:33.983 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-03T16:30:34.032 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3450.g9a047 136/156 2024-05-03T16:30:34.098 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3450.g9a047 136/156 2024-05-03T16:30:34.099 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:34.099 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-03T16:30:34.099 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-03T16:30:34.174 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 137/156 2024-05-03T16:30:34.247 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 137/156 2024-05-03T16:30:34.247 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:34.247 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-03T16:30:34.247 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-03T16:30:34.247 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-03T16:30:34.247 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-03T16:30:34.260 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 107/156 2024-05-03T16:30:34.260 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2024-05-03T16:30:34.261 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2024-05-03T16:30:34.261 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2024-05-03T16:30:34.261 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2024-05-03T16:30:34.261 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2024-05-03T16:30:34.261 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /root 2024-05-03T16:30:34.261 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2024-05-03T16:30:34.261 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:30:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 108/156 2024-05-03T16:30:34.580 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 108/156 2024-05-03T16:30:34.581 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:34.581 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-03T16:30:34.581 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:30:34.616 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 138/156 2024-05-03T16:30:34.713 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 138/156 2024-05-03T16:30:34.713 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:34.713 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-03T16:30:34.713 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-03T16:30:34.713 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-03T16:30:34.714 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-03T16:30:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 109/156 2024-05-03T16:30:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 109/156 2024-05-03T16:30:36.312 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:36.312 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-03T16:30:36.312 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-03T16:30:36.312 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-03T16:30:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:30:36.560 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 110/156 2024-05-03T16:30:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 110/156 2024-05-03T16:30:36.628 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:36.628 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-03T16:30:36.628 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-03T16:30:36.628 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-03T16:30:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:30:37.111 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 111/156 2024-05-03T16:30:37.178 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 111/156 2024-05-03T16:30:37.179 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:37.179 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-03T16:30:37.179 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-03T16:30:37.179 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-03T16:30:37.179 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:30:37.230 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 1/156 2024-05-03T16:30:37.230 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 2/156 2024-05-03T16:30:37.231 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 3/156 2024-05-03T16:30:37.231 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 4/156 2024-05-03T16:30:37.231 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3450.g9a047 5/156 2024-05-03T16:30:37.231 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 6/156 2024-05-03T16:30:37.231 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 7/156 2024-05-03T16:30:37.231 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T16:30:37.231 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T16:30:37.231 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 10/156 2024-05-03T16:30:37.231 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 11/156 2024-05-03T16:30:37.231 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 12/156 2024-05-03T16:30:37.231 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T16:30:37.231 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 14/156 2024-05-03T16:30:37.232 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_ 15/156 2024-05-03T16:30:37.232 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 16/156 2024-05-03T16:30:37.232 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 17/156 2024-05-03T16:30:37.232 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_6 18/156 2024-05-03T16:30:37.232 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 19/156 2024-05-03T16:30:37.232 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 20/156 2024-05-03T16:30:37.232 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el 21/156 2024-05-03T16:30:37.232 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9. 22/156 2024-05-03T16:30:37.232 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_6 23/156 2024-05-03T16:30:37.232 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 24/156 2024-05-03T16:30:37.232 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 25/156 2024-05-03T16:30:37.244 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 26/156 2024-05-03T16:30:37.244 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 27/156 2024-05-03T16:30:37.244 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 28/156 2024-05-03T16:30:37.244 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 29/156 2024-05-03T16:30:37.245 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7. 30/156 2024-05-03T16:30:37.245 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 31/156 2024-05-03T16:30:37.245 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 32/156 2024-05-03T16:30:37.245 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 33/156 2024-05-03T16:30:37.245 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el 34/156 2024-05-03T16:30:37.245 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 35/156 2024-05-03T16:30:37.245 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.e 36/156 2024-05-03T16:30:37.245 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 37/156 2024-05-03T16:30:37.245 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 38/156 2024-05-03T16:30:37.245 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 39/156 2024-05-03T16:30:37.245 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-05-03T16:30:37.245 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-05-03T16:30:37.245 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-05-03T16:30:37.245 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-05-03T16:30:37.246 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-05-03T16:30:37.246 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-05-03T16:30:37.246 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-05-03T16:30:37.246 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-05-03T16:30:37.246 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-05-03T16:30:37.246 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-05-03T16:30:37.246 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-05-03T16:30:37.246 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-05-03T16:30:37.246 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-05-03T16:30:37.246 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-05-03T16:30:37.246 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-05-03T16:30:37.246 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-05-03T16:30:37.247 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-05-03T16:30:37.247 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-05-03T16:30:37.247 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-05-03T16:30:37.247 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-05-03T16:30:37.247 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-05-03T16:30:37.247 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-05-03T16:30:37.247 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-05-03T16:30:37.247 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-05-03T16:30:37.247 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-05-03T16:30:37.247 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-05-03T16:30:37.247 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-05-03T16:30:37.247 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-05-03T16:30:37.247 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-05-03T16:30:37.248 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-05-03T16:30:37.248 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-05-03T16:30:37.248 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-05-03T16:30:37.248 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-05-03T16:30:37.248 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-05-03T16:30:37.248 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-05-03T16:30:37.248 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-05-03T16:30:37.248 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-05-03T16:30:37.248 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-05-03T16:30:37.248 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-05-03T16:30:37.248 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-05-03T16:30:37.248 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-05-03T16:30:37.248 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-05-03T16:30:37.248 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-05-03T16:30:37.249 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-05-03T16:30:37.249 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-05-03T16:30:37.249 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-05-03T16:30:37.249 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-05-03T16:30:37.249 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-05-03T16:30:37.249 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-05-03T16:30:37.249 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-05-03T16:30:37.249 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-05-03T16:30:37.249 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-05-03T16:30:37.249 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-05-03T16:30:37.249 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-05-03T16:30:37.249 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-05-03T16:30:37.249 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-05-03T16:30:37.249 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-05-03T16:30:37.250 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-05-03T16:30:37.250 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-05-03T16:30:37.250 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-05-03T16:30:37.250 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-05-03T16:30:37.250 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-05-03T16:30:37.250 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-05-03T16:30:37.250 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-05-03T16:30:37.250 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-05-03T16:30:37.250 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-05-03T16:30:37.250 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-05-03T16:30:37.250 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-05-03T16:30:37.250 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-05-03T16:30:37.250 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-05-03T16:30:37.250 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-05-03T16:30:37.250 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-05-03T16:30:37.251 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-05-03T16:30:37.251 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-05-03T16:30:37.251 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-05-03T16:30:37.251 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-05-03T16:30:37.251 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-05-03T16:30:37.251 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-05-03T16:30:37.251 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-03T16:30:37.251 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-03T16:30:37.251 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-05-03T16:30:37.251 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-05-03T16:30:37.251 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-05-03T16:30:37.251 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-05-03T16:30:37.251 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-05-03T16:30:37.252 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-05-03T16:30:37.252 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-05-03T16:30:37.252 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-05-03T16:30:37.252 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-05-03T16:30:37.252 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-05-03T16:30:37.252 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-05-03T16:30:37.252 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-05-03T16:30:37.252 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-05-03T16:30:37.252 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-05-03T16:30:37.252 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-05-03T16:30:37.252 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-05-03T16:30:37.252 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-05-03T16:30:37.252 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-05-03T16:30:37.252 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-05-03T16:30:37.253 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-05-03T16:30:37.253 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-05-03T16:30:37.253 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-05-03T16:30:37.253 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-05-03T16:30:37.253 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-05-03T16:30:37.253 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-05-03T16:30:37.253 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-05-03T16:30:37.253 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-05-03T16:30:37.253 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-05-03T16:30:37.253 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-05-03T16:30:37.253 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 149/156 2024-05-03T16:30:37.253 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-05-03T16:30:37.253 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 151/156 2024-05-03T16:30:37.254 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-05-03T16:30:37.254 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-05-03T16:30:37.254 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-03T16:30:37.254 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-05-03T16:30:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-05-03T16:30:37.364 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-05-03T16:30:37.432 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-05-03T16:30:37.662 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-05-03T16:30:37.717 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-05-03T16:30:37.802 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-05-03T16:30:37.910 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-03T16:30:38.110 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-03T16:30:38.167 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-05-03T16:30:38.208 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-05-03T16:30:38.241 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-05-03T16:30:38.930 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 123/156 2024-05-03T16:30:38.970 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 123/156 2024-05-03T16:30:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.e 124/156 2024-05-03T16:30:39.134 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7. 125/156 2024-05-03T16:30:39.171 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 126/156 2024-05-03T16:30:39.751 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T16:30:39.752 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:30:39.752 INFO:teuthology.orchestra.run.smithi146.stdout:Upgraded: 2024-05-03T16:30:39.752 INFO:teuthology.orchestra.run.smithi146.stdout: librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.752 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.752 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-03T16:30:39.752 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-03T16:30:39.752 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-05-03T16:30:39.752 INFO:teuthology.orchestra.run.smithi146.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-03T16:30:39.752 INFO:teuthology.orchestra.run.smithi146.stdout: automake-1.16.2-8.el9.noarch 2024-05-03T16:30:39.752 INFO:teuthology.orchestra.run.smithi146.stdout: bison-3.7.4-5.el9.x86_64 2024-05-03T16:30:39.752 INFO:teuthology.orchestra.run.smithi146.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-03T16:30:39.753 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.753 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.753 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.753 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.753 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:39.753 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.753 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.753 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.753 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:39.753 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:39.753 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:39.753 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:39.753 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:39.753 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.753 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.754 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:39.754 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.754 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.754 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.754 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:39.754 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:39.754 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.754 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.754 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:39.754 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-03T16:30:39.754 INFO:teuthology.orchestra.run.smithi146.stdout: flex-2.6.4-9.el9.x86_64 2024-05-03T16:30:39.754 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-03T16:30:39.754 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-03T16:30:39.754 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-03T16:30:39.755 INFO:teuthology.orchestra.run.smithi146.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-03T16:30:39.755 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-03T16:30:39.755 INFO:teuthology.orchestra.run.smithi146.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-03T16:30:39.755 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-03T16:30:39.755 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-03T16:30:39.755 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-03T16:30:39.755 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.755 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.755 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.755 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-03T16:30:39.755 INFO:teuthology.orchestra.run.smithi146.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-03T16:30:39.755 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-03T16:30:39.755 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-03T16:30:39.755 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-03T16:30:39.756 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.756 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.756 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-03T16:30:39.756 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.756 INFO:teuthology.orchestra.run.smithi146.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-03T16:30:39.756 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-03T16:30:39.756 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-03T16:30:39.756 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-03T16:30:39.756 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-03T16:30:39.756 INFO:teuthology.orchestra.run.smithi146.stdout: lua-5.4.4-4.el9.x86_64 2024-05-03T16:30:39.756 INFO:teuthology.orchestra.run.smithi146.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-03T16:30:39.756 INFO:teuthology.orchestra.run.smithi146.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-03T16:30:39.756 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-03T16:30:39.756 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-03T16:30:39.756 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-03T16:30:39.757 INFO:teuthology.orchestra.run.smithi146.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-03T16:30:39.757 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-13.14-1.el9.x86_64 2024-05-03T16:30:39.757 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-03T16:30:39.757 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-03T16:30:39.757 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-03T16:30:39.757 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-03T16:30:39.757 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-03T16:30:39.757 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-03T16:30:39.757 INFO:teuthology.orchestra.run.smithi146.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-03T16:30:39.757 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-03T16:30:39.757 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-03T16:30:39.757 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-03T16:30:39.757 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.757 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.758 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.758 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-03T16:30:39.758 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-03T16:30:39.758 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-03T16:30:39.758 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-03T16:30:39.758 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-03T16:30:39.758 INFO:teuthology.orchestra.run.smithi146.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-03T16:30:39.758 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-03T16:30:39.758 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-03T16:30:39.758 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-03T16:30:39.758 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-03T16:30:39.758 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-03T16:30:39.758 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-03T16:30:39.758 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-03T16:30:39.759 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-03T16:30:39.759 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-03T16:30:39.759 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-03T16:30:39.759 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-03T16:30:39.759 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-03T16:30:39.759 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-03T16:30:39.759 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-03T16:30:39.759 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-03T16:30:39.759 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-03T16:30:39.759 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-03T16:30:39.759 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-03T16:30:39.759 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-03T16:30:39.759 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-03T16:30:39.759 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-03T16:30:39.760 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-03T16:30:39.760 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-03T16:30:39.760 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-03T16:30:39.760 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply-3.11-14.el9.noarch 2024-05-03T16:30:39.760 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-03T16:30:39.760 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-03T16:30:39.760 INFO:teuthology.orchestra.run.smithi146.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-03T16:30:39.760 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-03T16:30:39.760 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-03T16:30:39.760 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-03T16:30:39.760 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-03T16:30:39.760 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-03T16:30:39.760 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-03T16:30:39.760 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.761 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.761 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-03T16:30:39.761 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-03T16:30:39.761 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-03T16:30:39.761 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.761 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-03T16:30:39.761 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-03T16:30:39.761 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-03T16:30:39.761 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-03T16:30:39.761 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-03T16:30:39.761 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-03T16:30:39.761 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-03T16:30:39.761 INFO:teuthology.orchestra.run.smithi146.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-03T16:30:39.761 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-03T16:30:39.761 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-03T16:30:39.762 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-03T16:30:39.762 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-03T16:30:39.762 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-03T16:30:39.762 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-03T16:30:39.762 INFO:teuthology.orchestra.run.smithi146.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-03T16:30:39.762 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.762 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.762 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:39.762 INFO:teuthology.orchestra.run.smithi146.stdout: re2-1:20211101-3.el9.x86_64 2024-05-03T16:30:39.762 INFO:teuthology.orchestra.run.smithi146.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-03T16:30:39.762 INFO:teuthology.orchestra.run.smithi146.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-03T16:30:39.762 INFO:teuthology.orchestra.run.smithi146.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-03T16:30:39.762 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-03T16:30:39.762 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-03T16:30:39.763 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 139/156 2024-05-03T16:30:39.763 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-03T16:30:39.763 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:30:39.763 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-05-03T16:30:39.812 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 140/156 2024-05-03T16:30:39.901 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 141/156 2024-05-03T16:30:39.944 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-05-03T16:30:39.995 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-05-03T16:30:40.330 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 144/156 2024-05-03T16:30:40.386 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-05-03T16:30:40.406 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_ 146/156 2024-05-03T16:30:40.410 DEBUG:teuthology.parallel:result is None 2024-05-03T16:30:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 126/156 2024-05-03T16:30:40.523 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 127/156 2024-05-03T16:30:41.293 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T16:30:41.346 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T16:30:41.402 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T16:30:41.611 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 127/156 2024-05-03T16:30:41.639 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 128/156 2024-05-03T16:30:41.793 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 128/156 2024-05-03T16:30:41.969 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el 129/156 2024-05-03T16:30:42.008 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 130/156 2024-05-03T16:30:42.077 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 130/156 2024-05-03T16:30:42.077 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:42.077 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-03T16:30:42.078 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-03T16:30:42.078 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-03T16:30:42.078 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:30:42.134 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 131/156 2024-05-03T16:30:42.170 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 131/156 2024-05-03T16:30:42.274 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 132/156 2024-05-03T16:30:42.340 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 133/156 2024-05-03T16:30:42.690 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 148/156 2024-05-03T16:30:42.795 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-05-03T16:30:42.872 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-05-03T16:30:43.046 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-05-03T16:30:43.092 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-05-03T16:30:43.092 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-03T16:30:43.219 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-03T16:30:43.267 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-03T16:30:43.267 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-03T16:30:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-05-03T16:30:43.370 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 135/156 2024-05-03T16:30:43.407 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-03T16:30:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 135/156 2024-05-03T16:30:43.438 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:43.438 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-03T16:30:43.438 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-03T16:30:43.438 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-03T16:30:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:30:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3450.g9a047 136/156 2024-05-03T16:30:43.537 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T16:30:43.555 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3450.g9a047 136/156 2024-05-03T16:30:43.555 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:43.556 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-03T16:30:43.556 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:30:43.638 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 137/156 2024-05-03T16:30:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 137/156 2024-05-03T16:30:43.716 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:43.716 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-03T16:30:43.716 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-03T16:30:43.717 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-03T16:30:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:30:43.830 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T16:30:43.831 INFO:teuthology.orchestra.run.smithi134.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-03T16:30:43.831 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-03T16:30:44.097 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 138/156 2024-05-03T16:30:44.165 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 138/156 2024-05-03T16:30:44.165 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T16:30:44.165 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-03T16:30:44.165 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-03T16:30:44.165 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-03T16:30:44.165 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:30:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 139/156 2024-05-03T16:30:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 140/156 2024-05-03T16:30:49.328 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 141/156 2024-05-03T16:30:49.375 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-05-03T16:30:49.422 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-05-03T16:30:49.504 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 1/156 2024-05-03T16:30:49.504 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 2/156 2024-05-03T16:30:49.504 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 3/156 2024-05-03T16:30:49.504 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 4/156 2024-05-03T16:30:49.504 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3450.g9a047 5/156 2024-05-03T16:30:49.504 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 6/156 2024-05-03T16:30:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 7/156 2024-05-03T16:30:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T16:30:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T16:30:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 10/156 2024-05-03T16:30:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 11/156 2024-05-03T16:30:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 12/156 2024-05-03T16:30:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T16:30:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 14/156 2024-05-03T16:30:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_ 15/156 2024-05-03T16:30:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 16/156 2024-05-03T16:30:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 17/156 2024-05-03T16:30:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_6 18/156 2024-05-03T16:30:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 19/156 2024-05-03T16:30:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 20/156 2024-05-03T16:30:49.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el 21/156 2024-05-03T16:30:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9. 22/156 2024-05-03T16:30:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_6 23/156 2024-05-03T16:30:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 24/156 2024-05-03T16:30:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 25/156 2024-05-03T16:30:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 26/156 2024-05-03T16:30:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 27/156 2024-05-03T16:30:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 28/156 2024-05-03T16:30:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 29/156 2024-05-03T16:30:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7. 30/156 2024-05-03T16:30:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 31/156 2024-05-03T16:30:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 32/156 2024-05-03T16:30:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 33/156 2024-05-03T16:30:49.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el 34/156 2024-05-03T16:30:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 35/156 2024-05-03T16:30:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.e 36/156 2024-05-03T16:30:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 37/156 2024-05-03T16:30:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 38/156 2024-05-03T16:30:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 39/156 2024-05-03T16:30:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-05-03T16:30:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-05-03T16:30:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-05-03T16:30:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-05-03T16:30:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-05-03T16:30:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-05-03T16:30:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-05-03T16:30:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-05-03T16:30:49.507 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-05-03T16:30:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-05-03T16:30:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-05-03T16:30:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-05-03T16:30:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-05-03T16:30:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-05-03T16:30:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-05-03T16:30:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-05-03T16:30:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-05-03T16:30:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-05-03T16:30:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-05-03T16:30:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-05-03T16:30:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-05-03T16:30:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-05-03T16:30:49.508 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-05-03T16:30:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-05-03T16:30:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-05-03T16:30:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-05-03T16:30:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-05-03T16:30:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-05-03T16:30:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-05-03T16:30:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-05-03T16:30:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-05-03T16:30:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-05-03T16:30:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-05-03T16:30:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-05-03T16:30:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-05-03T16:30:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-05-03T16:30:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-05-03T16:30:49.509 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-05-03T16:30:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-05-03T16:30:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-05-03T16:30:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-05-03T16:30:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-05-03T16:30:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-05-03T16:30:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-05-03T16:30:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-05-03T16:30:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-05-03T16:30:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-05-03T16:30:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-05-03T16:30:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-05-03T16:30:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-05-03T16:30:49.510 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-05-03T16:30:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-05-03T16:30:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-05-03T16:30:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-05-03T16:30:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-05-03T16:30:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-05-03T16:30:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-05-03T16:30:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-05-03T16:30:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-05-03T16:30:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-05-03T16:30:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-05-03T16:30:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-05-03T16:30:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-05-03T16:30:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-05-03T16:30:49.511 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-05-03T16:30:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-05-03T16:30:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-05-03T16:30:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-05-03T16:30:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-05-03T16:30:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-05-03T16:30:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-05-03T16:30:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-05-03T16:30:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-05-03T16:30:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-05-03T16:30:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-05-03T16:30:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-05-03T16:30:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-05-03T16:30:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-05-03T16:30:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-03T16:30:49.512 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-03T16:30:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-05-03T16:30:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-05-03T16:30:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-05-03T16:30:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-05-03T16:30:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-05-03T16:30:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-05-03T16:30:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-05-03T16:30:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-05-03T16:30:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-05-03T16:30:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-05-03T16:30:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-05-03T16:30:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-05-03T16:30:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-05-03T16:30:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-05-03T16:30:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-05-03T16:30:49.513 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-05-03T16:30:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-05-03T16:30:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-05-03T16:30:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-05-03T16:30:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-05-03T16:30:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-05-03T16:30:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-05-03T16:30:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-05-03T16:30:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-05-03T16:30:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-05-03T16:30:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-05-03T16:30:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-05-03T16:30:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-05-03T16:30:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-05-03T16:30:49.514 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 149/156 2024-05-03T16:30:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-05-03T16:30:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 151/156 2024-05-03T16:30:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-05-03T16:30:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-05-03T16:30:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-03T16:30:49.515 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-05-03T16:30:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 144/156 2024-05-03T16:30:49.933 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-05-03T16:30:49.961 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_ 146/156 2024-05-03T16:30:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T16:30:50.892 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T16:30:50.951 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T16:30:52.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T16:30:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-03T16:30:52.005 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-05-03T16:30:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-03T16:30:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-03T16:30:52.005 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-05-03T16:30:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-03T16:30:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: automake-1.16.2-8.el9.noarch 2024-05-03T16:30:52.005 INFO:teuthology.orchestra.run.smithi134.stdout: bison-3.7.4-5.el9.x86_64 2024-05-03T16:30:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-03T16:30:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:52.006 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.007 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:30:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-03T16:30:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: flex-2.6.4-9.el9.x86_64 2024-05-03T16:30:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-03T16:30:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-03T16:30:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-03T16:30:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-03T16:30:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-03T16:30:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-03T16:30:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-03T16:30:52.008 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-03T16:30:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-03T16:30:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-03T16:30:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-03T16:30:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-03T16:30:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-03T16:30:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-03T16:30:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-03T16:30:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.009 INFO:teuthology.orchestra.run.smithi134.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-03T16:30:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-03T16:30:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-03T16:30:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-03T16:30:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-03T16:30:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: lua-5.4.4-4.el9.x86_64 2024-05-03T16:30:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-03T16:30:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-03T16:30:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-03T16:30:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-03T16:30:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-03T16:30:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-03T16:30:52.010 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-13.14-1.el9.x86_64 2024-05-03T16:30:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-03T16:30:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-03T16:30:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-03T16:30:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-03T16:30:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-03T16:30:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-03T16:30:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-03T16:30:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-03T16:30:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-03T16:30:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-03T16:30:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.011 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-03T16:30:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-03T16:30:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-03T16:30:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-03T16:30:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-03T16:30:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-03T16:30:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-03T16:30:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-03T16:30:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-03T16:30:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-03T16:30:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-03T16:30:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-03T16:30:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-03T16:30:52.012 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-03T16:30:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-03T16:30:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-03T16:30:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-03T16:30:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-03T16:30:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-03T16:30:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-03T16:30:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-03T16:30:52.013 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-03T16:30:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-03T16:30:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-03T16:30:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-03T16:30:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-03T16:30:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-03T16:30:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-03T16:30:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-03T16:30:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-03T16:30:52.014 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply-3.11-14.el9.noarch 2024-05-03T16:30:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-03T16:30:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-03T16:30:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-03T16:30:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-03T16:30:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-03T16:30:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-03T16:30:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-03T16:30:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-03T16:30:52.015 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-03T16:30:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-03T16:30:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-03T16:30:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-03T16:30:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-03T16:30:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-03T16:30:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-03T16:30:52.016 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-03T16:30:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-03T16:30:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-03T16:30:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-03T16:30:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-03T16:30:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-03T16:30:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-03T16:30:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-03T16:30:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-03T16:30:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-03T16:30:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-03T16:30:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-03T16:30:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:30:52.017 INFO:teuthology.orchestra.run.smithi134.stdout: re2-1:20211101-3.el9.x86_64 2024-05-03T16:30:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-03T16:30:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-03T16:30:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-03T16:30:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-03T16:30:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-03T16:30:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-03T16:30:52.018 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-03T16:30:52.018 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-05-03T16:30:52.238 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 148/156 2024-05-03T16:30:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-05-03T16:30:52.433 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-05-03T16:30:52.589 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-05-03T16:30:52.631 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-05-03T16:30:52.631 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-03T16:30:52.660 DEBUG:teuthology.parallel:result is None 2024-05-03T16:30:52.755 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-03T16:30:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-03T16:30:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-03T16:30:52.961 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-03T16:30:53.093 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T16:30:53.375 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T16:30:53.375 INFO:teuthology.orchestra.run.smithi081.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-03T16:30:53.375 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:30:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 1/156 2024-05-03T16:30:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 2/156 2024-05-03T16:30:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 3/156 2024-05-03T16:30:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 4/156 2024-05-03T16:30:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3450.g9a047 5/156 2024-05-03T16:30:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 6/156 2024-05-03T16:30:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 7/156 2024-05-03T16:30:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T16:30:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T16:30:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 10/156 2024-05-03T16:30:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 11/156 2024-05-03T16:30:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 12/156 2024-05-03T16:30:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T16:30:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 14/156 2024-05-03T16:30:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_ 15/156 2024-05-03T16:30:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 16/156 2024-05-03T16:30:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 17/156 2024-05-03T16:30:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_6 18/156 2024-05-03T16:30:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 19/156 2024-05-03T16:30:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 20/156 2024-05-03T16:30:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el 21/156 2024-05-03T16:30:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9. 22/156 2024-05-03T16:30:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_6 23/156 2024-05-03T16:30:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 24/156 2024-05-03T16:30:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 25/156 2024-05-03T16:30:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 26/156 2024-05-03T16:30:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 27/156 2024-05-03T16:30:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 28/156 2024-05-03T16:30:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 29/156 2024-05-03T16:30:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7. 30/156 2024-05-03T16:30:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 31/156 2024-05-03T16:30:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 32/156 2024-05-03T16:30:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 33/156 2024-05-03T16:30:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el 34/156 2024-05-03T16:30:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 35/156 2024-05-03T16:30:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.e 36/156 2024-05-03T16:30:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 37/156 2024-05-03T16:30:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 38/156 2024-05-03T16:30:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 39/156 2024-05-03T16:30:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-05-03T16:30:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-05-03T16:30:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-05-03T16:30:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-05-03T16:30:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-05-03T16:30:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-05-03T16:30:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-05-03T16:30:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-05-03T16:30:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-05-03T16:30:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-05-03T16:30:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-05-03T16:30:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-05-03T16:30:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-05-03T16:30:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-05-03T16:30:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-05-03T16:30:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-05-03T16:30:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-05-03T16:30:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-05-03T16:30:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-05-03T16:30:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-05-03T16:30:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-05-03T16:30:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-05-03T16:30:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-05-03T16:30:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-05-03T16:30:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-05-03T16:30:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-05-03T16:30:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-05-03T16:30:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-05-03T16:30:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-05-03T16:30:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-05-03T16:30:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-05-03T16:30:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-05-03T16:30:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-05-03T16:30:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-05-03T16:30:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-05-03T16:30:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-05-03T16:30:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-05-03T16:30:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-05-03T16:30:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-05-03T16:30:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-05-03T16:30:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-05-03T16:30:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-05-03T16:30:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-05-03T16:30:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-05-03T16:30:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-05-03T16:30:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-05-03T16:30:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-05-03T16:30:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-05-03T16:30:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-05-03T16:30:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-05-03T16:30:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-05-03T16:30:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-05-03T16:30:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-05-03T16:30:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-05-03T16:30:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-05-03T16:30:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-05-03T16:30:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-05-03T16:30:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-05-03T16:30:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-05-03T16:30:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-05-03T16:30:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-05-03T16:30:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-05-03T16:30:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-05-03T16:30:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-05-03T16:30:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-05-03T16:30:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-05-03T16:30:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-05-03T16:30:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-05-03T16:30:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-05-03T16:30:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-05-03T16:30:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-05-03T16:30:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-05-03T16:30:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-05-03T16:30:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-05-03T16:30:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-05-03T16:30:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-05-03T16:30:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-05-03T16:30:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-05-03T16:30:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-03T16:30:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-03T16:30:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-05-03T16:30:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-05-03T16:30:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-05-03T16:30:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-05-03T16:30:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-05-03T16:30:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-05-03T16:30:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-05-03T16:30:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-05-03T16:30:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-05-03T16:30:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-05-03T16:30:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-05-03T16:30:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-05-03T16:30:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-05-03T16:30:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-05-03T16:30:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-05-03T16:30:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-05-03T16:30:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-05-03T16:30:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-05-03T16:30:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-05-03T16:30:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-05-03T16:30:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-05-03T16:30:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-05-03T16:30:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-05-03T16:30:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-05-03T16:30:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-05-03T16:30:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-05-03T16:30:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-05-03T16:30:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-05-03T16:30:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-05-03T16:30:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 149/156 2024-05-03T16:30:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-05-03T16:30:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 151/156 2024-05-03T16:30:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-05-03T16:30:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-05-03T16:30:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-03T16:30:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-05-03T16:31:01.752 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T16:31:01.752 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:31:01.753 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2024-05-03T16:31:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-03T16:31:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-03T16:31:01.753 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-05-03T16:31:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-03T16:31:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.2-8.el9.noarch 2024-05-03T16:31:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.7.4-5.el9.x86_64 2024-05-03T16:31:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-03T16:31:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:31:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:31:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:31:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:31:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:31:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:31:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:31:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:31:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:31:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T16:31:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-03T16:31:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.4-9.el9.x86_64 2024-05-03T16:31:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-03T16:31:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-03T16:31:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-03T16:31:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-03T16:31:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-03T16:31:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-03T16:31:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-03T16:31:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-03T16:31:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-03T16:31:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-03T16:31:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-03T16:31:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-03T16:31:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-03T16:31:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-03T16:31:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-03T16:31:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-03T16:31:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-03T16:31:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-03T16:31:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-03T16:31:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-03T16:31:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: lua-5.4.4-4.el9.x86_64 2024-05-03T16:31:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-03T16:31:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-03T16:31:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-03T16:31:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-03T16:31:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-03T16:31:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-03T16:31:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-13.14-1.el9.x86_64 2024-05-03T16:31:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-03T16:31:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-03T16:31:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-03T16:31:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-03T16:31:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-03T16:31:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-03T16:31:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-03T16:31:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-03T16:31:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-03T16:31:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-03T16:31:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-03T16:31:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-03T16:31:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-03T16:31:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-03T16:31:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-03T16:31:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-03T16:31:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-03T16:31:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-03T16:31:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-03T16:31:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-03T16:31:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-03T16:31:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-03T16:31:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-03T16:31:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-03T16:31:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-03T16:31:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-03T16:31:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-03T16:31:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-03T16:31:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-03T16:31:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-03T16:31:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-03T16:31:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-03T16:31:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-03T16:31:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-03T16:31:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-03T16:31:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-03T16:31:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-03T16:31:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-03T16:31:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-03T16:31:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-03T16:31:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply-3.11-14.el9.noarch 2024-05-03T16:31:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-03T16:31:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-03T16:31:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-03T16:31:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-03T16:31:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-03T16:31:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-03T16:31:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-03T16:31:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-03T16:31:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-03T16:31:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-03T16:31:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-03T16:31:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-03T16:31:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-03T16:31:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-03T16:31:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-03T16:31:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-03T16:31:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-03T16:31:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-03T16:31:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-03T16:31:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-03T16:31:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-03T16:31:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-03T16:31:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-03T16:31:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-03T16:31:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-03T16:31:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-03T16:31:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-03T16:31:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T16:31:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: re2-1:20211101-3.el9.x86_64 2024-05-03T16:31:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-03T16:31:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-03T16:31:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-03T16:31:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-03T16:31:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-03T16:31:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-03T16:31:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:31:01.766 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-05-03T16:31:02.350 DEBUG:teuthology.parallel:result is None 2024-05-03T16:31:02.351 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T16:31:02.498 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-03T16:31:02.554 INFO:teuthology.orchestra.run.smithi081.stdout:19.0.0-3450.g9a047fe7.el9 2024-05-03T16:31:02.554 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3450.g9a047fe7.el9 2024-05-03T16:31:02.554 INFO:teuthology.task.install:The correct ceph version 19.0.0-3450.g9a047fe7 is installed. 2024-05-03T16:31:02.556 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T16:31:02.695 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-03T16:31:02.765 INFO:teuthology.orchestra.run.smithi134.stdout:19.0.0-3450.g9a047fe7.el9 2024-05-03T16:31:02.766 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3450.g9a047fe7.el9 2024-05-03T16:31:02.766 INFO:teuthology.task.install:The correct ceph version 19.0.0-3450.g9a047fe7 is installed. 2024-05-03T16:31:02.768 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T16:31:02.902 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-03T16:31:02.973 INFO:teuthology.orchestra.run.smithi146.stdout:19.0.0-3450.g9a047fe7.el9 2024-05-03T16:31:02.973 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3450.g9a047fe7.el9 2024-05-03T16:31:02.973 INFO:teuthology.task.install:The correct ceph version 19.0.0-3450.g9a047fe7 is installed. 2024-05-03T16:31:02.975 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-03T16:31:02.976 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T16:31:02.976 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-03T16:31:03.049 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-03T16:31:03.049 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-03T16:31:03.136 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-05-03T16:31:03.136 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-03T16:31:03.227 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-03T16:31:03.227 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T16:31:03.227 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-05-03T16:31:03.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-03T16:31:03.397 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-03T16:31:03.397 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-05-03T16:31:03.474 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-03T16:31:03.589 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-05-03T16:31:03.589 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2024-05-03T16:31:03.678 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-03T16:31:03.806 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-03T16:31:03.806 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T16:31:03.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-03T16:31:03.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-03T16:31:03.986 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-03T16:31:03.986 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-03T16:31:04.065 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-03T16:31:04.180 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-05-03T16:31:04.180 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-03T16:31:04.268 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-03T16:31:04.397 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-03T16:31:04.397 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T16:31:04.397 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-05-03T16:31:04.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-03T16:31:04.582 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-03T16:31:04.582 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-05-03T16:31:04.671 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-03T16:31:04.754 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-05-03T16:31:04.755 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/stdin-killer 2024-05-03T16:31:04.842 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-03T16:31:04.927 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-03T16:31:05.037 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea', 'subvols': {'create': 2}} 2024-05-03T16:31:05.037 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T16:31:05.038 INFO:tasks.cephadm:Cluster fsid is 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:31:05.038 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-03T16:31:05.038 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.81', 'mon.b': '172.21.15.134', 'mon.c': '172.21.15.146'} 2024-05-03T16:31:05.038 INFO:tasks.cephadm:First mon is mon.a on smithi081 2024-05-03T16:31:05.039 INFO:tasks.cephadm:First mgr is x 2024-05-03T16:31:05.039 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-03T16:31:05.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname $(hostname -s) 2024-05-03T16:31:05.108 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname $(hostname -s) 2024-05-03T16:31:05.197 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname $(hostname -s) 2024-05-03T16:31:05.288 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-03T16:31:05.288 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T16:31:05.511 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79034/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3450-g9a047fe7', 'node_name': '172.21.5.34+adami04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3450.g9a047fe7'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-02 00:36:37.664792', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240501.193033', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-05-03T16:31:05.730 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-rishabh-testing-20240501.193033, sha1 9a047fe7599a549042d06a3fb5b6813a203eabea from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T16:31:05.732 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/x86_64/flavors/default/cephadm 2024-05-03T16:31:05.732 DEBUG:teuthology.orchestra.run.smithi081:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-03T16:31:06.345 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r--. 1 ubuntu ubuntu 782467 May 3 16:31 /home/ubuntu/cephtest/cephadm 2024-05-03T16:31:06.345 DEBUG:teuthology.orchestra.run.smithi134:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-03T16:31:06.824 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r--. 1 ubuntu ubuntu 782467 May 3 16:31 /home/ubuntu/cephtest/cephadm 2024-05-03T16:31:06.824 DEBUG:teuthology.orchestra.run.smithi146:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-03T16:31:07.335 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r--. 1 ubuntu ubuntu 782467 May 3 16:31 /home/ubuntu/cephtest/cephadm 2024-05-03T16:31:07.335 DEBUG:teuthology.orchestra.run.smithi081:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-03T16:31:07.381 DEBUG:teuthology.orchestra.run.smithi134:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-03T16:31:07.442 DEBUG:teuthology.orchestra.run.smithi146:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-03T16:31:07.520 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea on all hosts... 2024-05-03T16:31:07.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea pull 2024-05-03T16:31:07.525 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea pull 2024-05-03T16:31:07.530 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea pull 2024-05-03T16:31:09.568 INFO:teuthology.orchestra.run.smithi134.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea... 2024-05-03T16:31:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea... 2024-05-03T16:31:09.888 INFO:teuthology.orchestra.run.smithi081.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea... 2024-05-03T16:31:47.825 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-05-03T16:31:47.825 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_version": "ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev)", 2024-05-03T16:31:47.825 INFO:teuthology.orchestra.run.smithi134.stdout: "image_id": "ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012", 2024-05-03T16:31:47.825 INFO:teuthology.orchestra.run.smithi134.stdout: "repo_digests": [ 2024-05-03T16:31:47.825 INFO:teuthology.orchestra.run.smithi134.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd" 2024-05-03T16:31:47.825 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-05-03T16:31:47.825 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-05-03T16:32:27.052 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-03T16:32:27.052 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev)", 2024-05-03T16:32:27.053 INFO:teuthology.orchestra.run.smithi081.stdout: "image_id": "ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012", 2024-05-03T16:32:27.053 INFO:teuthology.orchestra.run.smithi081.stdout: "repo_digests": [ 2024-05-03T16:32:27.053 INFO:teuthology.orchestra.run.smithi081.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd" 2024-05-03T16:32:27.053 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-03T16:32:27.053 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-03T16:32:36.105 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-05-03T16:32:36.105 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev)", 2024-05-03T16:32:36.106 INFO:teuthology.orchestra.run.smithi146.stdout: "image_id": "ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012", 2024-05-03T16:32:36.106 INFO:teuthology.orchestra.run.smithi146.stdout: "repo_digests": [ 2024-05-03T16:32:36.106 INFO:teuthology.orchestra.run.smithi146.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd" 2024-05-03T16:32:36.106 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-05-03T16:32:36.106 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-05-03T16:32:36.173 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph 2024-05-03T16:32:36.267 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph 2024-05-03T16:32:36.361 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph 2024-05-03T16:32:36.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /etc/ceph 2024-05-03T16:32:36.541 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /etc/ceph 2024-05-03T16:32:36.631 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /etc/ceph 2024-05-03T16:32:36.719 INFO:tasks.cephadm:Writing seed config... 2024-05-03T16:32:36.721 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-03T16:32:36.721 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-03T16:32:36.721 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-03T16:32:36.721 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-03T16:32:36.721 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-03T16:32:36.721 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-03T16:32:36.721 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-03T16:32:36.721 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-03T16:32:36.721 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-03T16:32:36.721 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-03T16:32:36.722 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-03T16:32:36.722 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-03T16:32:36.722 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-03T16:32:36.722 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-03T16:32:36.722 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-03T16:32:36.722 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-03T16:32:36.722 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-05-03T16:32:36.722 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-05-03T16:32:36.722 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-03T16:32:36.722 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-03T16:32:36.722 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-03T16:32:36.722 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-03T16:32:36.722 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-03T16:32:36.723 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-03T16:32:36.723 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-03T16:32:36.723 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-03T16:32:36.723 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-03T16:32:36.723 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-03T16:32:36.723 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-03T16:32:36.723 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-03T16:32:36.723 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-03T16:32:36.723 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-03T16:32:36.723 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-05-03T16:32:36.723 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-05-03T16:32:36.723 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-03T16:32:36.723 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-03T16:32:36.723 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-05-03T16:32:36.723 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-03T16:32:36.724 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-03T16:32:36.724 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-03T16:32:36.724 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-03T16:32:36.724 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-03T16:32:36.724 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-03T16:32:36.724 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-03T16:32:36.724 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-05-03T16:32:36.725 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T16:32:36.725 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-03T16:32:36.780 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 8988869e-096a-11ef-bc97-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-03T16:32:36.781 DEBUG:teuthology.orchestra.run.smithi081:mon.a> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mon.a.service 2024-05-03T16:32:36.827 DEBUG:teuthology.orchestra.run.smithi081:mgr.x> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mgr.x.service 2024-05-03T16:32:36.872 INFO:tasks.cephadm:Bootstrapping... 2024-05-03T16:32:36.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea -v bootstrap --fsid 8988869e-096a-11ef-bc97-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.81 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-03T16:32:37.137 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-05-03T16:32:37.137 INFO:teuthology.orchestra.run.smithi081.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea', '-v', 'bootstrap', '--fsid', '8988869e-096a-11ef-bc97-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.81', '--skip-admin-label'] 2024-05-03T16:32:37.137 INFO:teuthology.orchestra.run.smithi081.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-03T16:32:37.137 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying podman|docker is present... 2024-05-03T16:32:37.196 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-03T16:32:37.197 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying lvm2 is present... 2024-05-03T16:32:37.197 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying time synchronization is in place... 2024-05-03T16:32:37.212 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-03T16:32:37.212 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-03T16:32:37.227 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-03T16:32:37.227 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-05-03T16:32:37.245 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout enabled 2024-05-03T16:32:37.264 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout active 2024-05-03T16:32:37.264 INFO:teuthology.orchestra.run.smithi081.stdout:Unit chronyd.service is enabled and running 2024-05-03T16:32:37.264 INFO:teuthology.orchestra.run.smithi081.stdout:Repeating the final host check... 2024-05-03T16:32:37.323 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-03T16:32:37.323 INFO:teuthology.orchestra.run.smithi081.stdout:podman (/bin/podman) version 4.9.4 is present 2024-05-03T16:32:37.323 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl is present 2024-05-03T16:32:37.323 INFO:teuthology.orchestra.run.smithi081.stdout:lvcreate is present 2024-05-03T16:32:37.337 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-03T16:32:37.337 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-03T16:32:37.355 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-03T16:32:37.355 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-05-03T16:32:37.378 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout enabled 2024-05-03T16:32:37.399 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout active 2024-05-03T16:32:37.399 INFO:teuthology.orchestra.run.smithi081.stdout:Unit chronyd.service is enabled and running 2024-05-03T16:32:37.400 INFO:teuthology.orchestra.run.smithi081.stdout:Host looks OK 2024-05-03T16:32:37.400 INFO:teuthology.orchestra.run.smithi081.stdout:Cluster fsid: 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:32:37.400 INFO:teuthology.orchestra.run.smithi081.stdout:Acquiring lock 140610990419920 on /run/cephadm/8988869e-096a-11ef-bc97-c7b262605968.lock 2024-05-03T16:32:37.401 INFO:teuthology.orchestra.run.smithi081.stdout:Lock 140610990419920 acquired on /run/cephadm/8988869e-096a-11ef-bc97-c7b262605968.lock 2024-05-03T16:32:37.402 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying IP 172.21.15.81 port 3300 ... 2024-05-03T16:32:37.403 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying IP 172.21.15.81 port 6789 ... 2024-05-03T16:32:37.403 INFO:teuthology.orchestra.run.smithi081.stdout:Base mon IP(s) is [172.21.15.81:3300, 172.21.15.81:6789], mon addrv is [v2:172.21.15.81:3300,v1:172.21.15.81:6789] 2024-05-03T16:32:37.418 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.81 metric 100 2024-05-03T16:32:37.418 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.81 metric 100 2024-05-03T16:32:37.430 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-03T16:32:37.430 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-05-03T16:32:37.430 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1756sec hoplimit 64 pref medium 2024-05-03T16:32:37.441 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-03T16:32:37.441 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-03T16:32:37.441 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-03T16:32:37.441 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-05-03T16:32:37.442 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2024-05-03T16:32:37.442 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-03T16:32:37.444 INFO:teuthology.orchestra.run.smithi081.stdout:Mon IP `172.21.15.81` is in CIDR network `172.21.0.0/20` 2024-05-03T16:32:37.444 INFO:teuthology.orchestra.run.smithi081.stdout:Mon IP `172.21.15.81` is in CIDR network `172.21.0.0/20` 2024-05-03T16:32:37.444 INFO:teuthology.orchestra.run.smithi081.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-03T16:32:37.447 INFO:teuthology.orchestra.run.smithi081.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-03T16:32:37.449 INFO:teuthology.orchestra.run.smithi081.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea... 2024-05-03T16:32:38.115 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 2024-05-03T16:32:38.115 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea... 2024-05-03T16:32:38.115 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Getting image source signatures 2024-05-03T16:32:38.115 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying blob sha256:e2f2fd2adca92139da4b4b907fa90a6775d3eb4eddaa977c42ef37c66eea70bd 2024-05-03T16:32:38.116 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying blob sha256:8173fd91c96404ae0424bb08037c57749051dcbdfaeee9354a65e201dad7b0e2 2024-05-03T16:32:38.116 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying config sha256:ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 2024-05-03T16:32:38.116 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-03T16:32:39.359 INFO:teuthology.orchestra.run.smithi081.stdout:ceph: stdout ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev) 2024-05-03T16:32:39.359 INFO:teuthology.orchestra.run.smithi081.stdout:Ceph version: ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev) 2024-05-03T16:32:39.359 INFO:teuthology.orchestra.run.smithi081.stdout:Extracting ceph user uid/gid from container image... 2024-05-03T16:32:40.572 INFO:teuthology.orchestra.run.smithi081.stdout:stat: stdout 167 167 2024-05-03T16:32:40.572 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial keys... 2024-05-03T16:32:41.734 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQCpETVmJs3yAhAADjpvQyPVIVo3a+9AibfmmA== 2024-05-03T16:32:42.922 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQCqETVmALWqDRAAiKkQhtdh3DHMn1ronhEcDA== 2024-05-03T16:32:44.123 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQCrETVmON1kGRAA83zvHpu9jtiowYBwaxmwwg== 2024-05-03T16:32:44.125 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial monmap... 2024-05-03T16:32:45.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-03T16:32:45.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-05-03T16:32:45.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:32:45.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-03T16:32:45.347 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool for a [v2:172.21.15.81:3300,v1:172.21.15.81:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-03T16:32:45.347 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = quincy 2024-05-03T16:32:45.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: set fsid to 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:32:45.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-03T16:32:45.347 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:32:45.348 INFO:teuthology.orchestra.run.smithi081.stdout:Creating mon... 2024-05-03T16:32:46.459 INFO:teuthology.orchestra.run.smithi081.stdout:create mon.a on 2024-05-03T16:32:47.039 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-03T16:32:47.583 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-03T16:32:49.175 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-8988869e-096a-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-8988869e-096a-11ef-bc97-c7b262605968.target. 2024-05-03T16:32:49.177 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-8988869e-096a-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-8988869e-096a-11ef-bc97-c7b262605968.target. 2024-05-03T16:32:52.790 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-8988869e-096a-11ef-bc97-c7b262605968@mon.a 2024-05-03T16:32:52.790 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to reset failed state of unit ceph-8988869e-096a-11ef-bc97-c7b262605968@mon.a.service: Unit ceph-8988869e-096a-11ef-bc97-c7b262605968@mon.a.service not loaded. 2024-05-03T16:32:53.938 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-8988869e-096a-11ef-bc97-c7b262605968.target.wants/ceph-8988869e-096a-11ef-bc97-c7b262605968@mon.a.service → /etc/systemd/system/ceph-8988869e-096a-11ef-bc97-c7b262605968@.service. 2024-05-03T16:32:54.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:54 smithi081 podman[28239]: 2024-05-03 16:32:54.47358413 +0000 UTC m=+0.040880672 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T16:32:56.445 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:56 smithi081 podman[28239]: 2024-05-03 16:32:56.125587898 +0000 UTC m=+1.692884466 container create 1f436b257c577a482b9d45c8e2fa0db803af38042d8f398c67261cffcaab4a88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-a, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T16:32:56.445 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:56 smithi081 podman[28239]: 2024-05-03 16:32:56.353742102 +0000 UTC m=+1.921038677 container init 1f436b257c577a482b9d45c8e2fa0db803af38042d8f398c67261cffcaab4a88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS) 2024-05-03T16:32:56.445 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:56 smithi081 podman[28239]: 2024-05-03 16:32:56.365010206 +0000 UTC m=+1.932306780 container start 1f436b257c577a482b9d45c8e2fa0db803af38042d8f398c67261cffcaab4a88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-a, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-03T16:32:56.445 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:56 smithi081 bash[28239]: 1f436b257c577a482b9d45c8e2fa0db803af38042d8f398c67261cffcaab4a88 2024-05-03T16:32:56.480 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-03T16:32:56.480 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-05-03T16:32:56.496 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-03T16:32:56.496 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-05-03T16:32:56.497 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-05-03T16:32:56.497 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to enable service . firewalld.service is not available 2024-05-03T16:32:56.498 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mon to start... 2024-05-03T16:32:56.498 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mon... 2024-05-03T16:32:56.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:56 smithi081 ceph-mon[28258]: mkfs 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:32:56.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:56 smithi081 ceph-mon[28258]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-03T16:32:56.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:56 smithi081 systemd[1]: Started Ceph mon.a for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:32:57.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:57 smithi081 ceph-mon[28258]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-03T16:32:57.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:57 smithi081 ceph-mon[28258]: monmap epoch 1 2024-05-03T16:32:57.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:57 smithi081 ceph-mon[28258]: fsid 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:32:57.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:57 smithi081 ceph-mon[28258]: last_changed 2024-05-03T16:32:44.597150+0000 2024-05-03T16:32:57.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:57 smithi081 ceph-mon[28258]: created 2024-05-03T16:32:44.597150+0000 2024-05-03T16:32:57.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:57 smithi081 ceph-mon[28258]: min_mon_release 19 (squid) 2024-05-03T16:32:57.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:57 smithi081 ceph-mon[28258]: election_strategy: 1 2024-05-03T16:32:57.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:57 smithi081 ceph-mon[28258]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-05-03T16:32:57.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:57 smithi081 ceph-mon[28258]: fsmap 2024-05-03T16:32:57.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:57 smithi081 ceph-mon[28258]: osdmap e1: 0 total, 0 up, 0 in 2024-05-03T16:32:57.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:57 smithi081 ceph-mon[28258]: mgrmap e1: no daemons active 2024-05-03T16:32:57.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:57 smithi081 ceph-mon[28258]: from='client.? 172.21.15.81:0/3894339647' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-03T16:32:57.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout cluster: 2024-05-03T16:32:57.889 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout id: 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:32:57.889 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-03T16:32:57.889 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-03T16:32:57.889 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout services: 2024-05-03T16:32:57.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.749917s) 2024-05-03T16:32:57.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-03T16:32:57.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-03T16:32:57.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-03T16:32:57.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout data: 2024-05-03T16:32:57.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-03T16:32:57.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-03T16:32:57.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-03T16:32:57.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout pgs: 2024-05-03T16:32:57.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-03T16:32:57.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.093+0000 7f2723000700 1 Processor -- start 2024-05-03T16:32:57.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.093+0000 7f2723000700 1 -- start start 2024-05-03T16:32:57.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.093+0000 7f2723000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c107c40 0x7f271c108060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:32:57.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.094+0000 7f2723000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f271c108630 con 0x7f271c107c40 2024-05-03T16:32:57.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.095+0000 7f271be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c107c40 0x7f271c108060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:32:57.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.095+0000 7f271be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c107c40 0x7f271c108060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57190/0 (socket says 172.21.15.81:57190) 2024-05-03T16:32:57.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.095+0000 7f271be00700 1 -- 172.21.15.81:0/4160075343 learned_addr learned my addr 172.21.15.81:0/4160075343 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:32:57.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.095+0000 7f271be00700 1 -- 172.21.15.81:0/4160075343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271c108e40 con 0x7f271c107c40 2024-05-03T16:32:57.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.096+0000 7f271be00700 1 --2- 172.21.15.81:0/4160075343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c107c40 0x7f271c108060 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f270c0098a0 tx=0x7f270c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd616bcad85a9e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:32:57.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.096+0000 7f271aa00700 1 -- 172.21.15.81:0/4160075343 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f270c004160 con 0x7f271c107c40 2024-05-03T16:32:57.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.096+0000 7f271aa00700 1 -- 172.21.15.81:0/4160075343 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f270c004300 con 0x7f271c107c40 2024-05-03T16:32:57.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.096+0000 7f271aa00700 1 -- 172.21.15.81:0/4160075343 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f270c0036a0 con 0x7f271c107c40 2024-05-03T16:32:57.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.097+0000 7f2723000700 1 -- 172.21.15.81:0/4160075343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c107c40 msgr2=0x7f271c108060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:32:57.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.097+0000 7f2723000700 1 --2- 172.21.15.81:0/4160075343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c107c40 0x7f271c108060 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f270c0098a0 tx=0x7f270c009bb0 comp rx=0 tx=0).stop 2024-05-03T16:32:57.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.097+0000 7f2723000700 1 -- 172.21.15.81:0/4160075343 shutdown_connections 2024-05-03T16:32:57.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.097+0000 7f2723000700 1 --2- 172.21.15.81:0/4160075343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c107c40 0x7f271c108060 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:32:57.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.097+0000 7f2723000700 1 -- 172.21.15.81:0/4160075343 >> 172.21.15.81:0/4160075343 conn(0x7f271c103200 msgr2=0x7f271c105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:32:57.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.097+0000 7f2723000700 1 -- 172.21.15.81:0/4160075343 shutdown_connections 2024-05-03T16:32:57.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.097+0000 7f2723000700 1 -- 172.21.15.81:0/4160075343 wait complete. 2024-05-03T16:32:57.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.098+0000 7f2723000700 1 Processor -- start 2024-05-03T16:32:57.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.098+0000 7f2723000700 1 -- start start 2024-05-03T16:32:57.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.098+0000 7f2723000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c107c40 0x7f271c19e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:32:57.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.098+0000 7f2723000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f271c109370 con 0x7f271c107c40 2024-05-03T16:32:57.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.099+0000 7f271be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c107c40 0x7f271c19e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:32:57.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.099+0000 7f271be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c107c40 0x7f271c19e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57192/0 (socket says 172.21.15.81:57192) 2024-05-03T16:32:57.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.099+0000 7f271be00700 1 -- 172.21.15.81:0/3894339647 learned_addr learned my addr 172.21.15.81:0/3894339647 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:32:57.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.099+0000 7f271be00700 1 -- 172.21.15.81:0/3894339647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271c19eb50 con 0x7f271c107c40 2024-05-03T16:32:57.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.100+0000 7f271be00700 1 --2- 172.21.15.81:0/3894339647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c107c40 0x7f271c19e610 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f270c000c00 tx=0x7f270c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:32:57.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.100+0000 7f2718c00700 1 -- 172.21.15.81:0/3894339647 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f270c003db0 con 0x7f271c107c40 2024-05-03T16:32:57.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.100+0000 7f2718c00700 1 -- 172.21.15.81:0/3894339647 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f270c011630 con 0x7f271c107c40 2024-05-03T16:32:57.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.100+0000 7f2723000700 1 -- 172.21.15.81:0/3894339647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f271c19ede0 con 0x7f271c107c40 2024-05-03T16:32:57.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.100+0000 7f2718c00700 1 -- 172.21.15.81:0/3894339647 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f270c011950 con 0x7f271c107c40 2024-05-03T16:32:57.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.100+0000 7f2723000700 1 -- 172.21.15.81:0/3894339647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f271c1a1ad0 con 0x7f271c107c40 2024-05-03T16:32:57.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.101+0000 7f2718c00700 1 -- 172.21.15.81:0/3894339647 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f270c01a460 con 0x7f271c107c40 2024-05-03T16:32:57.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.101+0000 7f2718c00700 1 -- 172.21.15.81:0/3894339647 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f270c01b780 con 0x7f271c107c40 2024-05-03T16:32:57.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.101+0000 7f2723000700 1 -- 172.21.15.81:0/3894339647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f271c064b00 con 0x7f271c107c40 2024-05-03T16:32:57.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.106+0000 7f2718c00700 1 -- 172.21.15.81:0/3894339647 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f270c031020 con 0x7f271c107c40 2024-05-03T16:32:57.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.186+0000 7f2723000700 1 -- 172.21.15.81:0/3894339647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f271c02e810 con 0x7f271c107c40 2024-05-03T16:32:57.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.187+0000 7f2718c00700 1 -- 172.21.15.81:0/3894339647 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f270c01ba20 con 0x7f271c107c40 2024-05-03T16:32:57.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.188+0000 7f2723000700 1 -- 172.21.15.81:0/3894339647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c107c40 msgr2=0x7f271c19e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:32:57.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.188+0000 7f2723000700 1 --2- 172.21.15.81:0/3894339647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c107c40 0x7f271c19e610 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f270c000c00 tx=0x7f270c004750 comp rx=0 tx=0).stop 2024-05-03T16:32:57.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.188+0000 7f2723000700 1 -- 172.21.15.81:0/3894339647 shutdown_connections 2024-05-03T16:32:57.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.188+0000 7f2723000700 1 --2- 172.21.15.81:0/3894339647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c107c40 0x7f271c19e610 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:32:57.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.188+0000 7f2723000700 1 -- 172.21.15.81:0/3894339647 >> 172.21.15.81:0/3894339647 conn(0x7f271c103200 msgr2=0x7f271c195390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:32:57.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.189+0000 7f2723000700 1 -- 172.21.15.81:0/3894339647 shutdown_connections 2024-05-03T16:32:57.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:57.189+0000 7f2723000700 1 -- 172.21.15.81:0/3894339647 wait complete. 2024-05-03T16:32:57.893 INFO:teuthology.orchestra.run.smithi081.stdout:mon is available 2024-05-03T16:32:57.893 INFO:teuthology.orchestra.run.smithi081.stdout:Assimilating anything we can from ceph.conf... 2024-05-03T16:32:58.981 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:58 smithi081 ceph-mon[28258]: from='client.? 172.21.15.81:0/1377205973' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-03T16:32:58.981 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:32:58 smithi081 ceph-mon[28258]: from='client.? 172.21.15.81:0/1377205973' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-03T16:32:59.716 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-03T16:32:59.717 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [global] 2024-05-03T16:32:59.717 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout fsid = 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:32:59.717 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-03T16:32:59.717 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.81:3300,v1:172.21.15.81:6789] 2024-05-03T16:32:59.717 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-03T16:32:59.717 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-03T16:32:59.717 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-03T16:32:59.717 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-03T16:32:59.717 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-03T16:32:59.717 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-03T16:32:59.717 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-03T16:32:59.717 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-03T16:32:59.718 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [osd] 2024-05-03T16:32:59.718 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-03T16:32:59.718 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-03T16:32:59.718 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-03T16:32:59.718 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-03T16:32:59.718 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-03T16:32:59.718 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.532+0000 7fedf5400700 1 Processor -- start 2024-05-03T16:32:59.718 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.532+0000 7fedf5400700 1 -- start start 2024-05-03T16:32:59.718 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.533+0000 7fedf5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedf0108d10 0x7fedf0109130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:32:59.718 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.533+0000 7fedf5400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fedf0109700 con 0x7fedf0108d10 2024-05-03T16:32:59.718 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.534+0000 7fedee800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedf0108d10 0x7fedf0109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:32:59.718 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.534+0000 7fedee800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedf0108d10 0x7fedf0109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57194/0 (socket says 172.21.15.81:57194) 2024-05-03T16:32:59.719 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.534+0000 7fedee800700 1 -- 172.21.15.81:0/3785822513 learned_addr learned my addr 172.21.15.81:0/3785822513 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:32:59.719 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.534+0000 7fedee800700 1 -- 172.21.15.81:0/3785822513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf0109f10 con 0x7fedf0108d10 2024-05-03T16:32:59.719 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.534+0000 7fedee800700 1 --2- 172.21.15.81:0/3785822513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedf0108d10 0x7fedf0109130 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fede00098a0 tx=0x7fede0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcfd9957a6c9ce9c server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:32:59.719 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.535+0000 7feded400700 1 -- 172.21.15.81:0/3785822513 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fede0004160 con 0x7fedf0108d10 2024-05-03T16:32:59.719 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.535+0000 7feded400700 1 -- 172.21.15.81:0/3785822513 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede0004300 con 0x7fedf0108d10 2024-05-03T16:32:59.719 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.535+0000 7feded400700 1 -- 172.21.15.81:0/3785822513 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fede00036a0 con 0x7fedf0108d10 2024-05-03T16:32:59.719 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.535+0000 7fedf5400700 1 -- 172.21.15.81:0/3785822513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedf0108d10 msgr2=0x7fedf0109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:32:59.719 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.535+0000 7fedf5400700 1 --2- 172.21.15.81:0/3785822513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedf0108d10 0x7fedf0109130 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fede00098a0 tx=0x7fede0009bb0 comp rx=0 tx=0).stop 2024-05-03T16:32:59.719 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.535+0000 7fedf5400700 1 -- 172.21.15.81:0/3785822513 shutdown_connections 2024-05-03T16:32:59.719 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.536+0000 7fedf5400700 1 --2- 172.21.15.81:0/3785822513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedf0108d10 0x7fedf0109130 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:32:59.719 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.536+0000 7fedf5400700 1 -- 172.21.15.81:0/3785822513 >> 172.21.15.81:0/3785822513 conn(0x7fedf01042d0 msgr2=0x7fedf01066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:32:59.719 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.536+0000 7fedf5400700 1 -- 172.21.15.81:0/3785822513 shutdown_connections 2024-05-03T16:32:59.719 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.536+0000 7fedf5400700 1 -- 172.21.15.81:0/3785822513 wait complete. 2024-05-03T16:32:59.719 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.537+0000 7fedf5400700 1 Processor -- start 2024-05-03T16:32:59.719 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.537+0000 7fedf5400700 1 -- start start 2024-05-03T16:32:59.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.537+0000 7fedf5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedf0108d10 0x7fedf019c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:32:59.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.537+0000 7fedf5400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fedf010a440 con 0x7fedf0108d10 2024-05-03T16:32:59.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.538+0000 7fedee800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedf0108d10 0x7fedf019c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:32:59.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.538+0000 7fedee800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedf0108d10 0x7fedf019c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57208/0 (socket says 172.21.15.81:57208) 2024-05-03T16:32:59.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.538+0000 7fedee800700 1 -- 172.21.15.81:0/1377205973 learned_addr learned my addr 172.21.15.81:0/1377205973 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:32:59.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.538+0000 7fedee800700 1 -- 172.21.15.81:0/1377205973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf019c910 con 0x7fedf0108d10 2024-05-03T16:32:59.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.538+0000 7fedee800700 1 --2- 172.21.15.81:0/1377205973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedf0108d10 0x7fedf019c3d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fede0000c00 tx=0x7fede0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:32:59.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.539+0000 7fede7400700 1 -- 172.21.15.81:0/1377205973 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fede0003db0 con 0x7fedf0108d10 2024-05-03T16:32:59.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.539+0000 7fede7400700 1 -- 172.21.15.81:0/1377205973 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede0011630 con 0x7fedf0108d10 2024-05-03T16:32:59.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.539+0000 7fede7400700 1 -- 172.21.15.81:0/1377205973 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fede0011950 con 0x7fedf0108d10 2024-05-03T16:32:59.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.539+0000 7fedf5400700 1 -- 172.21.15.81:0/1377205973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf019cba0 con 0x7fedf0108d10 2024-05-03T16:32:59.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.539+0000 7fedf5400700 1 -- 172.21.15.81:0/1377205973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf019f890 con 0x7fedf0108d10 2024-05-03T16:32:59.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.539+0000 7fede7400700 1 -- 172.21.15.81:0/1377205973 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fede001a460 con 0x7fedf0108d10 2024-05-03T16:32:59.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.539+0000 7fede7400700 1 -- 172.21.15.81:0/1377205973 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fede001b780 con 0x7fedf0108d10 2024-05-03T16:32:59.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.540+0000 7fedf5400700 1 -- 172.21.15.81:0/1377205973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf0064b00 con 0x7fedf0108d10 2024-05-03T16:32:59.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.543+0000 7fede7400700 1 -- 172.21.15.81:0/1377205973 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fede0031020 con 0x7fedf0108d10 2024-05-03T16:32:59.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.620+0000 7fedf5400700 1 -- 172.21.15.81:0/1377205973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fedf019d080 con 0x7fedf0108d10 2024-05-03T16:32:59.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.627+0000 7fede7400700 1 -- 172.21.15.81:0/1377205973 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7fedf019d080 con 0x7fedf0108d10 2024-05-03T16:32:59.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.628+0000 7fede7400700 1 -- 172.21.15.81:0/1377205973 <== mon.0 v2:172.21.15.81:3300/0 8 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fede001be40 con 0x7fedf0108d10 2024-05-03T16:32:59.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.629+0000 7fedf5400700 1 -- 172.21.15.81:0/1377205973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedf0108d10 msgr2=0x7fedf019c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:32:59.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.629+0000 7fedf5400700 1 --2- 172.21.15.81:0/1377205973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedf0108d10 0x7fedf019c3d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fede0000c00 tx=0x7fede0004750 comp rx=0 tx=0).stop 2024-05-03T16:32:59.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.629+0000 7fedf5400700 1 -- 172.21.15.81:0/1377205973 shutdown_connections 2024-05-03T16:32:59.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.629+0000 7fedf5400700 1 --2- 172.21.15.81:0/1377205973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedf0108d10 0x7fedf019c3d0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:32:59.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.629+0000 7fedf5400700 1 -- 172.21.15.81:0/1377205973 >> 172.21.15.81:0/1377205973 conn(0x7fedf01042d0 msgr2=0x7fedf0192fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:32:59.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.630+0000 7fedf5400700 1 -- 172.21.15.81:0/1377205973 shutdown_connections 2024-05-03T16:32:59.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:32:58.630+0000 7fedf5400700 1 -- 172.21.15.81:0/1377205973 wait complete. 2024-05-03T16:32:59.721 INFO:teuthology.orchestra.run.smithi081.stdout:Generating new minimal ceph.conf... 2024-05-03T16:33:00.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:00 smithi081 ceph-mon[28258]: from='client.? 172.21.15.81:0/53521424' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:33:01.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.315+0000 7f7106000700 1 Processor -- start 2024-05-03T16:33:01.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.315+0000 7f7106000700 1 -- start start 2024-05-03T16:33:01.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.316+0000 7f7106000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100108d10 0x7f7100109130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:01.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.316+0000 7f7106000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7100109700 con 0x7f7100108d10 2024-05-03T16:33:01.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.317+0000 7f70ff400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100108d10 0x7f7100109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:01.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.317+0000 7f70ff400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100108d10 0x7f7100109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57210/0 (socket says 172.21.15.81:57210) 2024-05-03T16:33:01.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.317+0000 7f70ff400700 1 -- 172.21.15.81:0/2999613671 learned_addr learned my addr 172.21.15.81:0/2999613671 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:01.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.317+0000 7f70ff400700 1 -- 172.21.15.81:0/2999613671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7100109f10 con 0x7f7100108d10 2024-05-03T16:33:01.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.318+0000 7f70ff400700 1 --2- 172.21.15.81:0/2999613671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100108d10 0x7f7100109130 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009e80 tx=0x7f70f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d8f39ca9607ef8 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:01.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.318+0000 7f70fea00700 1 -- 172.21.15.81:0/2999613671 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70f0017070 con 0x7f7100108d10 2024-05-03T16:33:01.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.318+0000 7f70fea00700 1 -- 172.21.15.81:0/2999613671 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f70f000b8c0 con 0x7f7100108d10 2024-05-03T16:33:01.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.318+0000 7f70fea00700 1 -- 172.21.15.81:0/2999613671 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70f0004420 con 0x7f7100108d10 2024-05-03T16:33:01.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.319+0000 7f7106000700 1 -- 172.21.15.81:0/2999613671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100108d10 msgr2=0x7f7100109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:01.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.319+0000 7f7106000700 1 --2- 172.21.15.81:0/2999613671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100108d10 0x7f7100109130 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009e80 tx=0x7f70f000b330 comp rx=0 tx=0).stop 2024-05-03T16:33:01.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.319+0000 7f7106000700 1 -- 172.21.15.81:0/2999613671 shutdown_connections 2024-05-03T16:33:01.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.319+0000 7f7106000700 1 --2- 172.21.15.81:0/2999613671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100108d10 0x7f7100109130 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:01.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.319+0000 7f7106000700 1 -- 172.21.15.81:0/2999613671 >> 172.21.15.81:0/2999613671 conn(0x7f71001042d0 msgr2=0x7f71001066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:01.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.319+0000 7f7106000700 1 -- 172.21.15.81:0/2999613671 shutdown_connections 2024-05-03T16:33:01.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.319+0000 7f7106000700 1 -- 172.21.15.81:0/2999613671 wait complete. 2024-05-03T16:33:01.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.320+0000 7f7106000700 1 Processor -- start 2024-05-03T16:33:01.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.320+0000 7f7106000700 1 -- start start 2024-05-03T16:33:01.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.320+0000 7f7106000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100108d10 0x7f710007eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:01.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.320+0000 7f7106000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f710010d140 con 0x7f7100108d10 2024-05-03T16:33:01.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.321+0000 7f70ff400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100108d10 0x7f710007eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:01.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.321+0000 7f70ff400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100108d10 0x7f710007eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57214/0 (socket says 172.21.15.81:57214) 2024-05-03T16:33:01.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.321+0000 7f70ff400700 1 -- 172.21.15.81:0/53521424 learned_addr learned my addr 172.21.15.81:0/53521424 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:01.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.321+0000 7f70ff400700 1 -- 172.21.15.81:0/53521424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710007f0c0 con 0x7f7100108d10 2024-05-03T16:33:01.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.321+0000 7f70ff400700 1 --2- 172.21.15.81:0/53521424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100108d10 0x7f710007eb80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f70f00093b0 tx=0x7f70f00093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:01.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.321+0000 7f70fcc00700 1 -- 172.21.15.81:0/53521424 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70f0020020 con 0x7f7100108d10 2024-05-03T16:33:01.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.322+0000 7f70fcc00700 1 -- 172.21.15.81:0/53521424 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f70f0003db0 con 0x7f7100108d10 2024-05-03T16:33:01.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.322+0000 7f7106000700 1 -- 172.21.15.81:0/53521424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710007d2b0 con 0x7f7100108d10 2024-05-03T16:33:01.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.322+0000 7f70fcc00700 1 -- 172.21.15.81:0/53521424 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70f0017040 con 0x7f7100108d10 2024-05-03T16:33:01.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.322+0000 7f7106000700 1 -- 172.21.15.81:0/53521424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f710007d7f0 con 0x7f7100108d10 2024-05-03T16:33:01.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.322+0000 7f70fcc00700 1 -- 172.21.15.81:0/53521424 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f70f0023020 con 0x7f7100108d10 2024-05-03T16:33:01.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.322+0000 7f70fcc00700 1 -- 172.21.15.81:0/53521424 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f70f000f050 con 0x7f7100108d10 2024-05-03T16:33:01.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.323+0000 7f7106000700 1 -- 172.21.15.81:0/53521424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f710010d2c0 con 0x7f7100108d10 2024-05-03T16:33:01.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.326+0000 7f70fcc00700 1 -- 172.21.15.81:0/53521424 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f70f002a020 con 0x7f7100108d10 2024-05-03T16:33:01.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.401+0000 7f7106000700 1 -- 172.21.15.81:0/53521424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f710007d9c0 con 0x7f7100108d10 2024-05-03T16:33:01.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.402+0000 7f70fcc00700 1 -- 172.21.15.81:0/53521424 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f70f000b860 con 0x7f7100108d10 2024-05-03T16:33:01.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.403+0000 7f7106000700 1 -- 172.21.15.81:0/53521424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100108d10 msgr2=0x7f710007eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:01.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.403+0000 7f7106000700 1 --2- 172.21.15.81:0/53521424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100108d10 0x7f710007eb80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f70f00093b0 tx=0x7f70f00093e0 comp rx=0 tx=0).stop 2024-05-03T16:33:01.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.403+0000 7f7106000700 1 -- 172.21.15.81:0/53521424 shutdown_connections 2024-05-03T16:33:01.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.403+0000 7f7106000700 1 --2- 172.21.15.81:0/53521424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100108d10 0x7f710007eb80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:01.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.403+0000 7f7106000700 1 -- 172.21.15.81:0/53521424 >> 172.21.15.81:0/53521424 conn(0x7f71001042d0 msgr2=0x7f7100104cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:01.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.404+0000 7f7106000700 1 -- 172.21.15.81:0/53521424 shutdown_connections 2024-05-03T16:33:01.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:00.404+0000 7f7106000700 1 -- 172.21.15.81:0/53521424 wait complete. 2024-05-03T16:33:01.049 INFO:teuthology.orchestra.run.smithi081.stdout:Restarting the monitor... 2024-05-03T16:33:01.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:01 smithi081 systemd[1]: Stopping Ceph mon.a for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T16:33:01.850 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:01 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-a[28254]: 2024-05-03T16:33:01.589+0000 7f19b2800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T16:33:01.850 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:01 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-a[28254]: 2024-05-03T16:33:01.590+0000 7f19b2800700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-03T16:33:02.132 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:01 smithi081 podman[28513]: 2024-05-03 16:33:01.848420912 +0000 UTC m=+0.428039347 container died 1f436b257c577a482b9d45c8e2fa0db803af38042d8f398c67261cffcaab4a88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-a, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T16:33:02.435 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:02 smithi081 podman[28513]: 2024-05-03 16:33:02.22441751 +0000 UTC m=+0.804035965 container cleanup 1f436b257c577a482b9d45c8e2fa0db803af38042d8f398c67261cffcaab4a88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-a, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T16:33:02.435 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:02 smithi081 bash[28513]: ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-a 2024-05-03T16:33:02.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:02 smithi081 podman[28527]: 2024-05-03 16:33:02.433619595 +0000 UTC m=+0.565826407 container remove 1f436b257c577a482b9d45c8e2fa0db803af38042d8f398c67261cffcaab4a88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240430) 2024-05-03T16:33:03.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:02 smithi081 systemd[1]: ceph-8988869e-096a-11ef-bc97-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-03T16:33:03.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:02 smithi081 systemd[1]: Stopped Ceph mon.a for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:33:03.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:02 smithi081 systemd[1]: ceph-8988869e-096a-11ef-bc97-c7b262605968@mon.a.service: Consumed 1.932s CPU time. 2024-05-03T16:33:03.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:02 smithi081 systemd[1]: Starting Ceph mon.a for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T16:33:03.564 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 podman[28621]: 2024-05-03 16:33:03.196253178 +0000 UTC m=+0.033332747 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T16:33:03.564 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 podman[28621]: 2024-05-03 16:33:03.326256548 +0000 UTC m=+0.163336128 container create ac30952d6fd320ec145a822ab7d1e17f7c4155ce056f31bf8fd28b5deefd197e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-05-03T16:33:03.716 INFO:teuthology.orchestra.run.smithi081.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-03T16:33:03.885 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 podman[28621]: 2024-05-03 16:33:03.563135948 +0000 UTC m=+0.400215577 container init ac30952d6fd320ec145a822ab7d1e17f7c4155ce056f31bf8fd28b5deefd197e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-03T16:33:03.885 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 podman[28621]: 2024-05-03 16:33:03.573074264 +0000 UTC m=+0.410153843 container start ac30952d6fd320ec145a822ab7d1e17f7c4155ce056f31bf8fd28b5deefd197e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-a, org.label-schema.build-date=20240430, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-03T16:33:03.885 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: set uid:gid to 167:167 (ceph:ceph) 2024-05-03T16:33:03.885 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev), process ceph-mon, pid 2 2024-05-03T16:33:03.886 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: pidfile_write: ignore empty --pid-file 2024-05-03T16:33:03.886 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: load: jerasure load: lrc 2024-05-03T16:33:03.886 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: RocksDB version: 7.9.2 2024-05-03T16:33:03.886 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Git sha 0 2024-05-03T16:33:03.886 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Compile date 2024-05-01 21:12:03 2024-05-03T16:33:03.886 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: DB SUMMARY 2024-05-03T16:33:03.886 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: DB Session ID: A44NDHCK3PJXM0BRI46X 2024-05-03T16:33:03.886 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: CURRENT file: CURRENT 2024-05-03T16:33:03.886 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: IDENTITY file: IDENTITY 2024-05-03T16:33:03.886 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-03T16:33:03.886 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-03T16:33:03.886 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104126 ; 2024-05-03T16:33:03.886 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.error_if_exists: 0 2024-05-03T16:33:03.886 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.create_if_missing: 0 2024-05-03T16:33:03.886 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.paranoid_checks: 1 2024-05-03T16:33:03.887 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-03T16:33:03.887 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-03T16:33:03.887 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-03T16:33:03.887 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.env: 0x561250f95cc0 2024-05-03T16:33:03.887 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.fs: PosixFileSystem 2024-05-03T16:33:03.887 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.info_log: 0x56127402bde0 2024-05-03T16:33:03.887 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_file_opening_threads: 16 2024-05-03T16:33:03.887 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.statistics: (nil) 2024-05-03T16:33:03.887 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.use_fsync: 0 2024-05-03T16:33:03.887 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_log_file_size: 0 2024-05-03T16:33:03.887 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-03T16:33:03.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-03T16:33:03.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.keep_log_file_num: 1000 2024-05-03T16:33:03.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.recycle_log_file_num: 0 2024-05-03T16:33:03.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.allow_fallocate: 1 2024-05-03T16:33:03.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.allow_mmap_reads: 0 2024-05-03T16:33:03.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.allow_mmap_writes: 0 2024-05-03T16:33:03.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.use_direct_reads: 0 2024-05-03T16:33:03.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-03T16:33:03.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.create_missing_column_families: 0 2024-05-03T16:33:03.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.db_log_dir: 2024-05-03T16:33:03.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.wal_dir: 2024-05-03T16:33:03.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-03T16:33:03.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-03T16:33:03.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-03T16:33:03.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-03T16:33:03.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-03T16:33:03.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-03T16:33:03.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.advise_random_on_open: 1 2024-05-03T16:33:03.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.db_write_buffer_size: 0 2024-05-03T16:33:03.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.write_buffer_manager: 0x561273ffd0e0 2024-05-03T16:33:03.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-03T16:33:03.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-03T16:33:03.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-03T16:33:03.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.rate_limiter: (nil) 2024-05-03T16:33:03.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-03T16:33:03.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.wal_recovery_mode: 2 2024-05-03T16:33:03.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.enable_thread_tracking: 0 2024-05-03T16:33:03.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.enable_pipelined_write: 0 2024-05-03T16:33:03.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.unordered_write: 0 2024-05-03T16:33:03.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-03T16:33:03.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-03T16:33:03.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-03T16:33:03.890 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-03T16:33:03.890 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.row_cache: None 2024-05-03T16:33:03.890 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.wal_filter: None 2024-05-03T16:33:03.890 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-03T16:33:03.890 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.allow_ingest_behind: 0 2024-05-03T16:33:03.890 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.two_write_queues: 0 2024-05-03T16:33:03.890 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.manual_wal_flush: 0 2024-05-03T16:33:03.890 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.wal_compression: 0 2024-05-03T16:33:03.890 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.atomic_flush: 0 2024-05-03T16:33:03.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-03T16:33:03.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-03T16:33:03.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-03T16:33:03.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.log_readahead_size: 0 2024-05-03T16:33:03.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-03T16:33:03.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.best_efforts_recovery: 0 2024-05-03T16:33:03.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-03T16:33:03.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-03T16:33:03.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.allow_data_in_errors: 0 2024-05-03T16:33:03.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.db_host_id: __hostname__ 2024-05-03T16:33:03.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-03T16:33:03.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_background_jobs: 2 2024-05-03T16:33:03.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_background_compactions: -1 2024-05-03T16:33:03.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_subcompactions: 1 2024-05-03T16:33:03.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-03T16:33:03.892 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-03T16:33:03.892 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-03T16:33:03.892 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_total_wal_size: 0 2024-05-03T16:33:03.892 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-03T16:33:03.892 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-03T16:33:03.892 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-03T16:33:03.892 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-03T16:33:03.892 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_open_files: -1 2024-05-03T16:33:03.892 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.bytes_per_sync: 0 2024-05-03T16:33:03.892 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-03T16:33:03.892 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-03T16:33:03.892 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compaction_readahead_size: 0 2024-05-03T16:33:03.892 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_background_flushes: -1 2024-05-03T16:33:03.892 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Compression algorithms supported: 2024-05-03T16:33:03.892 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-03T16:33:03.892 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: kZSTD supported: 0 2024-05-03T16:33:03.893 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: kXpressCompression supported: 0 2024-05-03T16:33:03.893 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: kLZ4HCCompression supported: 1 2024-05-03T16:33:03.893 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: kZlibCompression supported: 1 2024-05-03T16:33:03.893 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: kSnappyCompression supported: 1 2024-05-03T16:33:03.893 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: kLZ4Compression supported: 1 2024-05-03T16:33:03.893 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: kBZip2Compression supported: 0 2024-05-03T16:33:03.893 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-03T16:33:03.893 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-03T16:33:03.893 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-03T16:33:03.893 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-03T16:33:03.893 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-03T16:33:03.893 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.merge_operator: 2024-05-03T16:33:03.893 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compaction_filter: None 2024-05-03T16:33:03.893 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compaction_filter_factory: None 2024-05-03T16:33:03.893 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.sst_partitioner_factory: None 2024-05-03T16:33:03.893 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-03T16:33:03.894 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-03T16:33:03.894 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56127402bfa0) 2024-05-03T16:33:03.894 INFO:journalctl@ceph.mon.a.smithi081.stdout: cache_index_and_filter_blocks: 1 2024-05-03T16:33:03.894 INFO:journalctl@ceph.mon.a.smithi081.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-03T16:33:03.894 INFO:journalctl@ceph.mon.a.smithi081.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-03T16:33:03.894 INFO:journalctl@ceph.mon.a.smithi081.stdout: pin_top_level_index_and_filter: 1 2024-05-03T16:33:03.894 INFO:journalctl@ceph.mon.a.smithi081.stdout: index_type: 0 2024-05-03T16:33:03.894 INFO:journalctl@ceph.mon.a.smithi081.stdout: data_block_index_type: 0 2024-05-03T16:33:03.894 INFO:journalctl@ceph.mon.a.smithi081.stdout: index_shortening: 1 2024-05-03T16:33:03.894 INFO:journalctl@ceph.mon.a.smithi081.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-03T16:33:03.894 INFO:journalctl@ceph.mon.a.smithi081.stdout: checksum: 4 2024-05-03T16:33:03.894 INFO:journalctl@ceph.mon.a.smithi081.stdout: no_block_cache: 0 2024-05-03T16:33:03.894 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache: 0x56127402f1f0 2024-05-03T16:33:03.894 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache_name: BinnedLRUCache 2024-05-03T16:33:03.894 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache_options: 2024-05-03T16:33:03.894 INFO:journalctl@ceph.mon.a.smithi081.stdout: capacity : 536870912 2024-05-03T16:33:03.895 INFO:journalctl@ceph.mon.a.smithi081.stdout: num_shard_bits : 4 2024-05-03T16:33:03.895 INFO:journalctl@ceph.mon.a.smithi081.stdout: strict_capacity_limit : 0 2024-05-03T16:33:03.895 INFO:journalctl@ceph.mon.a.smithi081.stdout: high_pri_pool_ratio: 0.000 2024-05-03T16:33:03.895 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache_compressed: (nil) 2024-05-03T16:33:03.895 INFO:journalctl@ceph.mon.a.smithi081.stdout: persistent_cache: (nil) 2024-05-03T16:33:03.895 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_size: 4096 2024-05-03T16:33:03.895 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_size_deviation: 10 2024-05-03T16:33:03.895 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_restart_interval: 16 2024-05-03T16:33:03.895 INFO:journalctl@ceph.mon.a.smithi081.stdout: index_block_restart_interval: 1 2024-05-03T16:33:03.895 INFO:journalctl@ceph.mon.a.smithi081.stdout: metadata_block_size: 4096 2024-05-03T16:33:03.895 INFO:journalctl@ceph.mon.a.smithi081.stdout: partition_filters: 0 2024-05-03T16:33:03.895 INFO:journalctl@ceph.mon.a.smithi081.stdout: use_delta_encoding: 1 2024-05-03T16:33:03.895 INFO:journalctl@ceph.mon.a.smithi081.stdout: filter_policy: bloomfilter 2024-05-03T16:33:03.895 INFO:journalctl@ceph.mon.a.smithi081.stdout: whole_key_filtering: 1 2024-05-03T16:33:03.895 INFO:journalctl@ceph.mon.a.smithi081.stdout: verify_compression: 0 2024-05-03T16:33:03.896 INFO:journalctl@ceph.mon.a.smithi081.stdout: read_amp_bytes_per_bit: 0 2024-05-03T16:33:03.896 INFO:journalctl@ceph.mon.a.smithi081.stdout: format_version: 5 2024-05-03T16:33:03.896 INFO:journalctl@ceph.mon.a.smithi081.stdout: enable_index_compression: 1 2024-05-03T16:33:03.896 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_align: 0 2024-05-03T16:33:03.896 INFO:journalctl@ceph.mon.a.smithi081.stdout: max_auto_readahead_size: 262144 2024-05-03T16:33:03.896 INFO:journalctl@ceph.mon.a.smithi081.stdout: prepopulate_block_cache: 0 2024-05-03T16:33:03.896 INFO:journalctl@ceph.mon.a.smithi081.stdout: initial_auto_readahead_size: 8192 2024-05-03T16:33:03.896 INFO:journalctl@ceph.mon.a.smithi081.stdout: num_file_reads_for_auto_readahead: 2 2024-05-03T16:33:03.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.write_buffer_size: 33554432 2024-05-03T16:33:03.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_write_buffer_number: 2 2024-05-03T16:33:03.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compression: NoCompression 2024-05-03T16:33:03.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.bottommost_compression: Disabled 2024-05-03T16:33:03.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.prefix_extractor: nullptr 2024-05-03T16:33:03.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-03T16:33:03.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.num_levels: 7 2024-05-03T16:33:03.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-03T16:33:03.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-03T16:33:03.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-03T16:33:03.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-03T16:33:03.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-03T16:33:03.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-03T16:33:03.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-03T16:33:03.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-03T16:33:03.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-03T16:33:03.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-03T16:33:03.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-03T16:33:03.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-03T16:33:03.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-03T16:33:03.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compression_opts.level: 32767 2024-05-03T16:33:03.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compression_opts.strategy: 0 2024-05-03T16:33:03.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-03T16:33:03.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-03T16:33:03.899 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-03T16:33:03.899 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-03T16:33:03.899 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compression_opts.enabled: false 2024-05-03T16:33:03.899 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-03T16:33:03.899 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-03T16:33:03.899 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-03T16:33:03.899 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-03T16:33:03.899 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.target_file_size_base: 67108864 2024-05-03T16:33:03.899 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-03T16:33:03.899 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-03T16:33:03.899 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-03T16:33:03.899 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-03T16:33:03.899 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-03T16:33:03.899 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-03T16:33:03.900 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-03T16:33:03.900 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-03T16:33:03.901 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-03T16:33:03.901 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-03T16:33:03.901 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-03T16:33:03.901 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-03T16:33:03.901 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-03T16:33:03.901 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-03T16:33:03.902 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.arena_block_size: 1048576 2024-05-03T16:33:03.902 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-03T16:33:03.902 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-03T16:33:03.902 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.disable_auto_compactions: 0 2024-05-03T16:33:03.902 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-03T16:33:03.902 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-03T16:33:03.902 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-03T16:33:03.902 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-03T16:33:03.902 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-03T16:33:03.902 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-03T16:33:03.902 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-03T16:33:03.902 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-03T16:33:03.903 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-03T16:33:03.903 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-03T16:33:03.903 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-03T16:33:03.903 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.inplace_update_support: 0 2024-05-03T16:33:03.903 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-03T16:33:03.903 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-03T16:33:03.903 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-03T16:33:03.903 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-03T16:33:03.903 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.bloom_locality: 0 2024-05-03T16:33:03.903 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.max_successive_merges: 0 2024-05-03T16:33:03.903 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-03T16:33:03.903 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.paranoid_file_checks: 0 2024-05-03T16:33:03.903 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.force_consistency_checks: 1 2024-05-03T16:33:03.903 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.report_bg_io_stats: 0 2024-05-03T16:33:03.903 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.ttl: 2592000 2024-05-03T16:33:03.903 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-03T16:33:03.904 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-03T16:33:03.904 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-03T16:33:03.904 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.enable_blob_files: false 2024-05-03T16:33:03.904 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.min_blob_size: 0 2024-05-03T16:33:03.904 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.blob_file_size: 268435456 2024-05-03T16:33:03.904 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-03T16:33:03.904 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-03T16:33:03.904 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-03T16:33:03.904 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-03T16:33:03.904 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-03T16:33:03.904 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.blob_file_starting_level: 0 2024-05-03T16:33:03.904 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-03T16:33:03.904 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-03T16:33:03.904 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-03T16:33:03.905 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 30c77b0a-ffee-4c5c-a405-1aad11d16fa9 2024-05-03T16:33:03.905 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714753983632948, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-03T16:33:03.905 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-03T16:33:03.905 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714753983634423, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99361, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 322, "table_properties": {"data_size": 97307, "index_size": 310, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13925, "raw_average_key_size": 49, "raw_value_size": 89686, "raw_average_value_size": 319, "num_data_blocks": 12, "num_entries": 281, "num_filter_entries": 281, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714753983, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "30c77b0a-ffee-4c5c-a405-1aad11d16fa9", "db_session_id": "A44NDHCK3PJXM0BRI46X", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-03T16:33:03.905 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714753983634780, "job": 1, "event": "recovery_finished"} 2024-05-03T16:33:03.905 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-03T16:33:03.905 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-03T16:33:03.905 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56127414c000 2024-05-03T16:33:03.905 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: DB pointer 0x561274138000 2024-05-03T16:33:03.905 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-03T16:33:03.905 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-03T16:33:03.905 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** DB Stats ** 2024-05-03T16:33:03.905 INFO:journalctl@ceph.mon.a.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-03T16:33:03.905 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-03T16:33:03.905 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-03T16:33:03.906 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-03T16:33:03.906 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-03T16:33:03.906 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-03T16:33:03.906 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-03T16:33:03.906 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-05-03T16:33:03.906 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** Compaction Stats [default] ** 2024-05-03T16:33:03.906 INFO:journalctl@ceph.mon.a.smithi081.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-03T16:33:03.906 INFO:journalctl@ceph.mon.a.smithi081.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-03T16:33:03.906 INFO:journalctl@ceph.mon.a.smithi081.stdout: L0 2/0 98.89 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 107.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T16:33:03.906 INFO:journalctl@ceph.mon.a.smithi081.stdout: Sum 2/0 98.89 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 107.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T16:33:03.906 INFO:journalctl@ceph.mon.a.smithi081.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 107.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T16:33:03.906 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-05-03T16:33:03.906 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** Compaction Stats [default] ** 2024-05-03T16:33:03.906 INFO:journalctl@ceph.mon.a.smithi081.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-03T16:33:03.906 INFO:journalctl@ceph.mon.a.smithi081.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-03T16:33:03.906 INFO:journalctl@ceph.mon.a.smithi081.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 107.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T16:33:03.907 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-05-03T16:33:03.907 INFO:journalctl@ceph.mon.a.smithi081.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-03T16:33:03.907 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-05-03T16:33:03.907 INFO:journalctl@ceph.mon.a.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-03T16:33:03.907 INFO:journalctl@ceph.mon.a.smithi081.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-03T16:33:03.907 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-03T16:33:03.907 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-03T16:33:03.907 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-03T16:33:03.907 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-03T16:33:03.907 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative compaction: 0.00 GB write, 13.38 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-03T16:33:03.907 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval compaction: 0.00 GB write, 13.38 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-03T16:33:03.907 INFO:journalctl@ceph.mon.a.smithi081.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-03T16:33:03.907 INFO:journalctl@ceph.mon.a.smithi081.stdout: Block cache BinnedLRUCache@0x56127402f1f0#2 capacity: 512.00 MB usage: 1.39 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-05-03T16:33:03.907 INFO:journalctl@ceph.mon.a.smithi081.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-05-03T16:33:03.907 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-05-03T16:33:03.907 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-03T16:33:03.908 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: starting mon.a rank 0 at public addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] at bind addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:33:03.908 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: mon.a@-1(???) e1 preinit fsid 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:33:03.908 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: mon.a@-1(???).mds e1 new map 2024-05-03T16:33:03.908 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: mon.a@-1(???).mds e1 print_map 2024-05-03T16:33:03.908 INFO:journalctl@ceph.mon.a.smithi081.stdout: e1 2024-05-03T16:33:03.908 INFO:journalctl@ceph.mon.a.smithi081.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-03T16:33:03.908 INFO:journalctl@ceph.mon.a.smithi081.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-03T16:33:03.908 INFO:journalctl@ceph.mon.a.smithi081.stdout: legacy client fscid: -1 2024-05-03T16:33:03.908 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-05-03T16:33:03.908 INFO:journalctl@ceph.mon.a.smithi081.stdout: No filesystems configured 2024-05-03T16:33:03.908 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-03T16:33:03.908 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T16:33:03.908 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T16:33:03.908 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T16:33:03.908 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-03T16:33:03.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 bash[28621]: ac30952d6fd320ec145a822ab7d1e17f7c4155ce056f31bf8fd28b5deefd197e 2024-05-03T16:33:03.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-03T16:33:03.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: monmap epoch 1 2024-05-03T16:33:03.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: fsid 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:33:03.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: last_changed 2024-05-03T16:32:44.597150+0000 2024-05-03T16:33:03.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: created 2024-05-03T16:32:44.597150+0000 2024-05-03T16:33:03.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: min_mon_release 19 (squid) 2024-05-03T16:33:03.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: election_strategy: 1 2024-05-03T16:33:03.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-05-03T16:33:03.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: fsmap 2024-05-03T16:33:03.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: osdmap e1: 0 total, 0 up, 0 in 2024-05-03T16:33:03.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 ceph-mon[28640]: mgrmap e1: no daemons active 2024-05-03T16:33:03.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:03 smithi081 systemd[1]: Started Ceph mon.a for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:33:05.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.434+0000 7f4178a00700 1 Processor -- start 2024-05-03T16:33:05.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.434+0000 7f4178a00700 1 -- start start 2024-05-03T16:33:05.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.435+0000 7f4178a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41741097b0 0x7f417410bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:05.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.435+0000 7f4178a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f417407cec0 con 0x7f41741097b0 2024-05-03T16:33:05.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.435+0000 7f4171e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41741097b0 0x7f417410bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:05.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.435+0000 7f4171e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41741097b0 0x7f417410bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57218/0 (socket says 172.21.15.81:57218) 2024-05-03T16:33:05.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.436+0000 7f4171e00700 1 -- 172.21.15.81:0/3230333670 learned_addr learned my addr 172.21.15.81:0/3230333670 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:05.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.436+0000 7f4171e00700 1 -- 172.21.15.81:0/3230333670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417410c0e0 con 0x7f41741097b0 2024-05-03T16:33:05.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.437+0000 7f4171e00700 1 --2- 172.21.15.81:0/3230333670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41741097b0 0x7f417410bba0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f41640098a0 tx=0x7f4164009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7a8ee8d08ff2e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:05.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.437+0000 7f4170a00700 1 -- 172.21.15.81:0/3230333670 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4164004160 con 0x7f41741097b0 2024-05-03T16:33:05.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.437+0000 7f4170a00700 1 -- 172.21.15.81:0/3230333670 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f4164004300 con 0x7f41741097b0 2024-05-03T16:33:05.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.437+0000 7f4170a00700 1 -- 172.21.15.81:0/3230333670 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41640119e0 con 0x7f41741097b0 2024-05-03T16:33:05.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.438+0000 7f4178a00700 1 -- 172.21.15.81:0/3230333670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41741097b0 msgr2=0x7f417410bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:05.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.438+0000 7f4178a00700 1 --2- 172.21.15.81:0/3230333670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41741097b0 0x7f417410bba0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f41640098a0 tx=0x7f4164009bb0 comp rx=0 tx=0).stop 2024-05-03T16:33:05.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.438+0000 7f4178a00700 1 -- 172.21.15.81:0/3230333670 shutdown_connections 2024-05-03T16:33:05.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.438+0000 7f4178a00700 1 --2- 172.21.15.81:0/3230333670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41741097b0 0x7f417410bba0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:05.137 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.438+0000 7f4178a00700 1 -- 172.21.15.81:0/3230333670 >> 172.21.15.81:0/3230333670 conn(0x7f4174103200 msgr2=0x7f4174105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:05.137 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.438+0000 7f4178a00700 1 -- 172.21.15.81:0/3230333670 shutdown_connections 2024-05-03T16:33:05.137 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.438+0000 7f4178a00700 1 -- 172.21.15.81:0/3230333670 wait complete. 2024-05-03T16:33:05.137 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.439+0000 7f4178a00700 1 Processor -- start 2024-05-03T16:33:05.138 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.439+0000 7f4178a00700 1 -- start start 2024-05-03T16:33:05.138 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.439+0000 7f4178a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41741097b0 0x7f417419caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:05.138 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.439+0000 7f4178a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f417410cfe0 con 0x7f41741097b0 2024-05-03T16:33:05.138 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.440+0000 7f4171e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41741097b0 0x7f417419caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:05.138 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.440+0000 7f4171e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41741097b0 0x7f417419caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57228/0 (socket says 172.21.15.81:57228) 2024-05-03T16:33:05.138 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.440+0000 7f4171e00700 1 -- 172.21.15.81:0/539014476 learned_addr learned my addr 172.21.15.81:0/539014476 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:05.138 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.440+0000 7f4171e00700 1 -- 172.21.15.81:0/539014476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417419d030 con 0x7f41741097b0 2024-05-03T16:33:05.138 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.440+0000 7f4171e00700 1 --2- 172.21.15.81:0/539014476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41741097b0 0x7f417419caf0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f41640119e0 tx=0x7f41640046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:05.138 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.441+0000 7f416aa00700 1 -- 172.21.15.81:0/539014476 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4164003bf0 con 0x7f41741097b0 2024-05-03T16:33:05.138 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.441+0000 7f416aa00700 1 -- 172.21.15.81:0/539014476 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f416401a8a0 con 0x7f41741097b0 2024-05-03T16:33:05.138 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.441+0000 7f4178a00700 1 -- 172.21.15.81:0/539014476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417419d2c0 con 0x7f41741097b0 2024-05-03T16:33:05.138 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.441+0000 7f416aa00700 1 -- 172.21.15.81:0/539014476 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41640248c0 con 0x7f41741097b0 2024-05-03T16:33:05.138 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.441+0000 7f4178a00700 1 -- 172.21.15.81:0/539014476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f417419ffb0 con 0x7f41741097b0 2024-05-03T16:33:05.138 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.441+0000 7f416aa00700 1 -- 172.21.15.81:0/539014476 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4164022020 con 0x7f41741097b0 2024-05-03T16:33:05.139 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.441+0000 7f416aa00700 1 -- 172.21.15.81:0/539014476 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f41640193c0 con 0x7f41741097b0 2024-05-03T16:33:05.139 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.442+0000 7f4178a00700 1 -- 172.21.15.81:0/539014476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4174064b00 con 0x7f41741097b0 2024-05-03T16:33:05.139 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.445+0000 7f416aa00700 1 -- 172.21.15.81:0/539014476 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f4164043e50 con 0x7f41741097b0 2024-05-03T16:33:05.139 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.521+0000 7f4178a00700 1 -- 172.21.15.81:0/539014476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f41741a0180 con 0x7f41741097b0 2024-05-03T16:33:05.139 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.525+0000 7f416aa00700 1 -- 172.21.15.81:0/539014476 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f4164032030 con 0x7f41741097b0 2024-05-03T16:33:05.139 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.526+0000 7f4178a00700 1 -- 172.21.15.81:0/539014476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41741097b0 msgr2=0x7f417419caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:05.139 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.526+0000 7f4178a00700 1 --2- 172.21.15.81:0/539014476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41741097b0 0x7f417419caf0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f41640119e0 tx=0x7f41640046a0 comp rx=0 tx=0).stop 2024-05-03T16:33:05.139 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.527+0000 7f4178a00700 1 -- 172.21.15.81:0/539014476 shutdown_connections 2024-05-03T16:33:05.139 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.527+0000 7f4178a00700 1 --2- 172.21.15.81:0/539014476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41741097b0 0x7f417419caf0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:05.139 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.527+0000 7f4178a00700 1 -- 172.21.15.81:0/539014476 >> 172.21.15.81:0/539014476 conn(0x7f4174103200 msgr2=0x7f4174103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:05.139 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.527+0000 7f4178a00700 1 -- 172.21.15.81:0/539014476 shutdown_connections 2024-05-03T16:33:05.139 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:04.527+0000 7f4178a00700 1 -- 172.21.15.81:0/539014476 wait complete. 2024-05-03T16:33:05.140 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-03T16:33:05.160 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-03T16:33:05.160 INFO:teuthology.orchestra.run.smithi081.stdout:Creating mgr... 2024-05-03T16:33:05.162 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-03T16:33:05.163 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-03T16:33:05.578 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-8988869e-096a-11ef-bc97-c7b262605968@mgr.x 2024-05-03T16:33:05.578 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to reset failed state of unit ceph-8988869e-096a-11ef-bc97-c7b262605968@mgr.x.service: Unit ceph-8988869e-096a-11ef-bc97-c7b262605968@mgr.x.service not loaded. 2024-05-03T16:33:05.840 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-8988869e-096a-11ef-bc97-c7b262605968.target.wants/ceph-8988869e-096a-11ef-bc97-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-8988869e-096a-11ef-bc97-c7b262605968@.service. 2024-05-03T16:33:05.877 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:05 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/539014476' entity='client.admin' 2024-05-03T16:33:06.225 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:05 smithi081 systemd[1]: Starting Ceph mgr.x for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T16:33:06.485 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:06 smithi081 podman[28855]: 2024-05-03 16:33:06.12773618 +0000 UTC m=+0.031164764 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T16:33:06.485 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:06 smithi081 podman[28855]: 2024-05-03 16:33:06.246057645 +0000 UTC m=+0.149486260 container create efb7bca1e81960e9cee42ff2c8bc92ad6a3c96fb99e23ff186d20eb7590ceb45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-05-03T16:33:06.485 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:06 smithi081 podman[28855]: 2024-05-03 16:33:06.48293877 +0000 UTC m=+0.386367432 container init efb7bca1e81960e9cee42ff2c8bc92ad6a3c96fb99e23ff186d20eb7590ceb45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-05-03T16:33:06.621 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-03T16:33:06.621 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-05-03T16:33:06.639 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-03T16:33:06.639 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-05-03T16:33:06.639 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-05-03T16:33:06.639 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to enable service . firewalld.service is not available 2024-05-03T16:33:06.662 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-03T16:33:06.662 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-05-03T16:33:06.681 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-03T16:33:06.681 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-05-03T16:33:06.682 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-05-03T16:33:06.682 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-03T16:33:06.682 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr to start... 2024-05-03T16:33:06.682 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr... 2024-05-03T16:33:06.736 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:06 smithi081 podman[28855]: 2024-05-03 16:33:06.493139401 +0000 UTC m=+0.396567987 container start efb7bca1e81960e9cee42ff2c8bc92ad6a3c96fb99e23ff186d20eb7590ceb45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-05-03T16:33:06.736 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:06 smithi081 bash[28855]: efb7bca1e81960e9cee42ff2c8bc92ad6a3c96fb99e23ff186d20eb7590ceb45 2024-05-03T16:33:06.736 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:06 smithi081 systemd[1]: Started Ceph mgr.x for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:33:06.990 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:06 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:06.734+0000 7f205c96b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-03T16:33:07.264 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:06 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:06.995+0000 7f205c96b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-03T16:33:07.264 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:07 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:07.127+0000 7f205c96b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-03T16:33:07.549 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:07 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2235267726' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-03T16:33:07.802 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:07 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:07.547+0000 7f205c96b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-03T16:33:07.802 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:07 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:07.665+0000 7f205c96b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-03T16:33:08.078 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-03T16:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-05-03T16:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "8988869e-096a-11ef-bc97-c7b262605968", 2024-05-03T16:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-05-03T16:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-03T16:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-03T16:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-03T16:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-03T16:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-03T16:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-05-03T16:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-03T16:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-03T16:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "a" 2024-05-03T16:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-03T16:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-05-03T16:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-03T16:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T16:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-03T16:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-03T16:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:08.083 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-03T16:33:08.083 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T16:33:08.083 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-03T16:33:08.083 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-03T16:33:08.083 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-03T16:33:08.087 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-03T16:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-03T16:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-03T16:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-03T16:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-03T16:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-03T16:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-03T16:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-03T16:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-03T16:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-03T16:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-03T16:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-03T16:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-03T16:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T16:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-03T16:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-03T16:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-03T16:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-03T16:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-03T16:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-03T16:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-03T16:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-03T16:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-05-03T16:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-03T16:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T16:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-03T16:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T16:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-05-03T16:32:56.440988+0000", 2024-05-03T16:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T16:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-03T16:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-05-03T16:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.262+0000 7f720fe00700 1 Processor -- start 2024-05-03T16:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.262+0000 7f720fe00700 1 -- start start 2024-05-03T16:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.263+0000 7f720fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210108b50 0x7f7210108f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.263+0000 7f720fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7210109540 con 0x7f7210108b50 2024-05-03T16:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.263+0000 7f720ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210108b50 0x7f7210108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.263+0000 7f720ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210108b50 0x7f7210108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41310/0 (socket says 172.21.15.81:41310) 2024-05-03T16:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.263+0000 7f720ea00700 1 -- 172.21.15.81:0/941475783 learned_addr learned my addr 172.21.15.81:0/941475783 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.264+0000 7f720ea00700 1 -- 172.21.15.81:0/941475783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7210109d50 con 0x7f7210108b50 2024-05-03T16:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.264+0000 7f720ea00700 1 --2- 172.21.15.81:0/941475783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210108b50 0x7f7210108f70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f72000098a0 tx=0x7f7200009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956b6eff2add392b server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.264+0000 7f720d600700 1 -- 172.21.15.81:0/941475783 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7200004160 con 0x7f7210108b50 2024-05-03T16:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.264+0000 7f720d600700 1 -- 172.21.15.81:0/941475783 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f7200004300 con 0x7f7210108b50 2024-05-03T16:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.264+0000 7f720d600700 1 -- 172.21.15.81:0/941475783 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72000119e0 con 0x7f7210108b50 2024-05-03T16:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.265+0000 7f720fe00700 1 -- 172.21.15.81:0/941475783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210108b50 msgr2=0x7f7210108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.265+0000 7f720fe00700 1 --2- 172.21.15.81:0/941475783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210108b50 0x7f7210108f70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f72000098a0 tx=0x7f7200009bb0 comp rx=0 tx=0).stop 2024-05-03T16:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.266+0000 7f720fe00700 1 -- 172.21.15.81:0/941475783 shutdown_connections 2024-05-03T16:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.266+0000 7f720fe00700 1 --2- 172.21.15.81:0/941475783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210108b50 0x7f7210108f70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.266+0000 7f720fe00700 1 -- 172.21.15.81:0/941475783 >> 172.21.15.81:0/941475783 conn(0x7f72101040f0 msgr2=0x7f7210106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.266+0000 7f720fe00700 1 -- 172.21.15.81:0/941475783 shutdown_connections 2024-05-03T16:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.266+0000 7f720fe00700 1 -- 172.21.15.81:0/941475783 wait complete. 2024-05-03T16:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.267+0000 7f720fe00700 1 Processor -- start 2024-05-03T16:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.267+0000 7f720fe00700 1 -- start start 2024-05-03T16:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.268+0000 7f720fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210108b50 0x7f721019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.268+0000 7f720fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f721010cf80 con 0x7f7210108b50 2024-05-03T16:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.268+0000 7f720ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210108b50 0x7f721019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.268+0000 7f720ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210108b50 0x7f721019c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41314/0 (socket says 172.21.15.81:41314) 2024-05-03T16:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.268+0000 7f720ea00700 1 -- 172.21.15.81:0/2235267726 learned_addr learned my addr 172.21.15.81:0/2235267726 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.268+0000 7f720ea00700 1 -- 172.21.15.81:0/2235267726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721019ce30 con 0x7f7210108b50 2024-05-03T16:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.269+0000 7f720ea00700 1 --2- 172.21.15.81:0/2235267726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210108b50 0x7f721019c8f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f72000119b0 tx=0x7f7200011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.269+0000 7f7207400700 1 -- 172.21.15.81:0/2235267726 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7200003af0 con 0x7f7210108b50 2024-05-03T16:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.269+0000 7f7207400700 1 -- 172.21.15.81:0/2235267726 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f720001a8a0 con 0x7f7210108b50 2024-05-03T16:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.269+0000 7f720fe00700 1 -- 172.21.15.81:0/2235267726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f721019d0c0 con 0x7f7210108b50 2024-05-03T16:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.269+0000 7f7207400700 1 -- 172.21.15.81:0/2235267726 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7200024830 con 0x7f7210108b50 2024-05-03T16:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.269+0000 7f720fe00700 1 -- 172.21.15.81:0/2235267726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f721019fdb0 con 0x7f7210108b50 2024-05-03T16:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.270+0000 7f7207400700 1 -- 172.21.15.81:0/2235267726 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7200022020 con 0x7f7210108b50 2024-05-03T16:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.270+0000 7f7207400700 1 -- 172.21.15.81:0/2235267726 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f720002dda0 con 0x7f7210108b50 2024-05-03T16:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.270+0000 7f720fe00700 1 -- 172.21.15.81:0/2235267726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f721010d100 con 0x7f7210108b50 2024-05-03T16:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.273+0000 7f7207400700 1 -- 172.21.15.81:0/2235267726 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f720001aa50 con 0x7f7210108b50 2024-05-03T16:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.352+0000 7f720fe00700 1 -- 172.21.15.81:0/2235267726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7210064b00 con 0x7f7210108b50 2024-05-03T16:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.353+0000 7f7207400700 1 -- 172.21.15.81:0/2235267726 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f7200032030 con 0x7f7210108b50 2024-05-03T16:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.354+0000 7f720fe00700 1 -- 172.21.15.81:0/2235267726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210108b50 msgr2=0x7f721019c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.354+0000 7f720fe00700 1 --2- 172.21.15.81:0/2235267726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210108b50 0x7f721019c8f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f72000119b0 tx=0x7f7200011a90 comp rx=0 tx=0).stop 2024-05-03T16:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.354+0000 7f720fe00700 1 -- 172.21.15.81:0/2235267726 shutdown_connections 2024-05-03T16:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.354+0000 7f720fe00700 1 --2- 172.21.15.81:0/2235267726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7210108b50 0x7f721019c8f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.354+0000 7f720fe00700 1 -- 172.21.15.81:0/2235267726 >> 172.21.15.81:0/2235267726 conn(0x7f72101040f0 msgr2=0x7f7210104ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.354+0000 7f720fe00700 1 -- 172.21.15.81:0/2235267726 shutdown_connections 2024-05-03T16:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:07.354+0000 7f720fe00700 1 -- 172.21.15.81:0/2235267726 wait complete. 2024-05-03T16:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout:mgr not available, waiting (1/15)... 2024-05-03T16:33:09.680 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:09 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:09.243+0000 7f205c96b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-03T16:33:09.681 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:09 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:09.468+0000 7f205c96b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-03T16:33:09.990 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:09 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:09.679+0000 7f205c96b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-03T16:33:10.397 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:10 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:10.105+0000 7f205c96b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-03T16:33:10.397 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:10 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:10.230+0000 7f205c96b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-03T16:33:10.661 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:10 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:10.492+0000 7f205c96b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-03T16:33:10.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:10 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/227335049' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-03T16:33:10.990 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:10 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:10.760+0000 7f205c96b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-03T16:33:11.440 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-03T16:33:11.440 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-05-03T16:33:11.440 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "8988869e-096a-11ef-bc97-c7b262605968", 2024-05-03T16:33:11.440 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-05-03T16:33:11.440 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-03T16:33:11.440 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-03T16:33:11.440 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-03T16:33:11.440 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:11.440 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-03T16:33:11.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-03T16:33:11.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-05-03T16:33:11.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-03T16:33:11.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-03T16:33:11.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "a" 2024-05-03T16:33:11.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-03T16:33:11.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-05-03T16:33:11.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-03T16:33:11.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T16:33:11.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-03T16:33:11.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-03T16:33:11.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:11.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-03T16:33:11.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T16:33:11.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-03T16:33:11.441 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-03T16:33:11.442 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-03T16:33:11.442 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-03T16:33:11.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-03T16:33:11.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-03T16:33:11.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:11.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-03T16:33:11.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-03T16:33:11.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-03T16:33:11.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-03T16:33:11.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-03T16:33:11.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-03T16:33:11.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-03T16:33:11.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-03T16:33:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-03T16:33:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-03T16:33:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T16:33:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-03T16:33:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-03T16:33:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-03T16:33:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-03T16:33:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-03T16:33:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-03T16:33:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-03T16:33:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-03T16:33:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-05-03T16:33:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-03T16:33:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T16:33:11.450 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:11.450 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-03T16:33:11.450 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T16:33:11.450 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-05-03T16:32:56.440988+0000", 2024-05-03T16:33:11.450 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T16:33:11.450 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:11.450 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-03T16:33:11.450 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-05-03T16:33:11.450 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.687+0000 7f839c400700 1 Processor -- start 2024-05-03T16:33:11.450 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.687+0000 7f839c400700 1 -- start start 2024-05-03T16:33:11.450 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.688+0000 7f839c400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839410af70 0x7f839410b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:11.450 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.688+0000 7f839c400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f839410b8d0 con 0x7f839410af70 2024-05-03T16:33:11.450 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.688+0000 7f8399a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839410af70 0x7f839410b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:11.451 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.688+0000 7f8399a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839410af70 0x7f839410b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41326/0 (socket says 172.21.15.81:41326) 2024-05-03T16:33:11.451 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.688+0000 7f8399a00700 1 -- 172.21.15.81:0/682931284 learned_addr learned my addr 172.21.15.81:0/682931284 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:11.451 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.689+0000 7f8399a00700 1 -- 172.21.15.81:0/682931284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839410c080 con 0x7f839410af70 2024-05-03T16:33:11.451 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.689+0000 7f8399a00700 1 --2- 172.21.15.81:0/682931284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839410af70 0x7f839410b390 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f83880098a0 tx=0x7f8388009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17f521ad5d50499 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:11.451 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.689+0000 7f8393e00700 1 -- 172.21.15.81:0/682931284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8388004160 con 0x7f839410af70 2024-05-03T16:33:11.451 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.689+0000 7f8393e00700 1 -- 172.21.15.81:0/682931284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f8388004300 con 0x7f839410af70 2024-05-03T16:33:11.451 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.689+0000 7f8393e00700 1 -- 172.21.15.81:0/682931284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83880119e0 con 0x7f839410af70 2024-05-03T16:33:11.451 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.690+0000 7f839c400700 1 -- 172.21.15.81:0/682931284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839410af70 msgr2=0x7f839410b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:11.451 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.690+0000 7f839c400700 1 --2- 172.21.15.81:0/682931284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839410af70 0x7f839410b390 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f83880098a0 tx=0x7f8388009bb0 comp rx=0 tx=0).stop 2024-05-03T16:33:11.451 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.690+0000 7f839c400700 1 -- 172.21.15.81:0/682931284 shutdown_connections 2024-05-03T16:33:11.451 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.690+0000 7f839c400700 1 --2- 172.21.15.81:0/682931284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839410af70 0x7f839410b390 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:11.451 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.690+0000 7f839c400700 1 -- 172.21.15.81:0/682931284 >> 172.21.15.81:0/682931284 conn(0x7f839407e2f0 msgr2=0x7f839407e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:11.451 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.690+0000 7f839c400700 1 -- 172.21.15.81:0/682931284 shutdown_connections 2024-05-03T16:33:11.452 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.690+0000 7f839c400700 1 -- 172.21.15.81:0/682931284 wait complete. 2024-05-03T16:33:11.452 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.691+0000 7f839c400700 1 Processor -- start 2024-05-03T16:33:11.452 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.691+0000 7f839c400700 1 -- start start 2024-05-03T16:33:11.452 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.691+0000 7f839c400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839410af70 0x7f839419ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:11.452 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.691+0000 7f839c400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f839410f340 con 0x7f839410af70 2024-05-03T16:33:11.452 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.692+0000 7f8399a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839410af70 0x7f839419ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:11.452 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.692+0000 7f8399a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839410af70 0x7f839419ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41334/0 (socket says 172.21.15.81:41334) 2024-05-03T16:33:11.452 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.692+0000 7f8399a00700 1 -- 172.21.15.81:0/227335049 learned_addr learned my addr 172.21.15.81:0/227335049 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:11.452 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.692+0000 7f8399a00700 1 -- 172.21.15.81:0/227335049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839419f260 con 0x7f839410af70 2024-05-03T16:33:11.452 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.692+0000 7f8399a00700 1 --2- 172.21.15.81:0/227335049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839410af70 0x7f839419ed20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f83880116a0 tx=0x7f83880046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:11.452 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.693+0000 7f8392000700 1 -- 172.21.15.81:0/227335049 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8388003b70 con 0x7f839410af70 2024-05-03T16:33:11.452 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.693+0000 7f8392000700 1 -- 172.21.15.81:0/227335049 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f838801a8a0 con 0x7f839410af70 2024-05-03T16:33:11.452 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.693+0000 7f8392000700 1 -- 172.21.15.81:0/227335049 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8388024890 con 0x7f839410af70 2024-05-03T16:33:11.452 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.693+0000 7f839c400700 1 -- 172.21.15.81:0/227335049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839419f4f0 con 0x7f839410af70 2024-05-03T16:33:11.453 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.693+0000 7f839c400700 1 -- 172.21.15.81:0/227335049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83941a21d0 con 0x7f839410af70 2024-05-03T16:33:11.453 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.694+0000 7f8392000700 1 -- 172.21.15.81:0/227335049 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8388022020 con 0x7f839410af70 2024-05-03T16:33:11.453 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.694+0000 7f839c400700 1 -- 172.21.15.81:0/227335049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8394064b00 con 0x7f839410af70 2024-05-03T16:33:11.453 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.694+0000 7f8392000700 1 -- 172.21.15.81:0/227335049 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f838802d9e0 con 0x7f839410af70 2024-05-03T16:33:11.453 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.696+0000 7f8392000700 1 -- 172.21.15.81:0/227335049 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f83880094f0 con 0x7f839410af70 2024-05-03T16:33:11.453 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.776+0000 7f839c400700 1 -- 172.21.15.81:0/227335049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f83941a2440 con 0x7f839410af70 2024-05-03T16:33:11.453 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.776+0000 7f8392000700 1 -- 172.21.15.81:0/227335049 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f838801aa50 con 0x7f839410af70 2024-05-03T16:33:11.453 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.778+0000 7f839c400700 1 -- 172.21.15.81:0/227335049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839410af70 msgr2=0x7f839419ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:11.453 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.778+0000 7f839c400700 1 --2- 172.21.15.81:0/227335049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839410af70 0x7f839419ed20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f83880116a0 tx=0x7f83880046a0 comp rx=0 tx=0).stop 2024-05-03T16:33:11.453 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.778+0000 7f839c400700 1 -- 172.21.15.81:0/227335049 shutdown_connections 2024-05-03T16:33:11.453 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.778+0000 7f839c400700 1 --2- 172.21.15.81:0/227335049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839410af70 0x7f839419ed20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:11.453 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.778+0000 7f839c400700 1 -- 172.21.15.81:0/227335049 >> 172.21.15.81:0/227335049 conn(0x7f839407e2f0 msgr2=0x7f8394108430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:11.453 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.778+0000 7f839c400700 1 -- 172.21.15.81:0/227335049 shutdown_connections 2024-05-03T16:33:11.453 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:10.779+0000 7f839c400700 1 -- 172.21.15.81:0/227335049 wait complete. 2024-05-03T16:33:11.453 INFO:teuthology.orchestra.run.smithi081.stdout:mgr not available, waiting (2/15)... 2024-05-03T16:33:11.740 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:11 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:11.580+0000 7f205c96b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-03T16:33:12.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:11 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:11.863+0000 7f205c96b200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-03T16:33:12.740 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:12 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:12.417+0000 7f205c96b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-03T16:33:12.740 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:12 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:12.545+0000 7f205c96b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-03T16:33:13.462 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:13 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:13.009+0000 7f205c96b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-03T16:33:13.740 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:13 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:13.460+0000 7f205c96b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-03T16:33:13.740 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:13 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:13.590+0000 7f205c96b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-03T16:33:14.076 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:13 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:13.920+0000 7f205c96b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-03T16:33:14.490 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:14 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:14.108+0000 7f205c96b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-03T16:33:14.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:14 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1579453726' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-03T16:33:14.771 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:14 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:14.493+0000 7f205c96b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-03T16:33:14.771 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:14 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:14.646+0000 7f205c96b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-03T16:33:14.771 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:14 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:14.769+0000 7f205c96b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-03T16:33:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-03T16:33:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-05-03T16:33:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "8988869e-096a-11ef-bc97-c7b262605968", 2024-05-03T16:33:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-05-03T16:33:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-03T16:33:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-03T16:33:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-03T16:33:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-03T16:33:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-03T16:33:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-05-03T16:33:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-03T16:33:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-03T16:33:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "a" 2024-05-03T16:33:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-03T16:33:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-05-03T16:33:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-03T16:33:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T16:33:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-03T16:33:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-03T16:33:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-03T16:33:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T16:33:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-03T16:33:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-03T16:33:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-03T16:33:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-03T16:33:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-03T16:33:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-03T16:33:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-03T16:33:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-03T16:33:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-03T16:33:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-03T16:33:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-03T16:33:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-03T16:33:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-03T16:33:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-03T16:33:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-03T16:33:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-03T16:33:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T16:33:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-03T16:33:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-03T16:33:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-03T16:33:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-03T16:33:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-03T16:33:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-03T16:33:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-03T16:33:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-03T16:33:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-05-03T16:33:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-03T16:33:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T16:33:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-03T16:33:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T16:33:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-05-03T16:32:56.440988+0000", 2024-05-03T16:33:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T16:33:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-03T16:33:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-05-03T16:33:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.075+0000 7f1463400700 1 Processor -- start 2024-05-03T16:33:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.075+0000 7f1463400700 1 -- start start 2024-05-03T16:33:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.075+0000 7f1463400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f145c07eed0 0x7f145c07d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.075+0000 7f1463400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f145c07d900 con 0x7f145c07eed0 2024-05-03T16:33:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.076+0000 7f1460a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f145c07eed0 0x7f145c07d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.076+0000 7f1460a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f145c07eed0 0x7f145c07d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41336/0 (socket says 172.21.15.81:41336) 2024-05-03T16:33:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.076+0000 7f1460a00700 1 -- 172.21.15.81:0/3238999364 learned_addr learned my addr 172.21.15.81:0/3238999364 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.076+0000 7f1460a00700 1 -- 172.21.15.81:0/3238999364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145c07da80 con 0x7f145c07eed0 2024-05-03T16:33:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.076+0000 7f1460a00700 1 --2- 172.21.15.81:0/3238999364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f145c07eed0 0x7f145c07d330 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f14500098a0 tx=0x7f1450009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a438c7f4870a47 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.077+0000 7f145b400700 1 -- 172.21.15.81:0/3238999364 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1450004160 con 0x7f145c07eed0 2024-05-03T16:33:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.077+0000 7f145b400700 1 -- 172.21.15.81:0/3238999364 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f1450004300 con 0x7f145c07eed0 2024-05-03T16:33:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.077+0000 7f145b400700 1 -- 172.21.15.81:0/3238999364 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14500119e0 con 0x7f145c07eed0 2024-05-03T16:33:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.078+0000 7f1463400700 1 -- 172.21.15.81:0/3238999364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f145c07eed0 msgr2=0x7f145c07d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.078+0000 7f1463400700 1 --2- 172.21.15.81:0/3238999364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f145c07eed0 0x7f145c07d330 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f14500098a0 tx=0x7f1450009bb0 comp rx=0 tx=0).stop 2024-05-03T16:33:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.078+0000 7f1463400700 1 -- 172.21.15.81:0/3238999364 shutdown_connections 2024-05-03T16:33:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.078+0000 7f1463400700 1 --2- 172.21.15.81:0/3238999364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f145c07eed0 0x7f145c07d330 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.078+0000 7f1463400700 1 -- 172.21.15.81:0/3238999364 >> 172.21.15.81:0/3238999364 conn(0x7f145c1042d0 msgr2=0x7f145c1066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.078+0000 7f1463400700 1 -- 172.21.15.81:0/3238999364 shutdown_connections 2024-05-03T16:33:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.078+0000 7f1463400700 1 -- 172.21.15.81:0/3238999364 wait complete. 2024-05-03T16:33:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.079+0000 7f1463400700 1 Processor -- start 2024-05-03T16:33:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.079+0000 7f1463400700 1 -- start start 2024-05-03T16:33:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.080+0000 7f1463400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f145c07eed0 0x7f145c19ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.080+0000 7f1463400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f145c10f1e0 con 0x7f145c07eed0 2024-05-03T16:33:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.080+0000 7f1460a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f145c07eed0 0x7f145c19ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.080+0000 7f1460a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f145c07eed0 0x7f145c19ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41352/0 (socket says 172.21.15.81:41352) 2024-05-03T16:33:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.080+0000 7f1460a00700 1 -- 172.21.15.81:0/1579453726 learned_addr learned my addr 172.21.15.81:0/1579453726 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.080+0000 7f1460a00700 1 -- 172.21.15.81:0/1579453726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145c19f230 con 0x7f145c07eed0 2024-05-03T16:33:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.081+0000 7f1460a00700 1 --2- 172.21.15.81:0/1579453726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f145c07eed0 0x7f145c19ecf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1450006b20 tx=0x7f1450011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.081+0000 7f1459600700 1 -- 172.21.15.81:0/1579453726 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1450003a60 con 0x7f145c07eed0 2024-05-03T16:33:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.081+0000 7f1459600700 1 -- 172.21.15.81:0/1579453726 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f1450003c00 con 0x7f145c07eed0 2024-05-03T16:33:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.081+0000 7f1459600700 1 -- 172.21.15.81:0/1579453726 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1450024780 con 0x7f145c07eed0 2024-05-03T16:33:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.081+0000 7f1463400700 1 -- 172.21.15.81:0/1579453726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f145c19f4c0 con 0x7f145c07eed0 2024-05-03T16:33:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.081+0000 7f1463400700 1 -- 172.21.15.81:0/1579453726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f145c1a21a0 con 0x7f145c07eed0 2024-05-03T16:33:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.081+0000 7f1459600700 1 -- 172.21.15.81:0/1579453726 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1450022020 con 0x7f145c07eed0 2024-05-03T16:33:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.081+0000 7f1459600700 1 -- 172.21.15.81:0/1579453726 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f145002dde0 con 0x7f145c07eed0 2024-05-03T16:33:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.082+0000 7f1463400700 1 -- 172.21.15.81:0/1579453726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f145c064b00 con 0x7f145c07eed0 2024-05-03T16:33:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.085+0000 7f1459600700 1 -- 172.21.15.81:0/1579453726 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f145001aba0 con 0x7f145c07eed0 2024-05-03T16:33:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.163+0000 7f1463400700 1 -- 172.21.15.81:0/1579453726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f145c1a2370 con 0x7f145c07eed0 2024-05-03T16:33:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.164+0000 7f1459600700 1 -- 172.21.15.81:0/1579453726 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f145002d3f0 con 0x7f145c07eed0 2024-05-03T16:33:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.165+0000 7f1463400700 1 -- 172.21.15.81:0/1579453726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f145c07eed0 msgr2=0x7f145c19ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.165+0000 7f1463400700 1 --2- 172.21.15.81:0/1579453726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f145c07eed0 0x7f145c19ecf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1450006b20 tx=0x7f1450011a60 comp rx=0 tx=0).stop 2024-05-03T16:33:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.165+0000 7f1463400700 1 -- 172.21.15.81:0/1579453726 shutdown_connections 2024-05-03T16:33:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.165+0000 7f1463400700 1 --2- 172.21.15.81:0/1579453726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f145c07eed0 0x7f145c19ecf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.165+0000 7f1463400700 1 -- 172.21.15.81:0/1579453726 >> 172.21.15.81:0/1579453726 conn(0x7f145c1042d0 msgr2=0x7f145c104d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:14.939 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.166+0000 7f1463400700 1 -- 172.21.15.81:0/1579453726 shutdown_connections 2024-05-03T16:33:14.939 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:14.166+0000 7f1463400700 1 -- 172.21.15.81:0/1579453726 wait complete. 2024-05-03T16:33:14.939 INFO:teuthology.orchestra.run.smithi081.stdout:mgr not available, waiting (3/15)... 2024-05-03T16:33:15.821 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:15 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:15.533+0000 7f205c96b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-03T16:33:16.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:15 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:15.820+0000 7f205c96b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-03T16:33:16.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:15 smithi081 ceph-mon[28640]: Activating manager daemon x 2024-05-03T16:33:16.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:15 smithi081 ceph-mon[28640]: mgrmap e2: x(active, starting, since 0.0110569s) 2024-05-03T16:33:16.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:15 smithi081 ceph-mon[28640]: from='mgr.14100 172.21.15.81:0/3190895689' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-03T16:33:16.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:15 smithi081 ceph-mon[28640]: from='mgr.14100 172.21.15.81:0/3190895689' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-03T16:33:16.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:15 smithi081 ceph-mon[28640]: from='mgr.14100 172.21.15.81:0/3190895689' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-03T16:33:16.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:15 smithi081 ceph-mon[28640]: from='mgr.14100 172.21.15.81:0/3190895689' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-03T16:33:16.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:15 smithi081 ceph-mon[28640]: from='mgr.14100 172.21.15.81:0/3190895689' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-03T16:33:16.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:15 smithi081 ceph-mon[28640]: from='mgr.14100 172.21.15.81:0/3190895689' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-03T16:33:16.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:15 smithi081 ceph-mon[28640]: from='mgr.14100 172.21.15.81:0/3190895689' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T16:33:16.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:15 smithi081 ceph-mon[28640]: from='mgr.14100 172.21.15.81:0/3190895689' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-03T16:33:16.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:15 smithi081 ceph-mon[28640]: Manager daemon x is now available 2024-05-03T16:33:16.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:15 smithi081 ceph-mon[28640]: from='mgr.14100 172.21.15.81:0/3190895689' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-03T16:33:16.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:15 smithi081 ceph-mon[28640]: from='mgr.14100 172.21.15.81:0/3190895689' entity='mgr.x' 2024-05-03T16:33:16.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:15 smithi081 ceph-mon[28640]: from='mgr.14100 172.21.15.81:0/3190895689' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-03T16:33:16.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:15 smithi081 ceph-mon[28640]: from='mgr.14100 172.21.15.81:0/3190895689' entity='mgr.x' 2024-05-03T16:33:17.200 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:16 smithi081 ceph-mon[28640]: from='mgr.14100 172.21.15.81:0/3190895689' entity='mgr.x' 2024-05-03T16:33:17.200 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:16 smithi081 ceph-mon[28640]: mgrmap e3: x(active, since 1.02186s) 2024-05-03T16:33:18.135 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:17 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/713511813' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-03T16:33:18.429 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-03T16:33:18.429 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-05-03T16:33:18.429 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "8988869e-096a-11ef-bc97-c7b262605968", 2024-05-03T16:33:18.429 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-05-03T16:33:18.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-03T16:33:18.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-03T16:33:18.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-03T16:33:18.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:18.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-03T16:33:18.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-03T16:33:18.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-05-03T16:33:18.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-03T16:33:18.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-03T16:33:18.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "a" 2024-05-03T16:33:18.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-03T16:33:18.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-05-03T16:33:18.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-03T16:33:18.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T16:33:18.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-03T16:33:18.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-03T16:33:18.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:18.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-03T16:33:18.433 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T16:33:18.433 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-03T16:33:18.433 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-03T16:33:18.433 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-03T16:33:18.442 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-03T16:33:18.442 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-03T16:33:18.442 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-03T16:33:18.442 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:18.442 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-03T16:33:18.442 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-03T16:33:18.442 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-03T16:33:18.442 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-03T16:33:18.442 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-03T16:33:18.442 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-03T16:33:18.442 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-03T16:33:18.442 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-03T16:33:18.442 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-03T16:33:18.443 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:18.443 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-03T16:33:18.443 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T16:33:18.443 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-03T16:33:18.443 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-03T16:33:18.443 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:18.443 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-03T16:33:18.443 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-03T16:33:18.443 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-03T16:33:18.443 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-03T16:33:18.443 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-03T16:33:18.443 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-03T16:33:18.444 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-05-03T16:33:18.444 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-03T16:33:18.444 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T16:33:18.444 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:18.444 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-03T16:33:18.444 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T16:33:18.444 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-05-03T16:32:56.440988+0000", 2024-05-03T16:33:18.444 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T16:33:18.444 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-03T16:33:18.444 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-03T16:33:18.444 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-05-03T16:33:18.444 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.523+0000 7f0c73600700 1 Processor -- start 2024-05-03T16:33:18.444 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.523+0000 7f0c73600700 1 -- start start 2024-05-03T16:33:18.444 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.524+0000 7f0c73600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c109800 0x7f0c6c10bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:18.444 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.524+0000 7f0c73600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c07ce60 con 0x7f0c6c109800 2024-05-03T16:33:18.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.524+0000 7f0c70c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c109800 0x7f0c6c10bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:18.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.524+0000 7f0c70c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c109800 0x7f0c6c10bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58998/0 (socket says 172.21.15.81:58998) 2024-05-03T16:33:18.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.524+0000 7f0c70c00700 1 -- 172.21.15.81:0/2783000450 learned_addr learned my addr 172.21.15.81:0/2783000450 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:18.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.525+0000 7f0c70c00700 1 -- 172.21.15.81:0/2783000450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6c10c130 con 0x7f0c6c109800 2024-05-03T16:33:18.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.525+0000 7f0c70c00700 1 --2- 172.21.15.81:0/2783000450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c109800 0x7f0c6c10bbf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0c600098a0 tx=0x7f0c60009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546ca8f101dd85dc server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:18.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.525+0000 7f0c6b400700 1 -- 172.21.15.81:0/2783000450 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c60004160 con 0x7f0c6c109800 2024-05-03T16:33:18.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.525+0000 7f0c6b400700 1 -- 172.21.15.81:0/2783000450 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f0c60004300 con 0x7f0c6c109800 2024-05-03T16:33:18.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.525+0000 7f0c6b400700 1 -- 172.21.15.81:0/2783000450 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c600119e0 con 0x7f0c6c109800 2024-05-03T16:33:18.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.526+0000 7f0c73600700 1 -- 172.21.15.81:0/2783000450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c109800 msgr2=0x7f0c6c10bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:18.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.526+0000 7f0c73600700 1 --2- 172.21.15.81:0/2783000450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c109800 0x7f0c6c10bbf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0c600098a0 tx=0x7f0c60009bb0 comp rx=0 tx=0).stop 2024-05-03T16:33:18.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.526+0000 7f0c73600700 1 -- 172.21.15.81:0/2783000450 shutdown_connections 2024-05-03T16:33:18.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.526+0000 7f0c73600700 1 --2- 172.21.15.81:0/2783000450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c109800 0x7f0c6c10bbf0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:18.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.526+0000 7f0c73600700 1 -- 172.21.15.81:0/2783000450 >> 172.21.15.81:0/2783000450 conn(0x7f0c6c1031d0 msgr2=0x7f0c6c105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:18.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.526+0000 7f0c73600700 1 -- 172.21.15.81:0/2783000450 shutdown_connections 2024-05-03T16:33:18.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.526+0000 7f0c73600700 1 -- 172.21.15.81:0/2783000450 wait complete. 2024-05-03T16:33:18.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.527+0000 7f0c73600700 1 Processor -- start 2024-05-03T16:33:18.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.527+0000 7f0c73600700 1 -- start start 2024-05-03T16:33:18.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.528+0000 7f0c73600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c109800 0x7f0c6c19cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:18.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.528+0000 7f0c73600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c10cfd0 con 0x7f0c6c109800 2024-05-03T16:33:18.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.528+0000 7f0c70c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c109800 0x7f0c6c19cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:18.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.528+0000 7f0c70c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c109800 0x7f0c6c19cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59008/0 (socket says 172.21.15.81:59008) 2024-05-03T16:33:18.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.528+0000 7f0c70c00700 1 -- 172.21.15.81:0/713511813 learned_addr learned my addr 172.21.15.81:0/713511813 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:18.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.528+0000 7f0c70c00700 1 -- 172.21.15.81:0/713511813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6c19d020 con 0x7f0c6c109800 2024-05-03T16:33:18.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.529+0000 7f0c70c00700 1 --2- 172.21.15.81:0/713511813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c109800 0x7f0c6c19cae0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0c600116a0 tx=0x7f0c600046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:18.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.529+0000 7f0c69600700 1 -- 172.21.15.81:0/713511813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c60003b70 con 0x7f0c6c109800 2024-05-03T16:33:18.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.529+0000 7f0c69600700 1 -- 172.21.15.81:0/713511813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f0c6001a8a0 con 0x7f0c6c109800 2024-05-03T16:33:18.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.529+0000 7f0c73600700 1 -- 172.21.15.81:0/713511813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6c19d2b0 con 0x7f0c6c109800 2024-05-03T16:33:18.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.529+0000 7f0c69600700 1 -- 172.21.15.81:0/713511813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c60024890 con 0x7f0c6c109800 2024-05-03T16:33:18.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.529+0000 7f0c73600700 1 -- 172.21.15.81:0/713511813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c6c19ffa0 con 0x7f0c6c109800 2024-05-03T16:33:18.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.530+0000 7f0c73600700 1 -- 172.21.15.81:0/713511813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c6c064b00 con 0x7f0c6c109800 2024-05-03T16:33:18.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.530+0000 7f0c69600700 1 -- 172.21.15.81:0/713511813 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 3) ==== 50105+0+0 (secure 0 0 0) 0x7f0c60022020 con 0x7f0c6c109800 2024-05-03T16:33:18.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.531+0000 7f0c69600700 1 --2- 172.21.15.81:0/713511813 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f0c5403e350 0x7f0c54040810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:18.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.531+0000 7f0c69600700 1 -- 172.21.15.81:0/713511813 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0c600534d0 con 0x7f0c6c109800 2024-05-03T16:33:18.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.531+0000 7f0c6be00700 1 --2- 172.21.15.81:0/713511813 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f0c5403e350 0x7f0c54040810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:18.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.532+0000 7f0c6be00700 1 --2- 172.21.15.81:0/713511813 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f0c5403e350 0x7f0c54040810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0c58006fd0 tx=0x7f0c58006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:18.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.538+0000 7f0c69600700 1 -- 172.21.15.81:0/713511813 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0c600212c0 con 0x7f0c6c109800 2024-05-03T16:33:18.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.836+0000 7f0c73600700 1 -- 172.21.15.81:0/713511813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0c6c1a0170 con 0x7f0c6c109800 2024-05-03T16:33:18.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.836+0000 7f0c69600700 1 -- 172.21.15.81:0/713511813 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f0c6c1a0170 con 0x7f0c6c109800 2024-05-03T16:33:18.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.839+0000 7f0c73600700 1 -- 172.21.15.81:0/713511813 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f0c5403e350 msgr2=0x7f0c54040810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:18.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.839+0000 7f0c73600700 1 --2- 172.21.15.81:0/713511813 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f0c5403e350 0x7f0c54040810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0c58006fd0 tx=0x7f0c58006e40 comp rx=0 tx=0).stop 2024-05-03T16:33:18.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.839+0000 7f0c73600700 1 -- 172.21.15.81:0/713511813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c109800 msgr2=0x7f0c6c19cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:18.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.839+0000 7f0c73600700 1 --2- 172.21.15.81:0/713511813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c109800 0x7f0c6c19cae0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0c600116a0 tx=0x7f0c600046a0 comp rx=0 tx=0).stop 2024-05-03T16:33:18.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.839+0000 7f0c73600700 1 -- 172.21.15.81:0/713511813 shutdown_connections 2024-05-03T16:33:18.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.839+0000 7f0c73600700 1 --2- 172.21.15.81:0/713511813 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f0c5403e350 0x7f0c54040810 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:18.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.839+0000 7f0c73600700 1 --2- 172.21.15.81:0/713511813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c109800 0x7f0c6c19cae0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:18.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.839+0000 7f0c73600700 1 -- 172.21.15.81:0/713511813 >> 172.21.15.81:0/713511813 conn(0x7f0c6c1031d0 msgr2=0x7f0c6c103c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:18.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.839+0000 7f0c73600700 1 -- 172.21.15.81:0/713511813 shutdown_connections 2024-05-03T16:33:18.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:17.840+0000 7f0c73600700 1 -- 172.21.15.81:0/713511813 wait complete. 2024-05-03T16:33:18.448 INFO:teuthology.orchestra.run.smithi081.stdout:mgr is available 2024-05-03T16:33:19.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:18 smithi081 ceph-mon[28640]: mgrmap e4: x(active, since 2s) 2024-05-03T16:33:19.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:19 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1486480761' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-03T16:33:20.039 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-03T16:33:20.039 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [global] 2024-05-03T16:33:20.039 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout fsid = 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:33:20.039 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-03T16:33:20.039 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-03T16:33:20.039 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-03T16:33:20.039 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-03T16:33:20.039 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-03T16:33:20.039 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-03T16:33:20.039 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-03T16:33:20.039 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-03T16:33:20.040 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-03T16:33:20.040 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [osd] 2024-05-03T16:33:20.040 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-03T16:33:20.040 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-03T16:33:20.040 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-03T16:33:20.040 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-03T16:33:20.040 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-03T16:33:20.040 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.079+0000 7fcd35a00700 1 Processor -- start 2024-05-03T16:33:20.040 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.079+0000 7fcd35a00700 1 -- start start 2024-05-03T16:33:20.040 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.080+0000 7fcd35a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd3010af10 0x7fcd3010b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:20.040 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.080+0000 7fcd35a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3010b870 con 0x7fcd3010af10 2024-05-03T16:33:20.040 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.080+0000 7fcd2ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd3010af10 0x7fcd3010b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:20.040 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.080+0000 7fcd2ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd3010af10 0x7fcd3010b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59018/0 (socket says 172.21.15.81:59018) 2024-05-03T16:33:20.040 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.080+0000 7fcd2ea00700 1 -- 172.21.15.81:0/2748911714 learned_addr learned my addr 172.21.15.81:0/2748911714 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:20.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.081+0000 7fcd2ea00700 1 -- 172.21.15.81:0/2748911714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3010c070 con 0x7fcd3010af10 2024-05-03T16:33:20.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.081+0000 7fcd2ea00700 1 --2- 172.21.15.81:0/2748911714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd3010af10 0x7fcd3010b330 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcd200098a0 tx=0x7fcd20009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80425e46096f6157 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:20.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.081+0000 7fcd2d600700 1 -- 172.21.15.81:0/2748911714 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd20004160 con 0x7fcd3010af10 2024-05-03T16:33:20.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.081+0000 7fcd2d600700 1 -- 172.21.15.81:0/2748911714 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fcd20004300 con 0x7fcd3010af10 2024-05-03T16:33:20.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.081+0000 7fcd2d600700 1 -- 172.21.15.81:0/2748911714 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd200119e0 con 0x7fcd3010af10 2024-05-03T16:33:20.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.082+0000 7fcd35a00700 1 -- 172.21.15.81:0/2748911714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd3010af10 msgr2=0x7fcd3010b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:20.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.082+0000 7fcd35a00700 1 --2- 172.21.15.81:0/2748911714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd3010af10 0x7fcd3010b330 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcd200098a0 tx=0x7fcd20009bb0 comp rx=0 tx=0).stop 2024-05-03T16:33:20.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.082+0000 7fcd35a00700 1 -- 172.21.15.81:0/2748911714 shutdown_connections 2024-05-03T16:33:20.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.082+0000 7fcd35a00700 1 --2- 172.21.15.81:0/2748911714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd3010af10 0x7fcd3010b330 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:20.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.082+0000 7fcd35a00700 1 -- 172.21.15.81:0/2748911714 >> 172.21.15.81:0/2748911714 conn(0x7fcd3007e300 msgr2=0x7fcd3007e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:20.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.082+0000 7fcd35a00700 1 -- 172.21.15.81:0/2748911714 shutdown_connections 2024-05-03T16:33:20.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.082+0000 7fcd35a00700 1 -- 172.21.15.81:0/2748911714 wait complete. 2024-05-03T16:33:20.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.084+0000 7fcd35a00700 1 Processor -- start 2024-05-03T16:33:20.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.084+0000 7fcd35a00700 1 -- start start 2024-05-03T16:33:20.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.084+0000 7fcd35a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd3010af10 0x7fcd3019ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:20.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.084+0000 7fcd35a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3010f330 con 0x7fcd3010af10 2024-05-03T16:33:20.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.085+0000 7fcd2ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd3010af10 0x7fcd3019ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:20.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.085+0000 7fcd2ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd3010af10 0x7fcd3019ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59022/0 (socket says 172.21.15.81:59022) 2024-05-03T16:33:20.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.085+0000 7fcd2ea00700 1 -- 172.21.15.81:0/1486480761 learned_addr learned my addr 172.21.15.81:0/1486480761 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:20.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.085+0000 7fcd2ea00700 1 -- 172.21.15.81:0/1486480761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3019f250 con 0x7fcd3010af10 2024-05-03T16:33:20.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.085+0000 7fcd2ea00700 1 --2- 172.21.15.81:0/1486480761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd3010af10 0x7fcd3019ed10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcd200116a0 tx=0x7fcd200046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:20.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.085+0000 7fcd27400700 1 -- 172.21.15.81:0/1486480761 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd20003b70 con 0x7fcd3010af10 2024-05-03T16:33:20.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.085+0000 7fcd27400700 1 -- 172.21.15.81:0/1486480761 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fcd2001a8a0 con 0x7fcd3010af10 2024-05-03T16:33:20.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.085+0000 7fcd27400700 1 -- 172.21.15.81:0/1486480761 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd20024890 con 0x7fcd3010af10 2024-05-03T16:33:20.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.085+0000 7fcd35a00700 1 -- 172.21.15.81:0/1486480761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd3019f4e0 con 0x7fcd3010af10 2024-05-03T16:33:20.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.086+0000 7fcd35a00700 1 -- 172.21.15.81:0/1486480761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd301a2180 con 0x7fcd3010af10 2024-05-03T16:33:20.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.087+0000 7fcd27400700 1 -- 172.21.15.81:0/1486480761 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7fcd20022020 con 0x7fcd3010af10 2024-05-03T16:33:20.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.087+0000 7fcd35a00700 1 -- 172.21.15.81:0/1486480761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd30064b00 con 0x7fcd3010af10 2024-05-03T16:33:20.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.087+0000 7fcd27400700 1 --2- 172.21.15.81:0/1486480761 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7fcd1403e470 0x7fcd14040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:20.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.087+0000 7fcd27400700 1 -- 172.21.15.81:0/1486480761 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcd20053700 con 0x7fcd3010af10 2024-05-03T16:33:20.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.088+0000 7fcd2e000700 1 --2- 172.21.15.81:0/1486480761 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7fcd1403e470 0x7fcd14040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:20.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.088+0000 7fcd2e000700 1 --2- 172.21.15.81:0/1486480761 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7fcd1403e470 0x7fcd14040930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c006fd0 tx=0x7fcd1c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:20.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.093+0000 7fcd27400700 1 -- 172.21.15.81:0/1486480761 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fcd200212c0 con 0x7fcd3010af10 2024-05-03T16:33:20.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.327+0000 7fcd35a00700 1 -- 172.21.15.81:0/1486480761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fcd301a2350 con 0x7fcd3010af10 2024-05-03T16:33:20.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.328+0000 7fcd27400700 1 -- 172.21.15.81:0/1486480761 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+409 (secure 0 0 0) 0x7fcd301a2350 con 0x7fcd3010af10 2024-05-03T16:33:20.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.331+0000 7fcd35a00700 1 -- 172.21.15.81:0/1486480761 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7fcd1403e470 msgr2=0x7fcd14040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:20.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.331+0000 7fcd35a00700 1 --2- 172.21.15.81:0/1486480761 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7fcd1403e470 0x7fcd14040930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c006fd0 tx=0x7fcd1c006e40 comp rx=0 tx=0).stop 2024-05-03T16:33:20.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.331+0000 7fcd35a00700 1 -- 172.21.15.81:0/1486480761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd3010af10 msgr2=0x7fcd3019ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:20.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.331+0000 7fcd35a00700 1 --2- 172.21.15.81:0/1486480761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd3010af10 0x7fcd3019ed10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcd200116a0 tx=0x7fcd200046a0 comp rx=0 tx=0).stop 2024-05-03T16:33:20.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.332+0000 7fcd35a00700 1 -- 172.21.15.81:0/1486480761 shutdown_connections 2024-05-03T16:33:20.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.332+0000 7fcd35a00700 1 --2- 172.21.15.81:0/1486480761 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7fcd1403e470 0x7fcd14040930 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:20.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.332+0000 7fcd35a00700 1 --2- 172.21.15.81:0/1486480761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd3010af10 0x7fcd3019ed10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:20.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.332+0000 7fcd35a00700 1 -- 172.21.15.81:0/1486480761 >> 172.21.15.81:0/1486480761 conn(0x7fcd3007e300 msgr2=0x7fcd301083b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:20.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.332+0000 7fcd35a00700 1 -- 172.21.15.81:0/1486480761 shutdown_connections 2024-05-03T16:33:20.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:19.332+0000 7fcd35a00700 1 -- 172.21.15.81:0/1486480761 wait complete. 2024-05-03T16:33:20.044 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling cephadm module... 2024-05-03T16:33:21.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:21 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1002747805' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-03T16:33:21.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:21 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: ignoring --setuser ceph since I am not root 2024-05-03T16:33:21.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:21 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: ignoring --setgroup ceph since I am not root 2024-05-03T16:33:21.616 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:21 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:21.342+0000 7fc15e154200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-03T16:33:21.616 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:21 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:21.582+0000 7fc15e154200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-03T16:33:21.870 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:21 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:21.709+0000 7fc15e154200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-03T16:33:21.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.672+0000 7ff706200700 1 Processor -- start 2024-05-03T16:33:21.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.672+0000 7ff706200700 1 -- start start 2024-05-03T16:33:21.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.672+0000 7ff706200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff700108d10 0x7ff700109130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:21.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.672+0000 7ff706200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff700109700 con 0x7ff700108d10 2024-05-03T16:33:21.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.673+0000 7ff6ff400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff700108d10 0x7ff700109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:21.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.673+0000 7ff6ff400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff700108d10 0x7ff700109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59032/0 (socket says 172.21.15.81:59032) 2024-05-03T16:33:21.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.673+0000 7ff6ff400700 1 -- 172.21.15.81:0/3216558153 learned_addr learned my addr 172.21.15.81:0/3216558153 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:21.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.673+0000 7ff6ff400700 1 -- 172.21.15.81:0/3216558153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff700109f10 con 0x7ff700108d10 2024-05-03T16:33:21.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.674+0000 7ff6ff400700 1 --2- 172.21.15.81:0/3216558153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff700108d10 0x7ff700109130 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00098a0 tx=0x7ff6f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bacc95a8b03e54 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:21.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.674+0000 7ff6fe000700 1 -- 172.21.15.81:0/3216558153 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6f0004160 con 0x7ff700108d10 2024-05-03T16:33:21.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.674+0000 7ff6fe000700 1 -- 172.21.15.81:0/3216558153 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7ff6f0004300 con 0x7ff700108d10 2024-05-03T16:33:21.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.674+0000 7ff6fe000700 1 -- 172.21.15.81:0/3216558153 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6f00119e0 con 0x7ff700108d10 2024-05-03T16:33:21.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.675+0000 7ff706200700 1 -- 172.21.15.81:0/3216558153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff700108d10 msgr2=0x7ff700109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:21.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.675+0000 7ff706200700 1 --2- 172.21.15.81:0/3216558153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff700108d10 0x7ff700109130 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00098a0 tx=0x7ff6f0009bb0 comp rx=0 tx=0).stop 2024-05-03T16:33:21.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.675+0000 7ff706200700 1 -- 172.21.15.81:0/3216558153 shutdown_connections 2024-05-03T16:33:21.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.675+0000 7ff706200700 1 --2- 172.21.15.81:0/3216558153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff700108d10 0x7ff700109130 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:21.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.675+0000 7ff706200700 1 -- 172.21.15.81:0/3216558153 >> 172.21.15.81:0/3216558153 conn(0x7ff7001042d0 msgr2=0x7ff7001066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:21.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.675+0000 7ff706200700 1 -- 172.21.15.81:0/3216558153 shutdown_connections 2024-05-03T16:33:21.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.675+0000 7ff706200700 1 -- 172.21.15.81:0/3216558153 wait complete. 2024-05-03T16:33:21.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.676+0000 7ff706200700 1 Processor -- start 2024-05-03T16:33:21.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.676+0000 7ff706200700 1 -- start start 2024-05-03T16:33:21.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.677+0000 7ff706200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff700108d10 0x7ff70019ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:21.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.677+0000 7ff706200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff70010d140 con 0x7ff700108d10 2024-05-03T16:33:21.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.677+0000 7ff6ff400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff700108d10 0x7ff70019ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:21.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.677+0000 7ff6ff400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff700108d10 0x7ff70019ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59046/0 (socket says 172.21.15.81:59046) 2024-05-03T16:33:21.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.677+0000 7ff6ff400700 1 -- 172.21.15.81:0/1002747805 learned_addr learned my addr 172.21.15.81:0/1002747805 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:21.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.677+0000 7ff6ff400700 1 -- 172.21.15.81:0/1002747805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70019f270 con 0x7ff700108d10 2024-05-03T16:33:21.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.678+0000 7ff6ff400700 1 --2- 172.21.15.81:0/1002747805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff700108d10 0x7ff70019ed30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00119b0 tx=0x7ff6f0011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:21.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.678+0000 7ff6f7e00700 1 -- 172.21.15.81:0/1002747805 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6f0003b70 con 0x7ff700108d10 2024-05-03T16:33:21.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.678+0000 7ff6f7e00700 1 -- 172.21.15.81:0/1002747805 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7ff6f001a8a0 con 0x7ff700108d10 2024-05-03T16:33:21.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.678+0000 7ff706200700 1 -- 172.21.15.81:0/1002747805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff70019f500 con 0x7ff700108d10 2024-05-03T16:33:21.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.678+0000 7ff6f7e00700 1 -- 172.21.15.81:0/1002747805 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6f0024830 con 0x7ff700108d10 2024-05-03T16:33:21.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.678+0000 7ff706200700 1 -- 172.21.15.81:0/1002747805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7001a21f0 con 0x7ff700108d10 2024-05-03T16:33:21.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.679+0000 7ff706200700 1 -- 172.21.15.81:0/1002747805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff70010d2c0 con 0x7ff700108d10 2024-05-03T16:33:21.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.680+0000 7ff6f7e00700 1 -- 172.21.15.81:0/1002747805 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7ff6f0022020 con 0x7ff700108d10 2024-05-03T16:33:21.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.680+0000 7ff6f7e00700 1 --2- 172.21.15.81:0/1002747805 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7ff6e403e420 0x7ff6e40408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:21.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.680+0000 7ff6f7e00700 1 -- 172.21.15.81:0/1002747805 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff6f0053630 con 0x7ff700108d10 2024-05-03T16:33:21.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.680+0000 7ff6fea00700 1 --2- 172.21.15.81:0/1002747805 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7ff6e403e420 0x7ff6e40408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:21.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.681+0000 7ff6fea00700 1 --2- 172.21.15.81:0/1002747805 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7ff6e403e420 0x7ff6e40408e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec006fd0 tx=0x7ff6ec006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:21.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.685+0000 7ff6f7e00700 1 -- 172.21.15.81:0/1002747805 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff6f00212c0 con 0x7ff700108d10 2024-05-03T16:33:21.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:20.974+0000 7ff706200700 1 -- 172.21.15.81:0/1002747805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7ff7001a2840 con 0x7ff700108d10 2024-05-03T16:33:21.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:21.028+0000 7ff6f7e00700 1 -- 172.21.15.81:0/1002747805 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7ff6f0053390 con 0x7ff700108d10 2024-05-03T16:33:21.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:21.031+0000 7ff706200700 1 -- 172.21.15.81:0/1002747805 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7ff6e403e420 msgr2=0x7ff6e40408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:21.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:21.031+0000 7ff706200700 1 --2- 172.21.15.81:0/1002747805 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7ff6e403e420 0x7ff6e40408e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec006fd0 tx=0x7ff6ec006e40 comp rx=0 tx=0).stop 2024-05-03T16:33:21.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:21.031+0000 7ff706200700 1 -- 172.21.15.81:0/1002747805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff700108d10 msgr2=0x7ff70019ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:21.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:21.032+0000 7ff6f7e00700 1 -- 172.21.15.81:0/1002747805 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7ff6f000f2e0 con 0x7ff700108d10 2024-05-03T16:33:21.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:21.032+0000 7ff706200700 1 --2- 172.21.15.81:0/1002747805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff700108d10 0x7ff70019ed30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00119b0 tx=0x7ff6f0011a90 comp rx=0 tx=0).stop 2024-05-03T16:33:21.886 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:21.033+0000 7ff706200700 1 -- 172.21.15.81:0/1002747805 shutdown_connections 2024-05-03T16:33:21.886 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:21.033+0000 7ff706200700 1 --2- 172.21.15.81:0/1002747805 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7ff6e403e420 0x7ff6e40408e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:21.886 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:21.033+0000 7ff706200700 1 --2- 172.21.15.81:0/1002747805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff700108d10 0x7ff70019ed30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:21.886 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:21.033+0000 7ff706200700 1 -- 172.21.15.81:0/1002747805 >> 172.21.15.81:0/1002747805 conn(0x7ff7001042d0 msgr2=0x7ff70007d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:21.886 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:21.033+0000 7ff706200700 1 -- 172.21.15.81:0/1002747805 shutdown_connections 2024-05-03T16:33:21.886 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:21.033+0000 7ff706200700 1 -- 172.21.15.81:0/1002747805 wait complete. 2024-05-03T16:33:22.178 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:22 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1002747805' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-03T16:33:22.179 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:22 smithi081 ceph-mon[28640]: mgrmap e5: x(active, since 5s) 2024-05-03T16:33:22.179 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:22 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:22.112+0000 7fc15e154200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-03T16:33:22.487 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:22 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:22.231+0000 7fc15e154200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-03T16:33:23.131 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:23 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/194555986' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-03T16:33:23.385 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-05-03T16:33:23.386 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-03T16:33:23.386 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-03T16:33:23.386 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-03T16:33:23.387 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-03T16:33:23.387 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-05-03T16:33:23.387 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.486+0000 7ff9f0400700 1 Processor -- start 2024-05-03T16:33:23.387 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.486+0000 7ff9f0400700 1 -- start start 2024-05-03T16:33:23.387 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.486+0000 7ff9f0400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e8108d10 0x7ff9e8109130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:23.387 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.486+0000 7ff9f0400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e8109700 con 0x7ff9e8108d10 2024-05-03T16:33:23.387 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.487+0000 7ff9eda00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e8108d10 0x7ff9e8109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:23.388 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.487+0000 7ff9eda00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e8108d10 0x7ff9e8109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59074/0 (socket says 172.21.15.81:59074) 2024-05-03T16:33:23.389 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.487+0000 7ff9eda00700 1 -- 172.21.15.81:0/3407723515 learned_addr learned my addr 172.21.15.81:0/3407723515 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:23.389 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.487+0000 7ff9eda00700 1 -- 172.21.15.81:0/3407723515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e8109f10 con 0x7ff9e8108d10 2024-05-03T16:33:23.389 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.488+0000 7ff9eda00700 1 --2- 172.21.15.81:0/3407723515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e8108d10 0x7ff9e8109130 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0098a0 tx=0x7ff9dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6a5883c20b9e8e server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:23.389 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.488+0000 7ff9e7e00700 1 -- 172.21.15.81:0/3407723515 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9dc004160 con 0x7ff9e8108d10 2024-05-03T16:33:23.389 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.488+0000 7ff9e7e00700 1 -- 172.21.15.81:0/3407723515 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7ff9dc004300 con 0x7ff9e8108d10 2024-05-03T16:33:23.389 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.488+0000 7ff9e7e00700 1 -- 172.21.15.81:0/3407723515 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9dc0119e0 con 0x7ff9e8108d10 2024-05-03T16:33:23.389 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.489+0000 7ff9f0400700 1 -- 172.21.15.81:0/3407723515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e8108d10 msgr2=0x7ff9e8109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:23.389 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.489+0000 7ff9f0400700 1 --2- 172.21.15.81:0/3407723515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e8108d10 0x7ff9e8109130 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0098a0 tx=0x7ff9dc009bb0 comp rx=0 tx=0).stop 2024-05-03T16:33:23.389 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.489+0000 7ff9f0400700 1 -- 172.21.15.81:0/3407723515 shutdown_connections 2024-05-03T16:33:23.391 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.489+0000 7ff9f0400700 1 --2- 172.21.15.81:0/3407723515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e8108d10 0x7ff9e8109130 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:23.391 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.489+0000 7ff9f0400700 1 -- 172.21.15.81:0/3407723515 >> 172.21.15.81:0/3407723515 conn(0x7ff9e81042d0 msgr2=0x7ff9e81066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:23.391 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.489+0000 7ff9f0400700 1 -- 172.21.15.81:0/3407723515 shutdown_connections 2024-05-03T16:33:23.391 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.489+0000 7ff9f0400700 1 -- 172.21.15.81:0/3407723515 wait complete. 2024-05-03T16:33:23.391 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.490+0000 7ff9f0400700 1 Processor -- start 2024-05-03T16:33:23.391 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.490+0000 7ff9f0400700 1 -- start start 2024-05-03T16:33:23.391 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.490+0000 7ff9f0400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e8108d10 0x7ff9e819cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:23.391 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.490+0000 7ff9f0400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e810d140 con 0x7ff9e8108d10 2024-05-03T16:33:23.392 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.490+0000 7ff9eda00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e8108d10 0x7ff9e819cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:23.392 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.491+0000 7ff9eda00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e8108d10 0x7ff9e819cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59084/0 (socket says 172.21.15.81:59084) 2024-05-03T16:33:23.392 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.491+0000 7ff9eda00700 1 -- 172.21.15.81:0/194555986 learned_addr learned my addr 172.21.15.81:0/194555986 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:23.392 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.491+0000 7ff9eda00700 1 -- 172.21.15.81:0/194555986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e819d040 con 0x7ff9e8108d10 2024-05-03T16:33:23.392 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.491+0000 7ff9eda00700 1 --2- 172.21.15.81:0/194555986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e8108d10 0x7ff9e819cb00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc006b20 tx=0x7ff9dc011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:23.392 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.491+0000 7ff9e6000700 1 -- 172.21.15.81:0/194555986 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9dc003a60 con 0x7ff9e8108d10 2024-05-03T16:33:23.393 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.491+0000 7ff9e6000700 1 -- 172.21.15.81:0/194555986 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7ff9dc003c00 con 0x7ff9e8108d10 2024-05-03T16:33:23.393 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.491+0000 7ff9f0400700 1 -- 172.21.15.81:0/194555986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e819d2d0 con 0x7ff9e8108d10 2024-05-03T16:33:23.393 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.492+0000 7ff9e6000700 1 -- 172.21.15.81:0/194555986 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9dc024780 con 0x7ff9e8108d10 2024-05-03T16:33:23.393 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.492+0000 7ff9f0400700 1 -- 172.21.15.81:0/194555986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e819ffc0 con 0x7ff9e8108d10 2024-05-03T16:33:23.394 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.493+0000 7ff9f0400700 1 -- 172.21.15.81:0/194555986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e810d2c0 con 0x7ff9e8108d10 2024-05-03T16:33:23.394 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.493+0000 7ff9e6000700 1 -- 172.21.15.81:0/194555986 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7ff9dc022020 con 0x7ff9e8108d10 2024-05-03T16:33:23.395 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.493+0000 7ff9e6000700 1 --2- 172.21.15.81:0/194555986 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7ff9d003e470 0x7ff9d0040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:23.395 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.493+0000 7ff9e6000700 1 -- 172.21.15.81:0/194555986 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff9dc0537a0 con 0x7ff9e8108d10 2024-05-03T16:33:23.395 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.494+0000 7ff9ed000700 1 -- 172.21.15.81:0/194555986 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7ff9d003e470 msgr2=0x7ff9d0040930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2256692598 2024-05-03T16:33:23.395 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.494+0000 7ff9ed000700 1 --2- 172.21.15.81:0/194555986 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7ff9d003e470 0x7ff9d0040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-03T16:33:23.395 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.499+0000 7ff9e6000700 1 -- 172.21.15.81:0/194555986 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff9dc0212c0 con 0x7ff9e8108d10 2024-05-03T16:33:23.395 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.695+0000 7ff9ed000700 1 -- 172.21.15.81:0/194555986 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7ff9d003e470 msgr2=0x7ff9d0040930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2256692598 2024-05-03T16:33:23.395 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.695+0000 7ff9ed000700 1 --2- 172.21.15.81:0/194555986 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7ff9d003e470 0x7ff9d0040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-03T16:33:23.395 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.827+0000 7ff9f0400700 1 -- 172.21.15.81:0/194555986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7ff9e81a0610 con 0x7ff9e8108d10 2024-05-03T16:33:23.396 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.828+0000 7ff9e6000700 1 -- 172.21.15.81:0/194555986 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7ff9dc053480 con 0x7ff9e8108d10 2024-05-03T16:33:23.397 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.830+0000 7ff9f0400700 1 -- 172.21.15.81:0/194555986 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7ff9d003e470 msgr2=0x7ff9d0040930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-03T16:33:23.397 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.830+0000 7ff9f0400700 1 --2- 172.21.15.81:0/194555986 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7ff9d003e470 0x7ff9d0040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:23.397 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.830+0000 7ff9f0400700 1 -- 172.21.15.81:0/194555986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e8108d10 msgr2=0x7ff9e819cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:23.397 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.830+0000 7ff9f0400700 1 --2- 172.21.15.81:0/194555986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e8108d10 0x7ff9e819cb00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc006b20 tx=0x7ff9dc011a60 comp rx=0 tx=0).stop 2024-05-03T16:33:23.398 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.830+0000 7ff9f0400700 1 -- 172.21.15.81:0/194555986 shutdown_connections 2024-05-03T16:33:23.398 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.830+0000 7ff9f0400700 1 --2- 172.21.15.81:0/194555986 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7ff9d003e470 0x7ff9d0040930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:23.398 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.830+0000 7ff9f0400700 1 --2- 172.21.15.81:0/194555986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9e8108d10 0x7ff9e819cb00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:23.398 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.830+0000 7ff9f0400700 1 -- 172.21.15.81:0/194555986 >> 172.21.15.81:0/194555986 conn(0x7ff9e81042d0 msgr2=0x7ff9e8104cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:23.398 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.830+0000 7ff9f0400700 1 -- 172.21.15.81:0/194555986 shutdown_connections 2024-05-03T16:33:23.398 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:22.831+0000 7ff9f0400700 1 -- 172.21.15.81:0/194555986 wait complete. 2024-05-03T16:33:23.398 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for the mgr to restart... 2024-05-03T16:33:23.398 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr epoch 5... 2024-05-03T16:33:23.975 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:23 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:23.811+0000 7fc15e154200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-03T16:33:24.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:24 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:24.047+0000 7fc15e154200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-03T16:33:24.586 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:24 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:24.260+0000 7fc15e154200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-03T16:33:24.990 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:24 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:24.636+0000 7fc15e154200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-03T16:33:24.990 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:24 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:24.758+0000 7fc15e154200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-03T16:33:25.263 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:25 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:25.009+0000 7fc15e154200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-03T16:33:25.263 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:25 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:25.261+0000 7fc15e154200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-03T16:33:26.322 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:26 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:26.038+0000 7fc15e154200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-03T16:33:26.322 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:26 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:26.320+0000 7fc15e154200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-03T16:33:26.989 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:26 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:26.894+0000 7fc15e154200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-03T16:33:27.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:27 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:27.024+0000 7fc15e154200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-03T16:33:27.870 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:27 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:27.497+0000 7fc15e154200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-03T16:33:28.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:27 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:27.958+0000 7fc15e154200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-03T16:33:28.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:28 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:28.080+0000 7fc15e154200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-03T16:33:28.740 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:28 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:28.398+0000 7fc15e154200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-03T16:33:28.741 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:28 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:28.576+0000 7fc15e154200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-03T16:33:29.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:28 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:28.962+0000 7fc15e154200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-03T16:33:29.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:29 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:29.113+0000 7fc15e154200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-03T16:33:29.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:29 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:29.238+0000 7fc15e154200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-03T16:33:30.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:29 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:29.984+0000 7fc15e154200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-03T16:33:30.740 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:30 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:30.270+0000 7fc15e154200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-03T16:33:30.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:30 smithi081 ceph-mon[28640]: Active manager daemon x restarted 2024-05-03T16:33:30.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:30 smithi081 ceph-mon[28640]: Activating manager daemon x 2024-05-03T16:33:30.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:30 smithi081 ceph-mon[28640]: osdmap e2: 0 total, 0 up, 0 in 2024-05-03T16:33:30.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:30 smithi081 ceph-mon[28640]: mgrmap e6: x(active, starting, since 0.00647244s) 2024-05-03T16:33:30.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:30 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T16:33:30.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:30 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-03T16:33:30.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:30 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-03T16:33:30.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:30 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-03T16:33:30.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:30 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-03T16:33:30.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:30 smithi081 ceph-mon[28640]: Manager daemon x is now available 2024-05-03T16:33:30.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:30 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' 2024-05-03T16:33:31.653 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:31 smithi081 ceph-mon[28640]: Found migration_current of "None". Setting to last migration. 2024-05-03T16:33:31.653 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:31 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' 2024-05-03T16:33:31.653 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:31 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:33:31.653 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:31 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:33:31.653 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:31 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-03T16:33:31.653 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:31 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-03T16:33:31.653 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:31 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' 2024-05-03T16:33:31.653 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:31 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' 2024-05-03T16:33:31.653 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:31 smithi081 ceph-mon[28640]: [03/May/2024:16:33:30] ENGINE Bus STARTING 2024-05-03T16:33:31.653 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:31 smithi081 ceph-mon[28640]: [03/May/2024:16:33:31] ENGINE Serving on https://172.21.15.81:7150 2024-05-03T16:33:31.653 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:31 smithi081 ceph-mon[28640]: [03/May/2024:16:33:31] ENGINE Serving on http://172.21.15.81:8765 2024-05-03T16:33:31.653 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:31 smithi081 ceph-mon[28640]: [03/May/2024:16:33:31] ENGINE Bus STARTED 2024-05-03T16:33:31.654 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:31 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:33:31.654 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:31 smithi081 ceph-mon[28640]: mgrmap e7: x(active, since 1.01707s) 2024-05-03T16:33:31.950 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-05-03T16:33:31.950 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-03T16:33:31.950 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-03T16:33:31.951 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-05-03T16:33:31.953 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.973+0000 7f9395000700 1 Processor -- start 2024-05-03T16:33:31.953 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.974+0000 7f9395000700 1 -- start start 2024-05-03T16:33:31.953 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.974+0000 7f9395000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93901075a0 0x7f93901099d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:31.953 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.974+0000 7f9395000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f939007cec0 con 0x7f93901075a0 2024-05-03T16:33:31.953 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.975+0000 7f938de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93901075a0 0x7f93901099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:31.953 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.975+0000 7f938de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93901075a0 0x7f93901099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59086/0 (socket says 172.21.15.81:59086) 2024-05-03T16:33:31.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.975+0000 7f938de00700 1 -- 172.21.15.81:0/953726412 learned_addr learned my addr 172.21.15.81:0/953726412 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:31.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.975+0000 7f938de00700 1 -- 172.21.15.81:0/953726412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9390109f10 con 0x7f93901075a0 2024-05-03T16:33:31.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.976+0000 7f938de00700 1 --2- 172.21.15.81:0/953726412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93901075a0 0x7f93901099d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f93800098a0 tx=0x7f9380009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb595596deb5d0a server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:31.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.976+0000 7f938ca00700 1 -- 172.21.15.81:0/953726412 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9380004160 con 0x7f93901075a0 2024-05-03T16:33:31.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.976+0000 7f938ca00700 1 -- 172.21.15.81:0/953726412 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f9380004300 con 0x7f93901075a0 2024-05-03T16:33:31.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.976+0000 7f938ca00700 1 -- 172.21.15.81:0/953726412 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93800119e0 con 0x7f93901075a0 2024-05-03T16:33:31.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.977+0000 7f9395000700 1 -- 172.21.15.81:0/953726412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93901075a0 msgr2=0x7f93901099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:31.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.977+0000 7f9395000700 1 --2- 172.21.15.81:0/953726412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93901075a0 0x7f93901099d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f93800098a0 tx=0x7f9380009bb0 comp rx=0 tx=0).stop 2024-05-03T16:33:31.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.977+0000 7f9395000700 1 -- 172.21.15.81:0/953726412 shutdown_connections 2024-05-03T16:33:31.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.977+0000 7f9395000700 1 --2- 172.21.15.81:0/953726412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93901075a0 0x7f93901099d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:31.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.977+0000 7f9395000700 1 -- 172.21.15.81:0/953726412 >> 172.21.15.81:0/953726412 conn(0x7f9390103200 msgr2=0x7f9390105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:31.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.977+0000 7f9395000700 1 -- 172.21.15.81:0/953726412 shutdown_connections 2024-05-03T16:33:31.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.977+0000 7f9395000700 1 -- 172.21.15.81:0/953726412 wait complete. 2024-05-03T16:33:31.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.978+0000 7f9395000700 1 Processor -- start 2024-05-03T16:33:31.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.979+0000 7f9395000700 1 -- start start 2024-05-03T16:33:31.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.979+0000 7f9395000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93901075a0 0x7f93901a3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:31.960 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.979+0000 7f9395000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f939010ae70 con 0x7f93901075a0 2024-05-03T16:33:31.960 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.979+0000 7f938de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93901075a0 0x7f93901a3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:31.960 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.979+0000 7f938de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93901075a0 0x7f93901a3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59088/0 (socket says 172.21.15.81:59088) 2024-05-03T16:33:31.960 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.979+0000 7f938de00700 1 -- 172.21.15.81:0/674229035 learned_addr learned my addr 172.21.15.81:0/674229035 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:31.960 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.980+0000 7f938de00700 1 -- 172.21.15.81:0/674229035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93901a3680 con 0x7f93901075a0 2024-05-03T16:33:31.960 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.980+0000 7f938de00700 1 --2- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93901075a0 0x7f93901a3140 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f93800116a0 tx=0x7f93800046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:31.960 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.980+0000 7f9386a00700 1 -- 172.21.15.81:0/674229035 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9380003b70 con 0x7f93901075a0 2024-05-03T16:33:31.960 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.980+0000 7f9386a00700 1 -- 172.21.15.81:0/674229035 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f938001a8a0 con 0x7f93901075a0 2024-05-03T16:33:31.960 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.980+0000 7f9386a00700 1 -- 172.21.15.81:0/674229035 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9380024890 con 0x7f93901075a0 2024-05-03T16:33:31.960 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.980+0000 7f9395000700 1 -- 172.21.15.81:0/674229035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93901a3910 con 0x7f93901075a0 2024-05-03T16:33:31.960 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.981+0000 7f9395000700 1 -- 172.21.15.81:0/674229035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93901a6600 con 0x7f93901075a0 2024-05-03T16:33:31.960 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.982+0000 7f9386a00700 1 -- 172.21.15.81:0/674229035 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f9380022020 con 0x7f93901075a0 2024-05-03T16:33:31.961 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.982+0000 7f9386a00700 1 --2- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f937403e4c0 0x7f9374040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:31.961 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.982+0000 7f9386a00700 1 -- 172.21.15.81:0/674229035 --> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9374041090 con 0x7f937403e4c0 2024-05-03T16:33:31.961 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.982+0000 7f9386a00700 1 -- 172.21.15.81:0/674229035 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f93800536e0 con 0x7f93901075a0 2024-05-03T16:33:31.961 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.982+0000 7f938d400700 1 -- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f937403e4c0 msgr2=0x7f9374040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2256692598 2024-05-03T16:33:31.961 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:23.982+0000 7f938d400700 1 --2- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f937403e4c0 0x7f9374040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-03T16:33:31.961 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:24.183+0000 7f938d400700 1 -- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f937403e4c0 msgr2=0x7f9374040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2256692598 2024-05-03T16:33:31.961 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:24.183+0000 7f938d400700 1 --2- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f937403e4c0 0x7f9374040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-03T16:33:31.961 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:24.584+0000 7f938d400700 1 -- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f937403e4c0 msgr2=0x7f9374040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2256692598 2024-05-03T16:33:31.961 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:24.584+0000 7f938d400700 1 --2- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f937403e4c0 0x7f9374040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-03T16:33:31.961 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:25.385+0000 7f938d400700 1 -- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f937403e4c0 msgr2=0x7f9374040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2256692598 2024-05-03T16:33:31.961 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:25.385+0000 7f938d400700 1 --2- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f937403e4c0 0x7f9374040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-03T16:33:31.961 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:26.987+0000 7f938d400700 1 -- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f937403e4c0 msgr2=0x7f9374040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2256692598 2024-05-03T16:33:31.961 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:26.987+0000 7f938d400700 1 --2- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f937403e4c0 0x7f9374040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-03T16:33:31.961 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:30.190+0000 7f938d400700 1 -- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f937403e4c0 msgr2=0x7f9374040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2256692598 2024-05-03T16:33:31.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:30.190+0000 7f938d400700 1 --2- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f937403e4c0 0x7f9374040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-03T16:33:31.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:30.278+0000 7f9386a00700 1 -- 172.21.15.81:0/674229035 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mgrmap(e 6) ==== 49989+0+0 (secure 0 0 0) 0x7f938000f2e0 con 0x7f93901075a0 2024-05-03T16:33:31.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:30.279+0000 7f9386a00700 1 -- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f937403e4c0 msgr2=0x7f9374040980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-03T16:33:31.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:30.279+0000 7f9386a00700 1 --2- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f937403e4c0 0x7f9374040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:31.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:31.284+0000 7f9386a00700 1 -- 172.21.15.81:0/674229035 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 7) ==== 50116+0+0 (secure 0 0 0) 0x7f9380055190 con 0x7f93901075a0 2024-05-03T16:33:31.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:31.285+0000 7f9386a00700 1 --2- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f9374041db0 0x7f93740441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:31.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:31.285+0000 7f9386a00700 1 -- 172.21.15.81:0/674229035 --> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f938000fec0 con 0x7f9374041db0 2024-05-03T16:33:31.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:31.287+0000 7f938d400700 1 --2- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f9374041db0 0x7f93740441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:31.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:31.290+0000 7f938d400700 1 --2- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f9374041db0 0x7f93740441a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f937c003a10 tx=0x7f937c0092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:31.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:31.293+0000 7f9386a00700 1 -- 172.21.15.81:0/674229035 <== mgr.14120 v2:172.21.15.81:6800/2734678359 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f938000fec0 con 0x7f9374041db0 2024-05-03T16:33:31.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:31.303+0000 7f9395000700 1 -- 172.21.15.81:0/674229035 --> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f9390064b00 con 0x7f9374041db0 2024-05-03T16:33:31.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:31.303+0000 7f9386a00700 1 -- 172.21.15.81:0/674229035 <== mgr.14120 v2:172.21.15.81:6800/2734678359 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f9390064b00 con 0x7f9374041db0 2024-05-03T16:33:31.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:31.304+0000 7f9395000700 1 -- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f9374041db0 msgr2=0x7f93740441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:31.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:31.304+0000 7f9395000700 1 --2- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f9374041db0 0x7f93740441a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f937c003a10 tx=0x7f937c0092b0 comp rx=0 tx=0).stop 2024-05-03T16:33:31.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:31.304+0000 7f9395000700 1 -- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93901075a0 msgr2=0x7f93901a3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:31.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:31.304+0000 7f9395000700 1 --2- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93901075a0 0x7f93901a3140 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f93800116a0 tx=0x7f93800046a0 comp rx=0 tx=0).stop 2024-05-03T16:33:31.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:31.305+0000 7f9395000700 1 -- 172.21.15.81:0/674229035 shutdown_connections 2024-05-03T16:33:31.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:31.305+0000 7f9395000700 1 --2- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f9374041db0 0x7f93740441a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:31.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:31.305+0000 7f9395000700 1 --2- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93901075a0 0x7f93901a3140 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:31.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:31.305+0000 7f9395000700 1 --2- 172.21.15.81:0/674229035 >> [v2:172.21.15.81:6800/2256692598,v1:172.21.15.81:6801/2256692598] conn(0x7f937403e4c0 0x7f9374040980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:31.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:31.305+0000 7f9395000700 1 -- 172.21.15.81:0/674229035 >> 172.21.15.81:0/674229035 conn(0x7f9390103200 msgr2=0x7f93901055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:31.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:31.305+0000 7f9395000700 1 -- 172.21.15.81:0/674229035 shutdown_connections 2024-05-03T16:33:31.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:31.305+0000 7f9395000700 1 -- 172.21.15.81:0/674229035 wait complete. 2024-05-03T16:33:31.963 INFO:teuthology.orchestra.run.smithi081.stdout:mgr epoch 5 is available 2024-05-03T16:33:31.964 INFO:teuthology.orchestra.run.smithi081.stdout:Setting orchestrator backend to cephadm... 2024-05-03T16:33:32.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:32 smithi081 ceph-mon[28640]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-03T16:33:32.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:32 smithi081 ceph-mon[28640]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-03T16:33:33.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:33 smithi081 ceph-mon[28640]: mgrmap e8: x(active, since 2s) 2024-05-03T16:33:33.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:33 smithi081 ceph-mon[28640]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:33:33.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:33 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' 2024-05-03T16:33:33.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:33 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:33:33.507 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.543+0000 7feffe600700 1 Processor -- start 2024-05-03T16:33:33.508 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.543+0000 7feffe600700 1 -- start start 2024-05-03T16:33:33.508 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.543+0000 7feffe600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feff810af10 0x7feff810b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:33.508 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.543+0000 7feffe600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feff810b870 con 0x7feff810af10 2024-05-03T16:33:33.508 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.544+0000 7feff7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feff810af10 0x7feff810b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:33.508 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.544+0000 7feff7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feff810af10 0x7feff810b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53712/0 (socket says 172.21.15.81:53712) 2024-05-03T16:33:33.508 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.544+0000 7feff7400700 1 -- 172.21.15.81:0/394349429 learned_addr learned my addr 172.21.15.81:0/394349429 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:33.508 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.544+0000 7feff7400700 1 -- 172.21.15.81:0/394349429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff810c070 con 0x7feff810af10 2024-05-03T16:33:33.508 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.544+0000 7feff7400700 1 --2- 172.21.15.81:0/394349429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feff810af10 0x7feff810b330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fefe80098a0 tx=0x7fefe8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e369a9f84e88c517 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:33.510 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.545+0000 7feff6000700 1 -- 172.21.15.81:0/394349429 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefe8004160 con 0x7feff810af10 2024-05-03T16:33:33.510 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.545+0000 7feff6000700 1 -- 172.21.15.81:0/394349429 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fefe8004300 con 0x7feff810af10 2024-05-03T16:33:33.510 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.545+0000 7feff6000700 1 -- 172.21.15.81:0/394349429 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefe80119e0 con 0x7feff810af10 2024-05-03T16:33:33.510 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.546+0000 7feffe600700 1 -- 172.21.15.81:0/394349429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feff810af10 msgr2=0x7feff810b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:33.510 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.546+0000 7feffe600700 1 --2- 172.21.15.81:0/394349429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feff810af10 0x7feff810b330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fefe80098a0 tx=0x7fefe8009bb0 comp rx=0 tx=0).stop 2024-05-03T16:33:33.510 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.546+0000 7feffe600700 1 -- 172.21.15.81:0/394349429 shutdown_connections 2024-05-03T16:33:33.510 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.546+0000 7feffe600700 1 --2- 172.21.15.81:0/394349429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feff810af10 0x7feff810b330 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:33.510 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.546+0000 7feffe600700 1 -- 172.21.15.81:0/394349429 >> 172.21.15.81:0/394349429 conn(0x7feff807e300 msgr2=0x7feff807e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:33.511 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.546+0000 7feffe600700 1 -- 172.21.15.81:0/394349429 shutdown_connections 2024-05-03T16:33:33.511 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.546+0000 7feffe600700 1 -- 172.21.15.81:0/394349429 wait complete. 2024-05-03T16:33:33.511 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.547+0000 7feffe600700 1 Processor -- start 2024-05-03T16:33:33.511 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.547+0000 7feffe600700 1 -- start start 2024-05-03T16:33:33.511 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.547+0000 7feffe600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feff810af10 0x7feff819ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:33.513 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.547+0000 7feffe600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feff810f330 con 0x7feff810af10 2024-05-03T16:33:33.513 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.548+0000 7feff7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feff810af10 0x7feff819ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:33.513 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.548+0000 7feff7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feff810af10 0x7feff819ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53718/0 (socket says 172.21.15.81:53718) 2024-05-03T16:33:33.513 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.548+0000 7feff7400700 1 -- 172.21.15.81:0/1671811457 learned_addr learned my addr 172.21.15.81:0/1671811457 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:33.514 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.548+0000 7feff7400700 1 -- 172.21.15.81:0/1671811457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff819f250 con 0x7feff810af10 2024-05-03T16:33:33.514 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.548+0000 7feff7400700 1 --2- 172.21.15.81:0/1671811457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feff810af10 0x7feff819ed10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fefe80116a0 tx=0x7fefe80046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:33.514 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.549+0000 7fefefe00700 1 -- 172.21.15.81:0/1671811457 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefe8003b70 con 0x7feff810af10 2024-05-03T16:33:33.514 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.549+0000 7fefefe00700 1 -- 172.21.15.81:0/1671811457 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fefe801a8a0 con 0x7feff810af10 2024-05-03T16:33:33.514 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.549+0000 7feffe600700 1 -- 172.21.15.81:0/1671811457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff819f4e0 con 0x7feff810af10 2024-05-03T16:33:33.514 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.549+0000 7fefefe00700 1 -- 172.21.15.81:0/1671811457 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefe8024890 con 0x7feff810af10 2024-05-03T16:33:33.514 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.549+0000 7feffe600700 1 -- 172.21.15.81:0/1671811457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff81a2180 con 0x7feff810af10 2024-05-03T16:33:33.514 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.550+0000 7fefefe00700 1 -- 172.21.15.81:0/1671811457 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fefe8022020 con 0x7feff810af10 2024-05-03T16:33:33.514 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.550+0000 7feffe600700 1 -- 172.21.15.81:0/1671811457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff8064b00 con 0x7feff810af10 2024-05-03T16:33:33.514 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.551+0000 7fefefe00700 1 --2- 172.21.15.81:0/1671811457 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7fefdc03e4c0 0x7fefdc040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:33.514 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.551+0000 7fefefe00700 1 -- 172.21.15.81:0/1671811457 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fefe8053b10 con 0x7feff810af10 2024-05-03T16:33:33.514 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.551+0000 7feff6a00700 1 --2- 172.21.15.81:0/1671811457 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7fefdc03e4c0 0x7fefdc040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:33.514 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.552+0000 7feff6a00700 1 --2- 172.21.15.81:0/1671811457 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7fefdc03e4c0 0x7fefdc040980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fefe0006fd0 tx=0x7fefe0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:33.515 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.557+0000 7fefefe00700 1 -- 172.21.15.81:0/1671811457 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fefe800f2e0 con 0x7feff810af10 2024-05-03T16:33:33.515 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.805+0000 7feffe600700 1 -- 172.21.15.81:0/1671811457 --> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7feff8108ac0 con 0x7fefdc03e4c0 2024-05-03T16:33:33.515 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.815+0000 7fefefe00700 1 -- 172.21.15.81:0/1671811457 <== mgr.14120 v2:172.21.15.81:6800/2734678359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7feff8108ac0 con 0x7fefdc03e4c0 2024-05-03T16:33:33.515 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.818+0000 7feffe600700 1 -- 172.21.15.81:0/1671811457 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7fefdc03e4c0 msgr2=0x7fefdc040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:33.515 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.818+0000 7feffe600700 1 --2- 172.21.15.81:0/1671811457 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7fefdc03e4c0 0x7fefdc040980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fefe0006fd0 tx=0x7fefe0006e40 comp rx=0 tx=0).stop 2024-05-03T16:33:33.515 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.818+0000 7feffe600700 1 -- 172.21.15.81:0/1671811457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feff810af10 msgr2=0x7feff819ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:33.516 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.818+0000 7feffe600700 1 --2- 172.21.15.81:0/1671811457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feff810af10 0x7feff819ed10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fefe80116a0 tx=0x7fefe80046a0 comp rx=0 tx=0).stop 2024-05-03T16:33:33.516 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.818+0000 7feffe600700 1 -- 172.21.15.81:0/1671811457 shutdown_connections 2024-05-03T16:33:33.516 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.818+0000 7feffe600700 1 --2- 172.21.15.81:0/1671811457 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7fefdc03e4c0 0x7fefdc040980 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:33.516 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.818+0000 7feffe600700 1 --2- 172.21.15.81:0/1671811457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feff810af10 0x7feff819ed10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:33.516 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.818+0000 7feffe600700 1 -- 172.21.15.81:0/1671811457 >> 172.21.15.81:0/1671811457 conn(0x7feff807e300 msgr2=0x7feff81083b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:33.516 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.819+0000 7feffe600700 1 -- 172.21.15.81:0/1671811457 shutdown_connections 2024-05-03T16:33:33.517 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:32.819+0000 7feffe600700 1 -- 172.21.15.81:0/1671811457 wait complete. 2024-05-03T16:33:35.027 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-03T16:33:35.027 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.104+0000 7f0208200700 1 Processor -- start 2024-05-03T16:33:35.027 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.104+0000 7f0208200700 1 -- start start 2024-05-03T16:33:35.027 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.105+0000 7f0208200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020010fce0 0x7f02001120d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:35.027 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.105+0000 7f0208200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0200083580 con 0x7f020010fce0 2024-05-03T16:33:35.027 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.105+0000 7f0205800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020010fce0 0x7f02001120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:35.027 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.105+0000 7f0205800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020010fce0 0x7f02001120d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53730/0 (socket says 172.21.15.81:53730) 2024-05-03T16:33:35.028 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.105+0000 7f0205800700 1 -- 172.21.15.81:0/1413441536 learned_addr learned my addr 172.21.15.81:0/1413441536 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:35.028 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.106+0000 7f0205800700 1 -- 172.21.15.81:0/1413441536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0200112610 con 0x7f020010fce0 2024-05-03T16:33:35.028 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.106+0000 7f0205800700 1 --2- 172.21.15.81:0/1413441536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020010fce0 0x7f02001120d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009e80 tx=0x7f01f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b43cfa0b515d75 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:35.028 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.106+0000 7f01ffe00700 1 -- 172.21.15.81:0/1413441536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f4017070 con 0x7f020010fce0 2024-05-03T16:33:35.028 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.106+0000 7f01ffe00700 1 -- 172.21.15.81:0/1413441536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f01f400b8c0 con 0x7f020010fce0 2024-05-03T16:33:35.028 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.106+0000 7f01ffe00700 1 -- 172.21.15.81:0/1413441536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f4004420 con 0x7f020010fce0 2024-05-03T16:33:35.028 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.107+0000 7f0208200700 1 -- 172.21.15.81:0/1413441536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020010fce0 msgr2=0x7f02001120d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:35.028 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.107+0000 7f0208200700 1 --2- 172.21.15.81:0/1413441536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020010fce0 0x7f02001120d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009e80 tx=0x7f01f400b330 comp rx=0 tx=0).stop 2024-05-03T16:33:35.028 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.107+0000 7f0208200700 1 -- 172.21.15.81:0/1413441536 shutdown_connections 2024-05-03T16:33:35.028 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.107+0000 7f0208200700 1 --2- 172.21.15.81:0/1413441536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020010fce0 0x7f02001120d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:35.028 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.107+0000 7f0208200700 1 -- 172.21.15.81:0/1413441536 >> 172.21.15.81:0/1413441536 conn(0x7f020007e300 msgr2=0x7f0200080720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:35.028 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.107+0000 7f0208200700 1 -- 172.21.15.81:0/1413441536 shutdown_connections 2024-05-03T16:33:35.028 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.108+0000 7f0208200700 1 -- 172.21.15.81:0/1413441536 wait complete. 2024-05-03T16:33:35.028 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.109+0000 7f0208200700 1 Processor -- start 2024-05-03T16:33:35.029 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.109+0000 7f0208200700 1 -- start start 2024-05-03T16:33:35.029 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.110+0000 7f0208200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020010fce0 0x7f02001a3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:35.029 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.110+0000 7f0208200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f02001135c0 con 0x7f020010fce0 2024-05-03T16:33:35.029 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.110+0000 7f0205800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020010fce0 0x7f02001a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:35.029 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.110+0000 7f0205800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020010fce0 0x7f02001a3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53732/0 (socket says 172.21.15.81:53732) 2024-05-03T16:33:35.029 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.110+0000 7f0205800700 1 -- 172.21.15.81:0/3558529524 learned_addr learned my addr 172.21.15.81:0/3558529524 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:35.029 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.110+0000 7f0205800700 1 -- 172.21.15.81:0/3558529524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02001a3670 con 0x7f020010fce0 2024-05-03T16:33:35.029 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.110+0000 7f0205800700 1 --2- 172.21.15.81:0/3558529524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020010fce0 0x7f02001a3130 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009e50 tx=0x7f01f400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:35.029 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.111+0000 7f01fe000700 1 -- 172.21.15.81:0/3558529524 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f4020020 con 0x7f020010fce0 2024-05-03T16:33:35.029 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.111+0000 7f01fe000700 1 -- 172.21.15.81:0/3558529524 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f01f4012430 con 0x7f020010fce0 2024-05-03T16:33:35.029 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.111+0000 7f01fe000700 1 -- 172.21.15.81:0/3558529524 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f4017040 con 0x7f020010fce0 2024-05-03T16:33:35.029 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.111+0000 7f0208200700 1 -- 172.21.15.81:0/3558529524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02001a3900 con 0x7f020010fce0 2024-05-03T16:33:35.029 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.111+0000 7f0208200700 1 -- 172.21.15.81:0/3558529524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02001a65f0 con 0x7f020010fce0 2024-05-03T16:33:35.029 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.112+0000 7f0208200700 1 -- 172.21.15.81:0/3558529524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0200064b00 con 0x7f020010fce0 2024-05-03T16:33:35.029 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.112+0000 7f01fe000700 1 -- 172.21.15.81:0/3558529524 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f01f4023020 con 0x7f020010fce0 2024-05-03T16:33:35.029 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.113+0000 7f01fe000700 1 --2- 172.21.15.81:0/3558529524 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f01e803e470 0x7f01e8040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:35.030 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.113+0000 7f01fe000700 1 -- 172.21.15.81:0/3558529524 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f01f400f050 con 0x7f020010fce0 2024-05-03T16:33:35.030 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.113+0000 7f0204e00700 1 --2- 172.21.15.81:0/3558529524 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f01e803e470 0x7f01e8040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:35.030 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.114+0000 7f0204e00700 1 --2- 172.21.15.81:0/3558529524 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f01e803e470 0x7f01e8040930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f01ec006fd0 tx=0x7f01ec006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:35.030 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.119+0000 7f01fe000700 1 -- 172.21.15.81:0/3558529524 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f01f402a020 con 0x7f020010fce0 2024-05-03T16:33:35.030 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.355+0000 7f0208200700 1 -- 172.21.15.81:0/3558529524 --> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f020007f470 con 0x7f01e803e470 2024-05-03T16:33:35.030 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.357+0000 7f01fe000700 1 -- 172.21.15.81:0/3558529524 <== mgr.14120 v2:172.21.15.81:6800/2734678359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f020007f470 con 0x7f01e803e470 2024-05-03T16:33:35.030 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.360+0000 7f0208200700 1 -- 172.21.15.81:0/3558529524 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f01e803e470 msgr2=0x7f01e8040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:35.030 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.360+0000 7f0208200700 1 --2- 172.21.15.81:0/3558529524 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f01e803e470 0x7f01e8040930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f01ec006fd0 tx=0x7f01ec006e40 comp rx=0 tx=0).stop 2024-05-03T16:33:35.030 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.360+0000 7f0208200700 1 -- 172.21.15.81:0/3558529524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020010fce0 msgr2=0x7f02001a3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:35.030 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.360+0000 7f0208200700 1 --2- 172.21.15.81:0/3558529524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020010fce0 0x7f02001a3130 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009e50 tx=0x7f01f400bd50 comp rx=0 tx=0).stop 2024-05-03T16:33:35.030 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.360+0000 7f0208200700 1 -- 172.21.15.81:0/3558529524 shutdown_connections 2024-05-03T16:33:35.030 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.360+0000 7f0208200700 1 --2- 172.21.15.81:0/3558529524 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f01e803e470 0x7f01e8040930 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:35.030 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.360+0000 7f0208200700 1 --2- 172.21.15.81:0/3558529524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020010fce0 0x7f02001a3130 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:35.031 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.360+0000 7f0208200700 1 -- 172.21.15.81:0/3558529524 >> 172.21.15.81:0/3558529524 conn(0x7f020007e300 msgr2=0x7f020007ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:35.031 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.360+0000 7f0208200700 1 -- 172.21.15.81:0/3558529524 shutdown_connections 2024-05-03T16:33:35.031 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:34.360+0000 7f0208200700 1 -- 172.21.15.81:0/3558529524 wait complete. 2024-05-03T16:33:35.031 INFO:teuthology.orchestra.run.smithi081.stdout:Generating ssh key... 2024-05-03T16:33:35.324 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:35 smithi081 ceph-mon[28640]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:33:36.130 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:36 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: Generating public/private rsa key pair. 2024-05-03T16:33:36.130 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:36 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: Your identification has been saved in /tmp/tmpdhnihw_5/key. 2024-05-03T16:33:36.130 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:36 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: Your public key has been saved in /tmp/tmpdhnihw_5/key.pub. 2024-05-03T16:33:36.130 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:36 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: The key fingerprint is: 2024-05-03T16:33:36.130 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:36 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: SHA256:IIoRltztj4RM6YgJv3sybsysHZmWQ7ohjqjXzdizP0s ceph-8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:33:36.130 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:36 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: The key's randomart image is: 2024-05-03T16:33:36.130 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:36 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: +---[RSA 3072]----+ 2024-05-03T16:33:36.130 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:36 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: |o.o o | 2024-05-03T16:33:36.130 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:36 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: |o+ + . | 2024-05-03T16:33:36.130 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:36 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: |+o= + . | 2024-05-03T16:33:36.130 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:36 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: |o+.= + . | 2024-05-03T16:33:36.131 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:36 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: |. o.. o S | 2024-05-03T16:33:36.131 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:36 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: | o.+ . . | 2024-05-03T16:33:36.131 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:36 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: |++Bo = E | 2024-05-03T16:33:36.131 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:36 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: |==Xo+ =.. | 2024-05-03T16:33:36.131 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:36 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: |B*o+ .+oo | 2024-05-03T16:33:36.131 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:36 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: +----[SHA256]-----+ 2024-05-03T16:33:36.773 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.625+0000 7f51d8400700 1 Processor -- start 2024-05-03T16:33:36.773 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.625+0000 7f51d8400700 1 -- start start 2024-05-03T16:33:36.773 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.626+0000 7f51d8400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51d007ee90 0x7f51d007d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:36.774 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.626+0000 7f51d8400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f51d007d8c0 con 0x7f51d007ee90 2024-05-03T16:33:36.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.626+0000 7f51d5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51d007ee90 0x7f51d007d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:36.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.626+0000 7f51d5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51d007ee90 0x7f51d007d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53744/0 (socket says 172.21.15.81:53744) 2024-05-03T16:33:36.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.626+0000 7f51d5a00700 1 -- 172.21.15.81:0/965331855 learned_addr learned my addr 172.21.15.81:0/965331855 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:36.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.627+0000 7f51d5a00700 1 -- 172.21.15.81:0/965331855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d007da40 con 0x7f51d007ee90 2024-05-03T16:33:36.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.627+0000 7f51d5a00700 1 --2- 172.21.15.81:0/965331855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51d007ee90 0x7f51d007d2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f51c4009e80 tx=0x7f51c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b15b6cab0d17796 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:36.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.627+0000 7f51cfe00700 1 -- 172.21.15.81:0/965331855 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51c4017070 con 0x7f51d007ee90 2024-05-03T16:33:36.776 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.627+0000 7f51cfe00700 1 -- 172.21.15.81:0/965331855 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f51c400b8c0 con 0x7f51d007ee90 2024-05-03T16:33:36.776 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.627+0000 7f51cfe00700 1 -- 172.21.15.81:0/965331855 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51c4004420 con 0x7f51d007ee90 2024-05-03T16:33:36.776 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.628+0000 7f51d8400700 1 -- 172.21.15.81:0/965331855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51d007ee90 msgr2=0x7f51d007d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:36.776 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.628+0000 7f51d8400700 1 --2- 172.21.15.81:0/965331855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51d007ee90 0x7f51d007d2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f51c4009e80 tx=0x7f51c400b330 comp rx=0 tx=0).stop 2024-05-03T16:33:36.776 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.628+0000 7f51d8400700 1 -- 172.21.15.81:0/965331855 shutdown_connections 2024-05-03T16:33:36.776 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.628+0000 7f51d8400700 1 --2- 172.21.15.81:0/965331855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51d007ee90 0x7f51d007d2f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:36.776 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.628+0000 7f51d8400700 1 -- 172.21.15.81:0/965331855 >> 172.21.15.81:0/965331855 conn(0x7f51d01042d0 msgr2=0x7f51d01066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:36.777 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.628+0000 7f51d8400700 1 -- 172.21.15.81:0/965331855 shutdown_connections 2024-05-03T16:33:36.777 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.628+0000 7f51d8400700 1 -- 172.21.15.81:0/965331855 wait complete. 2024-05-03T16:33:36.779 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.629+0000 7f51d8400700 1 Processor -- start 2024-05-03T16:33:36.779 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.630+0000 7f51d8400700 1 -- start start 2024-05-03T16:33:36.779 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.630+0000 7f51d8400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51d007ee90 0x7f51d019ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:36.779 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.630+0000 7f51d8400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f51d010f220 con 0x7f51d007ee90 2024-05-03T16:33:36.779 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.630+0000 7f51d5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51d007ee90 0x7f51d019ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:36.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.630+0000 7f51d5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51d007ee90 0x7f51d019ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53754/0 (socket says 172.21.15.81:53754) 2024-05-03T16:33:36.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.630+0000 7f51d5a00700 1 -- 172.21.15.81:0/3889508336 learned_addr learned my addr 172.21.15.81:0/3889508336 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:36.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.630+0000 7f51d5a00700 1 -- 172.21.15.81:0/3889508336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d019f230 con 0x7f51d007ee90 2024-05-03T16:33:36.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.631+0000 7f51d5a00700 1 --2- 172.21.15.81:0/3889508336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51d007ee90 0x7f51d019ecf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f51c4009e50 tx=0x7f51c400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:36.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.631+0000 7f51ce000700 1 -- 172.21.15.81:0/3889508336 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51c4020020 con 0x7f51d007ee90 2024-05-03T16:33:36.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.631+0000 7f51ce000700 1 -- 172.21.15.81:0/3889508336 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f51c4012430 con 0x7f51d007ee90 2024-05-03T16:33:36.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.631+0000 7f51d8400700 1 -- 172.21.15.81:0/3889508336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d019f4c0 con 0x7f51d007ee90 2024-05-03T16:33:36.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.631+0000 7f51ce000700 1 -- 172.21.15.81:0/3889508336 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51c4017040 con 0x7f51d007ee90 2024-05-03T16:33:36.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.631+0000 7f51d8400700 1 -- 172.21.15.81:0/3889508336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d01a21a0 con 0x7f51d007ee90 2024-05-03T16:33:36.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.632+0000 7f51ce000700 1 -- 172.21.15.81:0/3889508336 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f51c4023020 con 0x7f51d007ee90 2024-05-03T16:33:36.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.632+0000 7f51d8400700 1 -- 172.21.15.81:0/3889508336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51d0064b00 con 0x7f51d007ee90 2024-05-03T16:33:36.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.633+0000 7f51ce000700 1 --2- 172.21.15.81:0/3889508336 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f51b803e470 0x7f51b8040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:36.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.633+0000 7f51ce000700 1 -- 172.21.15.81:0/3889508336 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f51c400f050 con 0x7f51d007ee90 2024-05-03T16:33:36.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.633+0000 7f51d5000700 1 --2- 172.21.15.81:0/3889508336 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f51b803e470 0x7f51b8040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:36.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.634+0000 7f51d5000700 1 --2- 172.21.15.81:0/3889508336 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f51b803e470 0x7f51b8040930 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f51bc006fd0 tx=0x7f51bc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:36.781 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.638+0000 7f51ce000700 1 -- 172.21.15.81:0/3889508336 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f51c402a020 con 0x7f51d007ee90 2024-05-03T16:33:36.782 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:35.870+0000 7f51d8400700 1 -- 172.21.15.81:0/3889508336 --> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f51d01054a0 con 0x7f51b803e470 2024-05-03T16:33:36.782 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:36.054+0000 7f51ce000700 1 -- 172.21.15.81:0/3889508336 <== mgr.14120 v2:172.21.15.81:6800/2734678359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f51d01054a0 con 0x7f51b803e470 2024-05-03T16:33:36.782 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:36.058+0000 7f51d8400700 1 -- 172.21.15.81:0/3889508336 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f51b803e470 msgr2=0x7f51b8040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:36.782 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:36.058+0000 7f51d8400700 1 --2- 172.21.15.81:0/3889508336 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f51b803e470 0x7f51b8040930 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f51bc006fd0 tx=0x7f51bc006e40 comp rx=0 tx=0).stop 2024-05-03T16:33:36.782 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:36.058+0000 7f51d8400700 1 -- 172.21.15.81:0/3889508336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51d007ee90 msgr2=0x7f51d019ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:36.782 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:36.058+0000 7f51d8400700 1 --2- 172.21.15.81:0/3889508336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51d007ee90 0x7f51d019ecf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f51c4009e50 tx=0x7f51c400bd50 comp rx=0 tx=0).stop 2024-05-03T16:33:36.782 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:36.058+0000 7f51d8400700 1 -- 172.21.15.81:0/3889508336 shutdown_connections 2024-05-03T16:33:36.782 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:36.058+0000 7f51d8400700 1 --2- 172.21.15.81:0/3889508336 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f51b803e470 0x7f51b8040930 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:36.783 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:36.058+0000 7f51d8400700 1 --2- 172.21.15.81:0/3889508336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51d007ee90 0x7f51d019ecf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:36.783 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:36.058+0000 7f51d8400700 1 -- 172.21.15.81:0/3889508336 >> 172.21.15.81:0/3889508336 conn(0x7f51d01042d0 msgr2=0x7f51d0104d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:36.783 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:36.058+0000 7f51d8400700 1 -- 172.21.15.81:0/3889508336 shutdown_connections 2024-05-03T16:33:36.783 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:36.058+0000 7f51d8400700 1 -- 172.21.15.81:0/3889508336 wait complete. 2024-05-03T16:33:37.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:37 smithi081 ceph-mon[28640]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:33:37.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:37 smithi081 ceph-mon[28640]: Generating ssh key... 2024-05-03T16:33:37.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:37 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' 2024-05-03T16:33:37.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:37 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' 2024-05-03T16:33:38.280 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNJCHo2UTASoBoUGCEHJdDQ0EgL0PfuwAer6Xvj3ITrDIlDfiSMEoU70ogNjKVBqrns+Ne+bISI281eseszkSqd1W58nNv/tswnoz9NuSP2qUsvCTy9z0n9YPc22VokzDDX0FvIZmQQYvmwYrv24V6ioCQ7zN9OZn+GGzRcpW5iuupwep+jCOj8zMD8kzoLpHJ4UlR1QHWAsHnw6ms9+mTIaDlrIn0RtjHTnb+TjW13CKQSkECxFKWRGKKNDcSS+wDnf14Qql69c14Q+XfGxaQ9VlZSu50uAwAkr3+ZcEkakwgAEKTdu+M5RBUqkiqynYqHyQcGVNRnV7CSDx/ZnuyhqpcpeNZUAz11truTAisVl2H9AD+lulOG5y5ERSS1J4NXo/wSyHqPqBDgAoCDjKfclilO/SCzaQq9KDlURpzEfpGfL3RwKXojwa9JP04jCx5NqypuyaGWcgkRopUGujzEHLEZGYPbwJVhfozW/gbcN4nSfMFtQTLF7SDZP2+etU= ceph-8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:33:38.280 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.407+0000 7f0727a00700 1 Processor -- start 2024-05-03T16:33:38.280 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.407+0000 7f0727a00700 1 -- start start 2024-05-03T16:33:38.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.408+0000 7f0727a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0720108d10 0x7f0720109130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:38.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.408+0000 7f0727a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0720109700 con 0x7f0720108d10 2024-05-03T16:33:38.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.408+0000 7f0725000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0720108d10 0x7f0720109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:38.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.408+0000 7f0725000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0720108d10 0x7f0720109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52540/0 (socket says 172.21.15.81:52540) 2024-05-03T16:33:38.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.408+0000 7f0725000700 1 -- 172.21.15.81:0/1006453033 learned_addr learned my addr 172.21.15.81:0/1006453033 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:38.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.409+0000 7f0725000700 1 -- 172.21.15.81:0/1006453033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0720109f10 con 0x7f0720108d10 2024-05-03T16:33:38.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.409+0000 7f0725000700 1 --2- 172.21.15.81:0/1006453033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0720108d10 0x7f0720109130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f07140098a0 tx=0x7f0714009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f31af89113192e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:38.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.410+0000 7f071f400700 1 -- 172.21.15.81:0/1006453033 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0714004160 con 0x7f0720108d10 2024-05-03T16:33:38.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.410+0000 7f071f400700 1 -- 172.21.15.81:0/1006453033 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f0714004300 con 0x7f0720108d10 2024-05-03T16:33:38.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.410+0000 7f071f400700 1 -- 172.21.15.81:0/1006453033 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07140119e0 con 0x7f0720108d10 2024-05-03T16:33:38.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.411+0000 7f0727a00700 1 -- 172.21.15.81:0/1006453033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0720108d10 msgr2=0x7f0720109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:38.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.411+0000 7f0727a00700 1 --2- 172.21.15.81:0/1006453033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0720108d10 0x7f0720109130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f07140098a0 tx=0x7f0714009bb0 comp rx=0 tx=0).stop 2024-05-03T16:33:38.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.411+0000 7f0727a00700 1 -- 172.21.15.81:0/1006453033 shutdown_connections 2024-05-03T16:33:38.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.411+0000 7f0727a00700 1 --2- 172.21.15.81:0/1006453033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0720108d10 0x7f0720109130 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:38.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.411+0000 7f0727a00700 1 -- 172.21.15.81:0/1006453033 >> 172.21.15.81:0/1006453033 conn(0x7f07201042d0 msgr2=0x7f07201066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:38.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.411+0000 7f0727a00700 1 -- 172.21.15.81:0/1006453033 shutdown_connections 2024-05-03T16:33:38.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.411+0000 7f0727a00700 1 -- 172.21.15.81:0/1006453033 wait complete. 2024-05-03T16:33:38.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.412+0000 7f0727a00700 1 Processor -- start 2024-05-03T16:33:38.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.412+0000 7f0727a00700 1 -- start start 2024-05-03T16:33:38.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.413+0000 7f0727a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f072019cd50 0x7f072019d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:38.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.413+0000 7f0727a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f072010d140 con 0x7f072019cd50 2024-05-03T16:33:38.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.413+0000 7f0725000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f072019cd50 0x7f072019d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:38.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.413+0000 7f0725000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f072019cd50 0x7f072019d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52556/0 (socket says 172.21.15.81:52556) 2024-05-03T16:33:38.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.413+0000 7f0725000700 1 -- 172.21.15.81:0/1065381250 learned_addr learned my addr 172.21.15.81:0/1065381250 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:38.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.413+0000 7f0725000700 1 -- 172.21.15.81:0/1065381250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072019d6d0 con 0x7f072019cd50 2024-05-03T16:33:38.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.414+0000 7f0725000700 1 --2- 172.21.15.81:0/1065381250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f072019cd50 0x7f072019d190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07140116a0 tx=0x7f0714012f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:38.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.414+0000 7f071d600700 1 -- 172.21.15.81:0/1065381250 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0714011a60 con 0x7f072019cd50 2024-05-03T16:33:38.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.414+0000 7f071d600700 1 -- 172.21.15.81:0/1065381250 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f0714003b10 con 0x7f072019cd50 2024-05-03T16:33:38.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.414+0000 7f071d600700 1 -- 172.21.15.81:0/1065381250 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f071401ace0 con 0x7f072019cd50 2024-05-03T16:33:38.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.414+0000 7f0727a00700 1 -- 172.21.15.81:0/1065381250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072019d960 con 0x7f072019cd50 2024-05-03T16:33:38.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.414+0000 7f0727a00700 1 -- 172.21.15.81:0/1065381250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07201a0400 con 0x7f072019cd50 2024-05-03T16:33:38.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.415+0000 7f0727a00700 1 -- 172.21.15.81:0/1065381250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0720064b00 con 0x7f072019cd50 2024-05-03T16:33:38.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.415+0000 7f071d600700 1 -- 172.21.15.81:0/1065381250 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f071401a460 con 0x7f072019cd50 2024-05-03T16:33:38.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.416+0000 7f071d600700 1 --2- 172.21.15.81:0/1065381250 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f070803e4c0 0x7f0708040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:38.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.416+0000 7f071d600700 1 -- 172.21.15.81:0/1065381250 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0714053de0 con 0x7f072019cd50 2024-05-03T16:33:38.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.416+0000 7f071fe00700 1 --2- 172.21.15.81:0/1065381250 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f070803e4c0 0x7f0708040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:38.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.417+0000 7f071fe00700 1 --2- 172.21.15.81:0/1065381250 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f070803e4c0 0x7f0708040980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f070c006fd0 tx=0x7f070c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:38.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.421+0000 7f071d600700 1 -- 172.21.15.81:0/1065381250 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0714053730 con 0x7f072019cd50 2024-05-03T16:33:38.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.654+0000 7f0727a00700 1 -- 172.21.15.81:0/1065381250 --> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f0720105500 con 0x7f070803e4c0 2024-05-03T16:33:38.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.656+0000 7f071d600700 1 -- 172.21.15.81:0/1065381250 <== mgr.14120 v2:172.21.15.81:6800/2734678359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f0720105500 con 0x7f070803e4c0 2024-05-03T16:33:38.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.659+0000 7f0727a00700 1 -- 172.21.15.81:0/1065381250 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f070803e4c0 msgr2=0x7f0708040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:38.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.659+0000 7f0727a00700 1 --2- 172.21.15.81:0/1065381250 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f070803e4c0 0x7f0708040980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f070c006fd0 tx=0x7f070c006e40 comp rx=0 tx=0).stop 2024-05-03T16:33:38.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.659+0000 7f0727a00700 1 -- 172.21.15.81:0/1065381250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f072019cd50 msgr2=0x7f072019d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:38.284 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.659+0000 7f0727a00700 1 --2- 172.21.15.81:0/1065381250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f072019cd50 0x7f072019d190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07140116a0 tx=0x7f0714012f80 comp rx=0 tx=0).stop 2024-05-03T16:33:38.284 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.659+0000 7f0727a00700 1 -- 172.21.15.81:0/1065381250 shutdown_connections 2024-05-03T16:33:38.284 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.659+0000 7f0727a00700 1 --2- 172.21.15.81:0/1065381250 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f070803e4c0 0x7f0708040980 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:38.284 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.659+0000 7f0727a00700 1 --2- 172.21.15.81:0/1065381250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f072019cd50 0x7f072019d190 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:38.284 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.659+0000 7f0727a00700 1 -- 172.21.15.81:0/1065381250 >> 172.21.15.81:0/1065381250 conn(0x7f07201042d0 msgr2=0x7f0720104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:38.284 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.659+0000 7f0727a00700 1 -- 172.21.15.81:0/1065381250 shutdown_connections 2024-05-03T16:33:38.284 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:37.659+0000 7f0727a00700 1 -- 172.21.15.81:0/1065381250 wait complete. 2024-05-03T16:33:38.284 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-03T16:33:38.284 INFO:teuthology.orchestra.run.smithi081.stdout:Adding key to root@localhost authorized_keys... 2024-05-03T16:33:38.284 INFO:teuthology.orchestra.run.smithi081.stdout:Adding host smithi081... 2024-05-03T16:33:38.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:38 smithi081 ceph-mon[28640]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:33:39.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:39 smithi081 ceph-mon[28640]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi081", "addr": "172.21.15.81", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:33:41.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:41 smithi081 ceph-mon[28640]: Deploying cephadm binary to smithi081 2024-05-03T16:33:45.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Added host 'smithi081' with addr '172.21.15.81' 2024-05-03T16:33:45.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.921+0000 7ff511200700 1 Processor -- start 2024-05-03T16:33:45.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.921+0000 7ff511200700 1 -- start start 2024-05-03T16:33:45.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.921+0000 7ff511200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c083320 0x7ff50c111cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:45.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.921+0000 7ff511200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c1122c0 con 0x7ff50c083320 2024-05-03T16:33:45.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.922+0000 7ff50b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c083320 0x7ff50c111cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:45.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.922+0000 7ff50b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c083320 0x7ff50c111cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52558/0 (socket says 172.21.15.81:52558) 2024-05-03T16:33:45.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.922+0000 7ff50b400700 1 -- 172.21.15.81:0/2532338097 learned_addr learned my addr 172.21.15.81:0/2532338097 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:45.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.922+0000 7ff50b400700 1 -- 172.21.15.81:0/2532338097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c112440 con 0x7ff50c083320 2024-05-03T16:33:45.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.923+0000 7ff50b400700 1 --2- 172.21.15.81:0/2532338097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c083320 0x7ff50c111cf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0098a0 tx=0x7ff4fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84aedcced58bd2d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:45.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.923+0000 7ff50a000700 1 -- 172.21.15.81:0/2532338097 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4fc004160 con 0x7ff50c083320 2024-05-03T16:33:45.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.923+0000 7ff50a000700 1 -- 172.21.15.81:0/2532338097 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7ff4fc004300 con 0x7ff50c083320 2024-05-03T16:33:45.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.923+0000 7ff50a000700 1 -- 172.21.15.81:0/2532338097 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4fc0119e0 con 0x7ff50c083320 2024-05-03T16:33:45.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.924+0000 7ff511200700 1 -- 172.21.15.81:0/2532338097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c083320 msgr2=0x7ff50c111cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:45.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.924+0000 7ff511200700 1 --2- 172.21.15.81:0/2532338097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c083320 0x7ff50c111cf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0098a0 tx=0x7ff4fc009bb0 comp rx=0 tx=0).stop 2024-05-03T16:33:45.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.924+0000 7ff511200700 1 -- 172.21.15.81:0/2532338097 shutdown_connections 2024-05-03T16:33:45.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.924+0000 7ff511200700 1 --2- 172.21.15.81:0/2532338097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c083320 0x7ff50c111cf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:45.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.924+0000 7ff511200700 1 -- 172.21.15.81:0/2532338097 >> 172.21.15.81:0/2532338097 conn(0x7ff50c07e110 msgr2=0x7ff50c080550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:45.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.924+0000 7ff511200700 1 -- 172.21.15.81:0/2532338097 shutdown_connections 2024-05-03T16:33:45.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.924+0000 7ff511200700 1 -- 172.21.15.81:0/2532338097 wait complete. 2024-05-03T16:33:45.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.925+0000 7ff511200700 1 Processor -- start 2024-05-03T16:33:45.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.925+0000 7ff511200700 1 -- start start 2024-05-03T16:33:45.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.925+0000 7ff511200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c1a2e90 0x7ff50c1a32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:45.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.925+0000 7ff511200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c1133f0 con 0x7ff50c1a2e90 2024-05-03T16:33:45.868 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.926+0000 7ff50b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c1a2e90 0x7ff50c1a32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:45.868 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.926+0000 7ff50b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c1a2e90 0x7ff50c1a32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52564/0 (socket says 172.21.15.81:52564) 2024-05-03T16:33:45.868 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.926+0000 7ff50b400700 1 -- 172.21.15.81:0/2290818163 learned_addr learned my addr 172.21.15.81:0/2290818163 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:45.868 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.926+0000 7ff50b400700 1 -- 172.21.15.81:0/2290818163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c1a37f0 con 0x7ff50c1a2e90 2024-05-03T16:33:45.868 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.926+0000 7ff50b400700 1 --2- 172.21.15.81:0/2290818163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c1a2e90 0x7ff50c1a32b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc009130 tx=0x7ff4fc011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:45.868 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.927+0000 7ff503e00700 1 -- 172.21.15.81:0/2290818163 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4fc003b20 con 0x7ff50c1a2e90 2024-05-03T16:33:45.868 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.927+0000 7ff503e00700 1 -- 172.21.15.81:0/2290818163 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7ff4fc01a8a0 con 0x7ff50c1a2e90 2024-05-03T16:33:45.868 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.927+0000 7ff511200700 1 -- 172.21.15.81:0/2290818163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff50c1a3a80 con 0x7ff50c1a2e90 2024-05-03T16:33:45.868 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.927+0000 7ff503e00700 1 -- 172.21.15.81:0/2290818163 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4fc024810 con 0x7ff50c1a2e90 2024-05-03T16:33:45.868 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.927+0000 7ff511200700 1 -- 172.21.15.81:0/2290818163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff50c1a6560 con 0x7ff50c1a2e90 2024-05-03T16:33:45.868 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.928+0000 7ff503e00700 1 -- 172.21.15.81:0/2290818163 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7ff4fc022020 con 0x7ff50c1a2e90 2024-05-03T16:33:45.868 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.928+0000 7ff511200700 1 -- 172.21.15.81:0/2290818163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff50c064b00 con 0x7ff50c1a2e90 2024-05-03T16:33:45.868 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.928+0000 7ff503e00700 1 --2- 172.21.15.81:0/2290818163 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7ff4f003e4c0 0x7ff4f0040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:45.868 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.929+0000 7ff503e00700 1 -- 172.21.15.81:0/2290818163 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff4fc0539e0 con 0x7ff50c1a2e90 2024-05-03T16:33:45.869 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.929+0000 7ff50aa00700 1 --2- 172.21.15.81:0/2290818163 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7ff4f003e4c0 0x7ff4f0040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:45.869 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.929+0000 7ff50aa00700 1 --2- 172.21.15.81:0/2290818163 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7ff4f003e4c0 0x7ff4f0040980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8006fd0 tx=0x7ff4f8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:45.869 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:38.934+0000 7ff503e00700 1 -- 172.21.15.81:0/2290818163 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff4fc01ab00 con 0x7ff50c1a2e90 2024-05-03T16:33:45.869 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:39.167+0000 7ff511200700 1 -- 172.21.15.81:0/2290818163 --> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi081", "addr": "172.21.15.81", "target": ["mon-mgr", ""]}) -- 0x7ff50c07f250 con 0x7ff4f003e4c0 2024-05-03T16:33:45.869 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:45.152+0000 7ff503e00700 1 -- 172.21.15.81:0/2290818163 <== mgr.14120 v2:172.21.15.81:6800/2734678359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7ff50c07f250 con 0x7ff4f003e4c0 2024-05-03T16:33:45.869 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:45.156+0000 7ff511200700 1 -- 172.21.15.81:0/2290818163 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7ff4f003e4c0 msgr2=0x7ff4f0040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:45.869 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:45.157+0000 7ff511200700 1 --2- 172.21.15.81:0/2290818163 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7ff4f003e4c0 0x7ff4f0040980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8006fd0 tx=0x7ff4f8006e40 comp rx=0 tx=0).stop 2024-05-03T16:33:45.869 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:45.157+0000 7ff511200700 1 -- 172.21.15.81:0/2290818163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c1a2e90 msgr2=0x7ff50c1a32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:45.869 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:45.157+0000 7ff511200700 1 --2- 172.21.15.81:0/2290818163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c1a2e90 0x7ff50c1a32b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc009130 tx=0x7ff4fc011a60 comp rx=0 tx=0).stop 2024-05-03T16:33:45.869 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:45.157+0000 7ff511200700 1 -- 172.21.15.81:0/2290818163 shutdown_connections 2024-05-03T16:33:45.869 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:45.157+0000 7ff511200700 1 --2- 172.21.15.81:0/2290818163 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7ff4f003e4c0 0x7ff4f0040980 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:45.869 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:45.157+0000 7ff511200700 1 --2- 172.21.15.81:0/2290818163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c1a2e90 0x7ff50c1a32b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:45.869 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:45.157+0000 7ff511200700 1 -- 172.21.15.81:0/2290818163 >> 172.21.15.81:0/2290818163 conn(0x7ff50c07e110 msgr2=0x7ff50c07eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:45.870 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:45.157+0000 7ff511200700 1 -- 172.21.15.81:0/2290818163 shutdown_connections 2024-05-03T16:33:45.870 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:45.157+0000 7ff511200700 1 -- 172.21.15.81:0/2290818163 wait complete. 2024-05-03T16:33:45.870 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying unmanaged mon service... 2024-05-03T16:33:46.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:46 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' 2024-05-03T16:33:46.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:46 smithi081 ceph-mon[28640]: Added host smithi081 2024-05-03T16:33:46.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:46 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:33:48.073 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:47 smithi081 ceph-mon[28640]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:33:48.073 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:47 smithi081 ceph-mon[28640]: Saving service mon spec with placement count:5 2024-05-03T16:33:48.073 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:47 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' 2024-05-03T16:33:48.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-03T16:33:48.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.523+0000 7ffba6e00700 1 Processor -- start 2024-05-03T16:33:48.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.523+0000 7ffba6e00700 1 -- start start 2024-05-03T16:33:48.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.524+0000 7ffba6e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba007eeb0 0x7ffba007d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:48.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.524+0000 7ffba6e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffba007d8e0 con 0x7ffba007eeb0 2024-05-03T16:33:48.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.524+0000 7ffba5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba007eeb0 0x7ffba007d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:48.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.524+0000 7ffba5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba007eeb0 0x7ffba007d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58374/0 (socket says 172.21.15.81:58374) 2024-05-03T16:33:48.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.524+0000 7ffba5a00700 1 -- 172.21.15.81:0/3841396770 learned_addr learned my addr 172.21.15.81:0/3841396770 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:48.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.525+0000 7ffba5a00700 1 -- 172.21.15.81:0/3841396770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba007da60 con 0x7ffba007eeb0 2024-05-03T16:33:48.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.525+0000 7ffba5a00700 1 --2- 172.21.15.81:0/3841396770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba007eeb0 0x7ffba007d310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009e80 tx=0x7ffb9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be70006a5c996ed1 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:48.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.525+0000 7ffb9fe00700 1 -- 172.21.15.81:0/3841396770 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb94017070 con 0x7ffba007eeb0 2024-05-03T16:33:48.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.525+0000 7ffb9fe00700 1 -- 172.21.15.81:0/3841396770 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7ffb9400b8c0 con 0x7ffba007eeb0 2024-05-03T16:33:48.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.525+0000 7ffb9fe00700 1 -- 172.21.15.81:0/3841396770 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb94004420 con 0x7ffba007eeb0 2024-05-03T16:33:48.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.526+0000 7ffba6e00700 1 -- 172.21.15.81:0/3841396770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba007eeb0 msgr2=0x7ffba007d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:48.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.526+0000 7ffba6e00700 1 --2- 172.21.15.81:0/3841396770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba007eeb0 0x7ffba007d310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009e80 tx=0x7ffb9400b330 comp rx=0 tx=0).stop 2024-05-03T16:33:48.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.526+0000 7ffba6e00700 1 -- 172.21.15.81:0/3841396770 shutdown_connections 2024-05-03T16:33:48.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.526+0000 7ffba6e00700 1 --2- 172.21.15.81:0/3841396770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba007eeb0 0x7ffba007d310 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:48.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.526+0000 7ffba6e00700 1 -- 172.21.15.81:0/3841396770 >> 172.21.15.81:0/3841396770 conn(0x7ffba01040f0 msgr2=0x7ffba0106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:48.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.526+0000 7ffba6e00700 1 -- 172.21.15.81:0/3841396770 shutdown_connections 2024-05-03T16:33:48.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.526+0000 7ffba6e00700 1 -- 172.21.15.81:0/3841396770 wait complete. 2024-05-03T16:33:48.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.527+0000 7ffba6e00700 1 Processor -- start 2024-05-03T16:33:48.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.527+0000 7ffba6e00700 1 -- start start 2024-05-03T16:33:48.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.527+0000 7ffba6e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba007eeb0 0x7ffba019eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:48.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.527+0000 7ffba6e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffba010f040 con 0x7ffba007eeb0 2024-05-03T16:33:48.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.528+0000 7ffba5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba007eeb0 0x7ffba019eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:48.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.528+0000 7ffba5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba007eeb0 0x7ffba019eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58388/0 (socket says 172.21.15.81:58388) 2024-05-03T16:33:48.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.528+0000 7ffba5a00700 1 -- 172.21.15.81:0/1687004524 learned_addr learned my addr 172.21.15.81:0/1687004524 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:48.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.528+0000 7ffba5a00700 1 -- 172.21.15.81:0/1687004524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba019f070 con 0x7ffba007eeb0 2024-05-03T16:33:48.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.528+0000 7ffba5a00700 1 --2- 172.21.15.81:0/1687004524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba007eeb0 0x7ffba019eb30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffb94004000 tx=0x7ffb94003ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:48.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.528+0000 7ffb9e000700 1 -- 172.21.15.81:0/1687004524 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb94020020 con 0x7ffba007eeb0 2024-05-03T16:33:48.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.529+0000 7ffb9e000700 1 -- 172.21.15.81:0/1687004524 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7ffb940128a0 con 0x7ffba007eeb0 2024-05-03T16:33:48.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.529+0000 7ffba6e00700 1 -- 172.21.15.81:0/1687004524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba019f300 con 0x7ffba007eeb0 2024-05-03T16:33:48.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.529+0000 7ffb9e000700 1 -- 172.21.15.81:0/1687004524 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb94017040 con 0x7ffba007eeb0 2024-05-03T16:33:48.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.529+0000 7ffba6e00700 1 -- 172.21.15.81:0/1687004524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba01a1ff0 con 0x7ffba007eeb0 2024-05-03T16:33:48.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.530+0000 7ffba6e00700 1 -- 172.21.15.81:0/1687004524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffba0064b00 con 0x7ffba007eeb0 2024-05-03T16:33:48.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.530+0000 7ffb9e000700 1 -- 172.21.15.81:0/1687004524 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7ffb94023020 con 0x7ffba007eeb0 2024-05-03T16:33:48.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.531+0000 7ffb9e000700 1 --2- 172.21.15.81:0/1687004524 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7ffb8803e4c0 0x7ffb88040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:48.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.531+0000 7ffb9e000700 1 -- 172.21.15.81:0/1687004524 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ffb9400f050 con 0x7ffba007eeb0 2024-05-03T16:33:48.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.531+0000 7ffba5000700 1 --2- 172.21.15.81:0/1687004524 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7ffb8803e4c0 0x7ffb88040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:48.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.531+0000 7ffba5000700 1 --2- 172.21.15.81:0/1687004524 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7ffb8803e4c0 0x7ffb88040980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c006fd0 tx=0x7ffb8c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:48.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.536+0000 7ffb9e000700 1 -- 172.21.15.81:0/1687004524 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ffb9402a020 con 0x7ffba007eeb0 2024-05-03T16:33:48.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.789+0000 7ffba6e00700 1 -- 172.21.15.81:0/1687004524 --> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7ffba0105280 con 0x7ffb8803e4c0 2024-05-03T16:33:48.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.796+0000 7ffb9e000700 1 -- 172.21.15.81:0/1687004524 <== mgr.14120 v2:172.21.15.81:6800/2734678359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ffba0105280 con 0x7ffb8803e4c0 2024-05-03T16:33:48.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.798+0000 7ffba6e00700 1 -- 172.21.15.81:0/1687004524 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7ffb8803e4c0 msgr2=0x7ffb88040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:48.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.798+0000 7ffba6e00700 1 --2- 172.21.15.81:0/1687004524 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7ffb8803e4c0 0x7ffb88040980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c006fd0 tx=0x7ffb8c006e40 comp rx=0 tx=0).stop 2024-05-03T16:33:48.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.798+0000 7ffba6e00700 1 -- 172.21.15.81:0/1687004524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba007eeb0 msgr2=0x7ffba019eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:48.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.798+0000 7ffba6e00700 1 --2- 172.21.15.81:0/1687004524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba007eeb0 0x7ffba019eb30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffb94004000 tx=0x7ffb94003ad0 comp rx=0 tx=0).stop 2024-05-03T16:33:48.092 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.798+0000 7ffba6e00700 1 -- 172.21.15.81:0/1687004524 shutdown_connections 2024-05-03T16:33:48.092 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.798+0000 7ffba6e00700 1 --2- 172.21.15.81:0/1687004524 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7ffb8803e4c0 0x7ffb88040980 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:48.092 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.798+0000 7ffba6e00700 1 --2- 172.21.15.81:0/1687004524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba007eeb0 0x7ffba019eb30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:48.092 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.798+0000 7ffba6e00700 1 -- 172.21.15.81:0/1687004524 >> 172.21.15.81:0/1687004524 conn(0x7ffba01040f0 msgr2=0x7ffba0104b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:48.092 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.799+0000 7ffba6e00700 1 -- 172.21.15.81:0/1687004524 shutdown_connections 2024-05-03T16:33:48.092 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:46.799+0000 7ffba6e00700 1 -- 172.21.15.81:0/1687004524 wait complete. 2024-05-03T16:33:48.092 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying unmanaged mgr service... 2024-05-03T16:33:49.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:49 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' 2024-05-03T16:33:49.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:49 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' 2024-05-03T16:33:49.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:49 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' 2024-05-03T16:33:50.130 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-03T16:33:50.130 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.078+0000 7f8bf8600700 1 Processor -- start 2024-05-03T16:33:50.130 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.078+0000 7f8bf8600700 1 -- start start 2024-05-03T16:33:50.130 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.079+0000 7f8bf8600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf0108d10 0x7f8bf0109130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:50.130 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.079+0000 7f8bf8600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf0109700 con 0x7f8bf0108d10 2024-05-03T16:33:50.130 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.079+0000 7f8bf5c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf0108d10 0x7f8bf0109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:50.130 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.079+0000 7f8bf5c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf0108d10 0x7f8bf0109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58390/0 (socket says 172.21.15.81:58390) 2024-05-03T16:33:50.130 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.079+0000 7f8bf5c00700 1 -- 172.21.15.81:0/3516043964 learned_addr learned my addr 172.21.15.81:0/3516043964 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:50.130 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.080+0000 7f8bf5c00700 1 -- 172.21.15.81:0/3516043964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf0109f10 con 0x7f8bf0108d10 2024-05-03T16:33:50.130 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.080+0000 7f8bf5c00700 1 --2- 172.21.15.81:0/3516043964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf0108d10 0x7f8bf0109130 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8be40098a0 tx=0x7f8be4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b73bb2ba83d0320 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:50.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.080+0000 7f8befe00700 1 -- 172.21.15.81:0/3516043964 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be4004160 con 0x7f8bf0108d10 2024-05-03T16:33:50.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.081+0000 7f8befe00700 1 -- 172.21.15.81:0/3516043964 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8be4004300 con 0x7f8bf0108d10 2024-05-03T16:33:50.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.081+0000 7f8befe00700 1 -- 172.21.15.81:0/3516043964 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be4011960 con 0x7f8bf0108d10 2024-05-03T16:33:50.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.081+0000 7f8bf8600700 1 -- 172.21.15.81:0/3516043964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf0108d10 msgr2=0x7f8bf0109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:50.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.081+0000 7f8bf8600700 1 --2- 172.21.15.81:0/3516043964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf0108d10 0x7f8bf0109130 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8be40098a0 tx=0x7f8be4009bb0 comp rx=0 tx=0).stop 2024-05-03T16:33:50.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.082+0000 7f8bf8600700 1 -- 172.21.15.81:0/3516043964 shutdown_connections 2024-05-03T16:33:50.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.082+0000 7f8bf8600700 1 --2- 172.21.15.81:0/3516043964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf0108d10 0x7f8bf0109130 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:50.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.082+0000 7f8bf8600700 1 -- 172.21.15.81:0/3516043964 >> 172.21.15.81:0/3516043964 conn(0x7f8bf01042d0 msgr2=0x7f8bf01066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:50.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.082+0000 7f8bf8600700 1 -- 172.21.15.81:0/3516043964 shutdown_connections 2024-05-03T16:33:50.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.082+0000 7f8bf8600700 1 -- 172.21.15.81:0/3516043964 wait complete. 2024-05-03T16:33:50.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.083+0000 7f8bf8600700 1 Processor -- start 2024-05-03T16:33:50.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.083+0000 7f8bf8600700 1 -- start start 2024-05-03T16:33:50.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.083+0000 7f8bf8600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf0108d10 0x7f8bf007eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:50.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.083+0000 7f8bf8600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf010d140 con 0x7f8bf0108d10 2024-05-03T16:33:50.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.084+0000 7f8bf5c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf0108d10 0x7f8bf007eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:50.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.084+0000 7f8bf5c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf0108d10 0x7f8bf007eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58398/0 (socket says 172.21.15.81:58398) 2024-05-03T16:33:50.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.084+0000 7f8bf5c00700 1 -- 172.21.15.81:0/2010134851 learned_addr learned my addr 172.21.15.81:0/2010134851 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:50.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.084+0000 7f8bf5c00700 1 -- 172.21.15.81:0/2010134851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf007f0c0 con 0x7f8bf0108d10 2024-05-03T16:33:50.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.084+0000 7f8bf5c00700 1 --2- 172.21.15.81:0/2010134851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf0108d10 0x7f8bf007eb80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8be4011670 tx=0x7f8be4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:50.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.085+0000 7f8bee000700 1 -- 172.21.15.81:0/2010134851 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be401f070 con 0x7f8bf0108d10 2024-05-03T16:33:50.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.085+0000 7f8bee000700 1 -- 172.21.15.81:0/2010134851 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8be4003b20 con 0x7f8bf0108d10 2024-05-03T16:33:50.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.085+0000 7f8bee000700 1 -- 172.21.15.81:0/2010134851 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be4019580 con 0x7f8bf0108d10 2024-05-03T16:33:50.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.085+0000 7f8bf8600700 1 -- 172.21.15.81:0/2010134851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf007d2b0 con 0x7f8bf0108d10 2024-05-03T16:33:50.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.085+0000 7f8bf8600700 1 -- 172.21.15.81:0/2010134851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf007d7f0 con 0x7f8bf0108d10 2024-05-03T16:33:50.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.086+0000 7f8bf8600700 1 -- 172.21.15.81:0/2010134851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf0064b00 con 0x7f8bf0108d10 2024-05-03T16:33:50.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.087+0000 7f8bee000700 1 -- 172.21.15.81:0/2010134851 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f8be4022070 con 0x7f8bf0108d10 2024-05-03T16:33:50.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.087+0000 7f8bee000700 1 --2- 172.21.15.81:0/2010134851 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8bd803e4c0 0x7f8bd8040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:50.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.087+0000 7f8bee000700 1 -- 172.21.15.81:0/2010134851 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8be4053a70 con 0x7f8bf0108d10 2024-05-03T16:33:50.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.088+0000 7f8bf5200700 1 --2- 172.21.15.81:0/2010134851 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8bd803e4c0 0x7f8bd8040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:50.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.089+0000 7f8bf5200700 1 --2- 172.21.15.81:0/2010134851 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8bd803e4c0 0x7f8bd8040980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc006fd0 tx=0x7f8bdc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:50.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.093+0000 7f8bee000700 1 -- 172.21.15.81:0/2010134851 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8be40172b0 con 0x7f8bf0108d10 2024-05-03T16:33:50.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.351+0000 7f8bf8600700 1 -- 172.21.15.81:0/2010134851 --> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f8bf007df80 con 0x7f8bd803e4c0 2024-05-03T16:33:50.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.358+0000 7f8bee000700 1 -- 172.21.15.81:0/2010134851 <== mgr.14120 v2:172.21.15.81:6800/2734678359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f8bf007df80 con 0x7f8bd803e4c0 2024-05-03T16:33:50.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.361+0000 7f8bf8600700 1 -- 172.21.15.81:0/2010134851 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8bd803e4c0 msgr2=0x7f8bd8040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:50.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.361+0000 7f8bf8600700 1 --2- 172.21.15.81:0/2010134851 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8bd803e4c0 0x7f8bd8040980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc006fd0 tx=0x7f8bdc006e40 comp rx=0 tx=0).stop 2024-05-03T16:33:50.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.361+0000 7f8bf8600700 1 -- 172.21.15.81:0/2010134851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf0108d10 msgr2=0x7f8bf007eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:50.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.361+0000 7f8bf8600700 1 --2- 172.21.15.81:0/2010134851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf0108d10 0x7f8bf007eb80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8be4011670 tx=0x7f8be4011a30 comp rx=0 tx=0).stop 2024-05-03T16:33:50.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.361+0000 7f8bf8600700 1 -- 172.21.15.81:0/2010134851 shutdown_connections 2024-05-03T16:33:50.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.361+0000 7f8bf8600700 1 --2- 172.21.15.81:0/2010134851 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8bd803e4c0 0x7f8bd8040980 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:50.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.361+0000 7f8bf8600700 1 --2- 172.21.15.81:0/2010134851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf0108d10 0x7f8bf007eb80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:50.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.361+0000 7f8bf8600700 1 -- 172.21.15.81:0/2010134851 >> 172.21.15.81:0/2010134851 conn(0x7f8bf01042d0 msgr2=0x7f8bf0104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:50.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.361+0000 7f8bf8600700 1 -- 172.21.15.81:0/2010134851 shutdown_connections 2024-05-03T16:33:50.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:49.361+0000 7f8bf8600700 1 -- 172.21.15.81:0/2010134851 wait complete. 2024-05-03T16:33:50.706 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:50 smithi081 ceph-mon[28640]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:33:50.706 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:50 smithi081 ceph-mon[28640]: Saving service mgr spec with placement count:2 2024-05-03T16:33:51.803 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.703+0000 7fb8d5000700 1 Processor -- start 2024-05-03T16:33:51.803 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.704+0000 7fb8d5000700 1 -- start start 2024-05-03T16:33:51.803 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.704+0000 7fb8d5000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d0108d10 0x7fb8d0109130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:51.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.704+0000 7fb8d5000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d0109700 con 0x7fb8d0108d10 2024-05-03T16:33:51.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.705+0000 7fb8cde00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d0108d10 0x7fb8d0109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:51.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.705+0000 7fb8cde00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d0108d10 0x7fb8d0109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58406/0 (socket says 172.21.15.81:58406) 2024-05-03T16:33:51.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.705+0000 7fb8cde00700 1 -- 172.21.15.81:0/1057983317 learned_addr learned my addr 172.21.15.81:0/1057983317 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:51.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.705+0000 7fb8cde00700 1 -- 172.21.15.81:0/1057983317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d0109f10 con 0x7fb8d0108d10 2024-05-03T16:33:51.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.706+0000 7fb8cde00700 1 --2- 172.21.15.81:0/1057983317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d0108d10 0x7fb8d0109130 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb8c00098a0 tx=0x7fb8c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a5562f9ee8f2d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:51.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.706+0000 7fb8cca00700 1 -- 172.21.15.81:0/1057983317 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8c0004160 con 0x7fb8d0108d10 2024-05-03T16:33:51.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.706+0000 7fb8cca00700 1 -- 172.21.15.81:0/1057983317 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8c0004300 con 0x7fb8d0108d10 2024-05-03T16:33:51.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.706+0000 7fb8cca00700 1 -- 172.21.15.81:0/1057983317 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8c0011960 con 0x7fb8d0108d10 2024-05-03T16:33:51.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.707+0000 7fb8d5000700 1 -- 172.21.15.81:0/1057983317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d0108d10 msgr2=0x7fb8d0109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:51.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.707+0000 7fb8d5000700 1 --2- 172.21.15.81:0/1057983317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d0108d10 0x7fb8d0109130 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb8c00098a0 tx=0x7fb8c0009bb0 comp rx=0 tx=0).stop 2024-05-03T16:33:51.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.707+0000 7fb8d5000700 1 -- 172.21.15.81:0/1057983317 shutdown_connections 2024-05-03T16:33:51.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.707+0000 7fb8d5000700 1 --2- 172.21.15.81:0/1057983317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d0108d10 0x7fb8d0109130 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:51.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.707+0000 7fb8d5000700 1 -- 172.21.15.81:0/1057983317 >> 172.21.15.81:0/1057983317 conn(0x7fb8d01042d0 msgr2=0x7fb8d01066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:51.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.707+0000 7fb8d5000700 1 -- 172.21.15.81:0/1057983317 shutdown_connections 2024-05-03T16:33:51.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.707+0000 7fb8d5000700 1 -- 172.21.15.81:0/1057983317 wait complete. 2024-05-03T16:33:51.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.708+0000 7fb8d5000700 1 Processor -- start 2024-05-03T16:33:51.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.708+0000 7fb8d5000700 1 -- start start 2024-05-03T16:33:51.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.708+0000 7fb8d5000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d0108d10 0x7fb8d019ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:51.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.708+0000 7fb8d5000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d010d140 con 0x7fb8d0108d10 2024-05-03T16:33:51.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.709+0000 7fb8cde00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d0108d10 0x7fb8d019ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:51.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.709+0000 7fb8cde00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d0108d10 0x7fb8d019ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58416/0 (socket says 172.21.15.81:58416) 2024-05-03T16:33:51.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.709+0000 7fb8cde00700 1 -- 172.21.15.81:0/1208392823 learned_addr learned my addr 172.21.15.81:0/1208392823 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:51.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.709+0000 7fb8cde00700 1 -- 172.21.15.81:0/1208392823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d019f2d0 con 0x7fb8d0108d10 2024-05-03T16:33:51.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.709+0000 7fb8cde00700 1 --2- 172.21.15.81:0/1208392823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d0108d10 0x7fb8d019ed90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0011670 tx=0x7fb8c0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:51.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.710+0000 7fb8c6a00700 1 -- 172.21.15.81:0/1208392823 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8c001f070 con 0x7fb8d0108d10 2024-05-03T16:33:51.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.710+0000 7fb8c6a00700 1 -- 172.21.15.81:0/1208392823 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8c0003b20 con 0x7fb8d0108d10 2024-05-03T16:33:51.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.710+0000 7fb8d5000700 1 -- 172.21.15.81:0/1208392823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d019f560 con 0x7fb8d0108d10 2024-05-03T16:33:51.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.710+0000 7fb8c6a00700 1 -- 172.21.15.81:0/1208392823 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8c0019580 con 0x7fb8d0108d10 2024-05-03T16:33:51.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.710+0000 7fb8d5000700 1 -- 172.21.15.81:0/1208392823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d01a2210 con 0x7fb8d0108d10 2024-05-03T16:33:51.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.711+0000 7fb8d5000700 1 -- 172.21.15.81:0/1208392823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d0064b00 con 0x7fb8d0108d10 2024-05-03T16:33:51.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.711+0000 7fb8c6a00700 1 -- 172.21.15.81:0/1208392823 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fb8c0022070 con 0x7fb8d0108d10 2024-05-03T16:33:51.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.712+0000 7fb8c6a00700 1 --2- 172.21.15.81:0/1208392823 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7fb8b403e470 0x7fb8b4040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:51.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.712+0000 7fb8c6a00700 1 -- 172.21.15.81:0/1208392823 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb8c0053ad0 con 0x7fb8d0108d10 2024-05-03T16:33:51.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.712+0000 7fb8cd400700 1 --2- 172.21.15.81:0/1208392823 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7fb8b403e470 0x7fb8b4040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:51.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.713+0000 7fb8cd400700 1 --2- 172.21.15.81:0/1208392823 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7fb8b403e470 0x7fb8b4040930 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc006fd0 tx=0x7fb8bc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:51.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.717+0000 7fb8c6a00700 1 -- 172.21.15.81:0/1208392823 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb8c0053420 con 0x7fb8d0108d10 2024-05-03T16:33:51.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.950+0000 7fb8d5000700 1 -- 172.21.15.81:0/1208392823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fb8d01a2860 con 0x7fb8d0108d10 2024-05-03T16:33:51.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.956+0000 7fb8c6a00700 1 -- 172.21.15.81:0/1208392823 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fb8c001ba80 con 0x7fb8d0108d10 2024-05-03T16:33:51.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.959+0000 7fb8d5000700 1 -- 172.21.15.81:0/1208392823 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7fb8b403e470 msgr2=0x7fb8b4040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:51.807 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.959+0000 7fb8d5000700 1 --2- 172.21.15.81:0/1208392823 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7fb8b403e470 0x7fb8b4040930 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc006fd0 tx=0x7fb8bc006e40 comp rx=0 tx=0).stop 2024-05-03T16:33:51.807 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.959+0000 7fb8d5000700 1 -- 172.21.15.81:0/1208392823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d0108d10 msgr2=0x7fb8d019ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:51.807 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.959+0000 7fb8d5000700 1 --2- 172.21.15.81:0/1208392823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d0108d10 0x7fb8d019ed90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0011670 tx=0x7fb8c0011a30 comp rx=0 tx=0).stop 2024-05-03T16:33:51.807 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.960+0000 7fb8d5000700 1 -- 172.21.15.81:0/1208392823 shutdown_connections 2024-05-03T16:33:51.807 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.960+0000 7fb8d5000700 1 --2- 172.21.15.81:0/1208392823 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7fb8b403e470 0x7fb8b4040930 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:51.807 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.960+0000 7fb8d5000700 1 --2- 172.21.15.81:0/1208392823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d0108d10 0x7fb8d019ed90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:51.807 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.960+0000 7fb8d5000700 1 -- 172.21.15.81:0/1208392823 >> 172.21.15.81:0/1208392823 conn(0x7fb8d01042d0 msgr2=0x7fb8d0104d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:51.807 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.960+0000 7fb8d5000700 1 -- 172.21.15.81:0/1208392823 shutdown_connections 2024-05-03T16:33:51.807 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:50.960+0000 7fb8d5000700 1 -- 172.21.15.81:0/1208392823 wait complete. 2024-05-03T16:33:52.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:51 smithi081 ceph-mon[28640]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:33:52.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:51 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1208392823' entity='client.admin' 2024-05-03T16:33:53.742 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.766+0000 7fe4a4800700 1 Processor -- start 2024-05-03T16:33:53.742 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.766+0000 7fe4a4800700 1 -- start start 2024-05-03T16:33:53.742 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.767+0000 7fe4a4800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe49c1075e0 0x7fe49c107a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:53.742 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.767+0000 7fe4a4800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c07ce80 con 0x7fe49c1075e0 2024-05-03T16:33:53.742 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.767+0000 7fe4a1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe49c1075e0 0x7fe49c107a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:53.742 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.767+0000 7fe4a1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe49c1075e0 0x7fe49c107a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58420/0 (socket says 172.21.15.81:58420) 2024-05-03T16:33:53.742 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.767+0000 7fe4a1e00700 1 -- 172.21.15.81:0/729298873 learned_addr learned my addr 172.21.15.81:0/729298873 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:53.743 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.768+0000 7fe4a1e00700 1 -- 172.21.15.81:0/729298873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe49c107f40 con 0x7fe49c1075e0 2024-05-03T16:33:53.743 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.768+0000 7fe4a1e00700 1 --2- 172.21.15.81:0/729298873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe49c1075e0 0x7fe49c107a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe4900098a0 tx=0x7fe490009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8935849f0c580b3f server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:53.743 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.768+0000 7fe4a0a00700 1 -- 172.21.15.81:0/729298873 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe490004160 con 0x7fe49c1075e0 2024-05-03T16:33:53.743 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.768+0000 7fe4a0a00700 1 -- 172.21.15.81:0/729298873 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe490004300 con 0x7fe49c1075e0 2024-05-03T16:33:53.743 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.768+0000 7fe4a0a00700 1 -- 172.21.15.81:0/729298873 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe490011960 con 0x7fe49c1075e0 2024-05-03T16:33:53.743 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.769+0000 7fe4a4800700 1 -- 172.21.15.81:0/729298873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe49c1075e0 msgr2=0x7fe49c107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:53.743 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.769+0000 7fe4a4800700 1 --2- 172.21.15.81:0/729298873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe49c1075e0 0x7fe49c107a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe4900098a0 tx=0x7fe490009bb0 comp rx=0 tx=0).stop 2024-05-03T16:33:53.743 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.769+0000 7fe4a4800700 1 -- 172.21.15.81:0/729298873 shutdown_connections 2024-05-03T16:33:53.743 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.769+0000 7fe4a4800700 1 --2- 172.21.15.81:0/729298873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe49c1075e0 0x7fe49c107a00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:53.743 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.769+0000 7fe4a4800700 1 -- 172.21.15.81:0/729298873 >> 172.21.15.81:0/729298873 conn(0x7fe49c103200 msgr2=0x7fe49c105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:53.743 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.769+0000 7fe4a4800700 1 -- 172.21.15.81:0/729298873 shutdown_connections 2024-05-03T16:33:53.743 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.769+0000 7fe4a4800700 1 -- 172.21.15.81:0/729298873 wait complete. 2024-05-03T16:33:53.743 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.770+0000 7fe4a4800700 1 Processor -- start 2024-05-03T16:33:53.743 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.771+0000 7fe4a4800700 1 -- start start 2024-05-03T16:33:53.743 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.771+0000 7fe4a4800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe49c1075e0 0x7fe49c19ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:53.744 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.771+0000 7fe4a4800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c108f50 con 0x7fe49c1075e0 2024-05-03T16:33:53.744 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.771+0000 7fe4a1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe49c1075e0 0x7fe49c19ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:53.744 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.771+0000 7fe4a1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe49c1075e0 0x7fe49c19ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58430/0 (socket says 172.21.15.81:58430) 2024-05-03T16:33:53.744 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.771+0000 7fe4a1e00700 1 -- 172.21.15.81:0/1284154586 learned_addr learned my addr 172.21.15.81:0/1284154586 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:53.744 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.771+0000 7fe4a1e00700 1 -- 172.21.15.81:0/1284154586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe49c19f270 con 0x7fe49c1075e0 2024-05-03T16:33:53.744 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.772+0000 7fe4a1e00700 1 --2- 172.21.15.81:0/1284154586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe49c1075e0 0x7fe49c19ed30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe490011670 tx=0x7fe490011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:53.744 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.772+0000 7fe496a00700 1 -- 172.21.15.81:0/1284154586 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe49001f070 con 0x7fe49c1075e0 2024-05-03T16:33:53.744 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.772+0000 7fe496a00700 1 -- 172.21.15.81:0/1284154586 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe490003b20 con 0x7fe49c1075e0 2024-05-03T16:33:53.744 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.772+0000 7fe4a4800700 1 -- 172.21.15.81:0/1284154586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe49c19f500 con 0x7fe49c1075e0 2024-05-03T16:33:53.744 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.772+0000 7fe496a00700 1 -- 172.21.15.81:0/1284154586 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4900195f0 con 0x7fe49c1075e0 2024-05-03T16:33:53.744 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.772+0000 7fe4a4800700 1 -- 172.21.15.81:0/1284154586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe49c1a21f0 con 0x7fe49c1075e0 2024-05-03T16:33:53.744 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.773+0000 7fe496a00700 1 -- 172.21.15.81:0/1284154586 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fe490022070 con 0x7fe49c1075e0 2024-05-03T16:33:53.744 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.773+0000 7fe4a4800700 1 -- 172.21.15.81:0/1284154586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe49c064b00 con 0x7fe49c1075e0 2024-05-03T16:33:53.744 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.774+0000 7fe496a00700 1 --2- 172.21.15.81:0/1284154586 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7fe48403e4c0 0x7fe484040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:53.744 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.774+0000 7fe496a00700 1 -- 172.21.15.81:0/1284154586 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe4900539b0 con 0x7fe49c1075e0 2024-05-03T16:33:53.745 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.774+0000 7fe4a1400700 1 --2- 172.21.15.81:0/1284154586 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7fe48403e4c0 0x7fe484040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:53.745 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.775+0000 7fe4a1400700 1 --2- 172.21.15.81:0/1284154586 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7fe48403e4c0 0x7fe484040980 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe48c006fd0 tx=0x7fe48c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:53.745 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:52.779+0000 7fe496a00700 1 -- 172.21.15.81:0/1284154586 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe49002cd20 con 0x7fe49c1075e0 2024-05-03T16:33:53.745 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:53.013+0000 7fe4a4800700 1 -- 172.21.15.81:0/1284154586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fe49c02e810 con 0x7fe49c1075e0 2024-05-03T16:33:53.745 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:53.017+0000 7fe496a00700 1 -- 172.21.15.81:0/1284154586 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fe49001b440 con 0x7fe49c1075e0 2024-05-03T16:33:53.745 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:53.020+0000 7fe4a4800700 1 -- 172.21.15.81:0/1284154586 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7fe48403e4c0 msgr2=0x7fe484040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:53.745 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:53.020+0000 7fe4a4800700 1 --2- 172.21.15.81:0/1284154586 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7fe48403e4c0 0x7fe484040980 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe48c006fd0 tx=0x7fe48c006e40 comp rx=0 tx=0).stop 2024-05-03T16:33:53.746 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:53.020+0000 7fe4a4800700 1 -- 172.21.15.81:0/1284154586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe49c1075e0 msgr2=0x7fe49c19ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:53.746 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:53.020+0000 7fe4a4800700 1 --2- 172.21.15.81:0/1284154586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe49c1075e0 0x7fe49c19ed30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe490011670 tx=0x7fe490011a30 comp rx=0 tx=0).stop 2024-05-03T16:33:53.746 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:53.021+0000 7fe4a4800700 1 -- 172.21.15.81:0/1284154586 shutdown_connections 2024-05-03T16:33:53.746 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:53.021+0000 7fe4a4800700 1 --2- 172.21.15.81:0/1284154586 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7fe48403e4c0 0x7fe484040980 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:53.746 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:53.021+0000 7fe4a4800700 1 --2- 172.21.15.81:0/1284154586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe49c1075e0 0x7fe49c19ed30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:53.746 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:53.021+0000 7fe4a4800700 1 -- 172.21.15.81:0/1284154586 >> 172.21.15.81:0/1284154586 conn(0x7fe49c103200 msgr2=0x7fe49c1959a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:53.746 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:53.021+0000 7fe4a4800700 1 -- 172.21.15.81:0/1284154586 shutdown_connections 2024-05-03T16:33:53.746 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:53.021+0000 7fe4a4800700 1 -- 172.21.15.81:0/1284154586 wait complete. 2024-05-03T16:33:53.746 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling the dashboard module... 2024-05-03T16:33:53.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:53 smithi081 ceph-mon[28640]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:33:53.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:53 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' 2024-05-03T16:33:53.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:53 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1284154586' entity='client.admin' 2024-05-03T16:33:54.924 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:54 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/336935462' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-03T16:33:55.207 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: ignoring --setuser ceph since I am not root 2024-05-03T16:33:55.208 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: ignoring --setgroup ceph since I am not root 2024-05-03T16:33:55.208 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:55 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:55.101+0000 7f8ef583b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-03T16:33:55.478 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:55 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:55.346+0000 7f8ef583b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-03T16:33:55.478 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:55 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:55.475+0000 7f8ef583b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-03T16:33:55.567 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.360+0000 7f04b4000700 1 Processor -- start 2024-05-03T16:33:55.568 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.361+0000 7f04b4000700 1 -- start start 2024-05-03T16:33:55.568 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.361+0000 7f04b4000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac10af10 0x7f04ac10b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:55.568 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.361+0000 7f04b4000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac10b870 con 0x7f04ac10af10 2024-05-03T16:33:55.568 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.361+0000 7f04b1600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac10af10 0x7f04ac10b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:55.568 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.361+0000 7f04b1600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac10af10 0x7f04ac10b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58440/0 (socket says 172.21.15.81:58440) 2024-05-03T16:33:55.568 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.361+0000 7f04b1600700 1 -- 172.21.15.81:0/1028516343 learned_addr learned my addr 172.21.15.81:0/1028516343 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:55.568 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.362+0000 7f04b1600700 1 -- 172.21.15.81:0/1028516343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ac10c070 con 0x7f04ac10af10 2024-05-03T16:33:55.568 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.362+0000 7f04b1600700 1 --2- 172.21.15.81:0/1028516343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac10af10 0x7f04ac10b330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f04a00098a0 tx=0x7f04a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d707843e00db60fa server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:55.568 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.362+0000 7f04abe00700 1 -- 172.21.15.81:0/1028516343 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04a0004160 con 0x7f04ac10af10 2024-05-03T16:33:55.568 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.363+0000 7f04abe00700 1 -- 172.21.15.81:0/1028516343 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04a0004300 con 0x7f04ac10af10 2024-05-03T16:33:55.568 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.363+0000 7f04abe00700 1 -- 172.21.15.81:0/1028516343 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04a0011960 con 0x7f04ac10af10 2024-05-03T16:33:55.568 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.363+0000 7f04b4000700 1 -- 172.21.15.81:0/1028516343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac10af10 msgr2=0x7f04ac10b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:55.568 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.363+0000 7f04b4000700 1 --2- 172.21.15.81:0/1028516343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac10af10 0x7f04ac10b330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f04a00098a0 tx=0x7f04a0009bb0 comp rx=0 tx=0).stop 2024-05-03T16:33:55.569 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.363+0000 7f04b4000700 1 -- 172.21.15.81:0/1028516343 shutdown_connections 2024-05-03T16:33:55.569 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.363+0000 7f04b4000700 1 --2- 172.21.15.81:0/1028516343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac10af10 0x7f04ac10b330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:55.569 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.363+0000 7f04b4000700 1 -- 172.21.15.81:0/1028516343 >> 172.21.15.81:0/1028516343 conn(0x7f04ac07e300 msgr2=0x7f04ac07e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:55.569 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.364+0000 7f04b4000700 1 -- 172.21.15.81:0/1028516343 shutdown_connections 2024-05-03T16:33:55.569 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.364+0000 7f04b4000700 1 -- 172.21.15.81:0/1028516343 wait complete. 2024-05-03T16:33:55.569 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.365+0000 7f04b4000700 1 Processor -- start 2024-05-03T16:33:55.569 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.365+0000 7f04b4000700 1 -- start start 2024-05-03T16:33:55.569 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.365+0000 7f04b4000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac10af10 0x7f04ac19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:55.569 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.365+0000 7f04b4000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac10f330 con 0x7f04ac10af10 2024-05-03T16:33:55.569 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.365+0000 7f04b1600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac10af10 0x7f04ac19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:55.569 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.365+0000 7f04b1600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac10af10 0x7f04ac19ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58450/0 (socket says 172.21.15.81:58450) 2024-05-03T16:33:55.569 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.365+0000 7f04b1600700 1 -- 172.21.15.81:0/336935462 learned_addr learned my addr 172.21.15.81:0/336935462 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:55.569 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.366+0000 7f04b1600700 1 -- 172.21.15.81:0/336935462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ac19f3b0 con 0x7f04ac10af10 2024-05-03T16:33:55.569 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.366+0000 7f04b1600700 1 --2- 172.21.15.81:0/336935462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac10af10 0x7f04ac19ee70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f04a0011670 tx=0x7f04a0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:55.569 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.366+0000 7f04aa000700 1 -- 172.21.15.81:0/336935462 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04a001f070 con 0x7f04ac10af10 2024-05-03T16:33:55.570 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.366+0000 7f04aa000700 1 -- 172.21.15.81:0/336935462 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04a0003b20 con 0x7f04ac10af10 2024-05-03T16:33:55.570 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.367+0000 7f04b4000700 1 -- 172.21.15.81:0/336935462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04ac19f640 con 0x7f04ac10af10 2024-05-03T16:33:55.570 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.367+0000 7f04aa000700 1 -- 172.21.15.81:0/336935462 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04a00195f0 con 0x7f04ac10af10 2024-05-03T16:33:55.570 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.367+0000 7f04b4000700 1 -- 172.21.15.81:0/336935462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04ac1a2330 con 0x7f04ac10af10 2024-05-03T16:33:55.570 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.368+0000 7f04b4000700 1 -- 172.21.15.81:0/336935462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04ac064b00 con 0x7f04ac10af10 2024-05-03T16:33:55.570 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.368+0000 7f04aa000700 1 -- 172.21.15.81:0/336935462 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f04a0022070 con 0x7f04ac10af10 2024-05-03T16:33:55.570 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.368+0000 7f04aa000700 1 --2- 172.21.15.81:0/336935462 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f049403e470 0x7f0494040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:55.570 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.369+0000 7f04aa000700 1 -- 172.21.15.81:0/336935462 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f04a0053cd0 con 0x7f04ac10af10 2024-05-03T16:33:55.570 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.369+0000 7f04b0c00700 1 --2- 172.21.15.81:0/336935462 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f049403e470 0x7f0494040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:55.570 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.370+0000 7f04b0c00700 1 --2- 172.21.15.81:0/336935462 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f049403e470 0x7f0494040930 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0498006fd0 tx=0x7f0498006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:55.570 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.374+0000 7f04aa000700 1 -- 172.21.15.81:0/336935462 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f04a00172b0 con 0x7f04ac10af10 2024-05-03T16:33:55.570 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.670+0000 7f04b4000700 1 -- 172.21.15.81:0/336935462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f04ac1a2770 con 0x7f04ac10af10 2024-05-03T16:33:55.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.806+0000 7f04aa000700 1 -- 172.21.15.81:0/336935462 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f04a0019df0 con 0x7f04ac10af10 2024-05-03T16:33:55.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.810+0000 7f04aa000700 1 -- 172.21.15.81:0/336935462 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f04a0019870 con 0x7f04ac10af10 2024-05-03T16:33:55.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.811+0000 7f04b4000700 1 -- 172.21.15.81:0/336935462 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f049403e470 msgr2=0x7f0494040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:55.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.811+0000 7f04b4000700 1 --2- 172.21.15.81:0/336935462 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f049403e470 0x7f0494040930 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0498006fd0 tx=0x7f0498006e40 comp rx=0 tx=0).stop 2024-05-03T16:33:55.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.811+0000 7f04b4000700 1 -- 172.21.15.81:0/336935462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac10af10 msgr2=0x7f04ac19ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:55.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.811+0000 7f04b4000700 1 --2- 172.21.15.81:0/336935462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac10af10 0x7f04ac19ee70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f04a0011670 tx=0x7f04a0011a30 comp rx=0 tx=0).stop 2024-05-03T16:33:55.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.811+0000 7f04b4000700 1 -- 172.21.15.81:0/336935462 shutdown_connections 2024-05-03T16:33:55.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.811+0000 7f04b4000700 1 --2- 172.21.15.81:0/336935462 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f049403e470 0x7f0494040930 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:55.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.811+0000 7f04b4000700 1 --2- 172.21.15.81:0/336935462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac10af10 0x7f04ac19ee70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:55.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.811+0000 7f04b4000700 1 -- 172.21.15.81:0/336935462 >> 172.21.15.81:0/336935462 conn(0x7f04ac07e300 msgr2=0x7f04ac108420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:55.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.812+0000 7f04b4000700 1 -- 172.21.15.81:0/336935462 shutdown_connections 2024-05-03T16:33:55.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:54.812+0000 7f04b4000700 1 -- 172.21.15.81:0/336935462 wait complete. 2024-05-03T16:33:56.126 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:55 smithi081 ceph-mon[28640]: from='mgr.14120 172.21.15.81:0/1194984376' entity='mgr.x' 2024-05-03T16:33:56.126 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:55 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/336935462' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-03T16:33:56.126 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:55 smithi081 ceph-mon[28640]: mgrmap e9: x(active, since 24s) 2024-05-03T16:33:56.126 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:55 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:55.902+0000 7f8ef583b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-03T16:33:56.126 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:56 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:56.020+0000 7f8ef583b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-03T16:33:57.177 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:33:56 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3256415142' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-03T16:33:57.216 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-05-03T16:33:57.222 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-03T16:33:57.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-03T16:33:57.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-03T16:33:57.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-03T16:33:57.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-05-03T16:33:57.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.175+0000 7f23e8c00700 1 Processor -- start 2024-05-03T16:33:57.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.175+0000 7f23e8c00700 1 -- start start 2024-05-03T16:33:57.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.175+0000 7f23e8c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e407ee90 0x7f23e407d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:57.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.175+0000 7f23e8c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f23e407d8c0 con 0x7f23e407ee90 2024-05-03T16:33:57.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.176+0000 7f23e3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e407ee90 0x7f23e407d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:57.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.176+0000 7f23e3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e407ee90 0x7f23e407d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34566/0 (socket says 172.21.15.81:34566) 2024-05-03T16:33:57.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.176+0000 7f23e3400700 1 -- 172.21.15.81:0/2981850366 learned_addr learned my addr 172.21.15.81:0/2981850366 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:57.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.177+0000 7f23e3400700 1 -- 172.21.15.81:0/2981850366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e407da40 con 0x7f23e407ee90 2024-05-03T16:33:57.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.177+0000 7f23e3400700 1 --2- 172.21.15.81:0/2981850366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e407ee90 0x7f23e407d2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f23d40098a0 tx=0x7f23d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3dc43eb146f9833 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:57.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.177+0000 7f23e2000700 1 -- 172.21.15.81:0/2981850366 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d4004160 con 0x7f23e407ee90 2024-05-03T16:33:57.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.177+0000 7f23e2000700 1 -- 172.21.15.81:0/2981850366 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23d4004300 con 0x7f23e407ee90 2024-05-03T16:33:57.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.177+0000 7f23e2000700 1 -- 172.21.15.81:0/2981850366 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d4011960 con 0x7f23e407ee90 2024-05-03T16:33:57.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.178+0000 7f23e8c00700 1 -- 172.21.15.81:0/2981850366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e407ee90 msgr2=0x7f23e407d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:57.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.178+0000 7f23e8c00700 1 --2- 172.21.15.81:0/2981850366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e407ee90 0x7f23e407d2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f23d40098a0 tx=0x7f23d4009bb0 comp rx=0 tx=0).stop 2024-05-03T16:33:57.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.178+0000 7f23e8c00700 1 -- 172.21.15.81:0/2981850366 shutdown_connections 2024-05-03T16:33:57.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.178+0000 7f23e8c00700 1 --2- 172.21.15.81:0/2981850366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e407ee90 0x7f23e407d2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:57.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.178+0000 7f23e8c00700 1 -- 172.21.15.81:0/2981850366 >> 172.21.15.81:0/2981850366 conn(0x7f23e41040f0 msgr2=0x7f23e4106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:57.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.178+0000 7f23e8c00700 1 -- 172.21.15.81:0/2981850366 shutdown_connections 2024-05-03T16:33:57.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.178+0000 7f23e8c00700 1 -- 172.21.15.81:0/2981850366 wait complete. 2024-05-03T16:33:57.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.179+0000 7f23e8c00700 1 Processor -- start 2024-05-03T16:33:57.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.180+0000 7f23e8c00700 1 -- start start 2024-05-03T16:33:57.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.180+0000 7f23e8c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e407ee90 0x7f23e419eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:57.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.180+0000 7f23e8c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f23e410f110 con 0x7f23e407ee90 2024-05-03T16:33:57.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.180+0000 7f23e3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e407ee90 0x7f23e419eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:33:57.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.180+0000 7f23e3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e407ee90 0x7f23e419eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34578/0 (socket says 172.21.15.81:34578) 2024-05-03T16:33:57.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.180+0000 7f23e3400700 1 -- 172.21.15.81:0/3256415142 learned_addr learned my addr 172.21.15.81:0/3256415142 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:33:57.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.181+0000 7f23e3400700 1 -- 172.21.15.81:0/3256415142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e419efe0 con 0x7f23e407ee90 2024-05-03T16:33:57.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.181+0000 7f23e3400700 1 --2- 172.21.15.81:0/3256415142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e407ee90 0x7f23e419eaa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f23d4011670 tx=0x7f23d4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:33:57.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.181+0000 7f23dbe00700 1 -- 172.21.15.81:0/3256415142 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d4003a60 con 0x7f23e407ee90 2024-05-03T16:33:57.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.181+0000 7f23dbe00700 1 -- 172.21.15.81:0/3256415142 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23d401b8d0 con 0x7f23e407ee90 2024-05-03T16:33:57.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.181+0000 7f23dbe00700 1 -- 172.21.15.81:0/3256415142 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d4023790 con 0x7f23e407ee90 2024-05-03T16:33:57.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.181+0000 7f23e8c00700 1 -- 172.21.15.81:0/3256415142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e419f270 con 0x7f23e407ee90 2024-05-03T16:33:57.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.181+0000 7f23e8c00700 1 -- 172.21.15.81:0/3256415142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e41a1f60 con 0x7f23e407ee90 2024-05-03T16:33:57.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.182+0000 7f23e8c00700 1 -- 172.21.15.81:0/3256415142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e4064b00 con 0x7f23e407ee90 2024-05-03T16:33:57.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.183+0000 7f23dbe00700 1 -- 172.21.15.81:0/3256415142 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f23d401b440 con 0x7f23e407ee90 2024-05-03T16:33:57.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.184+0000 7f23dbe00700 1 --2- 172.21.15.81:0/3256415142 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f23c803e520 0x7f23c80409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:33:57.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.184+0000 7f23dbe00700 1 -- 172.21.15.81:0/3256415142 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f23d4054070 con 0x7f23e407ee90 2024-05-03T16:33:57.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.184+0000 7f23e2a00700 1 -- 172.21.15.81:0/3256415142 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f23c803e520 msgr2=0x7f23c80409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2734678359 2024-05-03T16:33:57.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.184+0000 7f23e2a00700 1 --2- 172.21.15.81:0/3256415142 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f23c803e520 0x7f23c80409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-03T16:33:57.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.189+0000 7f23dbe00700 1 -- 172.21.15.81:0/3256415142 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f23d401f030 con 0x7f23e407ee90 2024-05-03T16:33:57.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.385+0000 7f23e2a00700 1 -- 172.21.15.81:0/3256415142 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f23c803e520 msgr2=0x7f23c80409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2734678359 2024-05-03T16:33:57.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.385+0000 7f23e2a00700 1 --2- 172.21.15.81:0/3256415142 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f23c803e520 0x7f23c80409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-03T16:33:57.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.475+0000 7f23e8c00700 1 -- 172.21.15.81:0/3256415142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f23e41a21d0 con 0x7f23e407ee90 2024-05-03T16:33:57.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.475+0000 7f23dbe00700 1 -- 172.21.15.81:0/3256415142 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f23d401bda0 con 0x7f23e407ee90 2024-05-03T16:33:57.227 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.478+0000 7f23e8c00700 1 -- 172.21.15.81:0/3256415142 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f23c803e520 msgr2=0x7f23c80409e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-03T16:33:57.227 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.478+0000 7f23e8c00700 1 --2- 172.21.15.81:0/3256415142 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f23c803e520 0x7f23c80409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:57.227 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.478+0000 7f23e8c00700 1 -- 172.21.15.81:0/3256415142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e407ee90 msgr2=0x7f23e419eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:33:57.227 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.478+0000 7f23e8c00700 1 --2- 172.21.15.81:0/3256415142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e407ee90 0x7f23e419eaa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f23d4011670 tx=0x7f23d4011a30 comp rx=0 tx=0).stop 2024-05-03T16:33:57.227 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.478+0000 7f23e8c00700 1 -- 172.21.15.81:0/3256415142 shutdown_connections 2024-05-03T16:33:57.227 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.478+0000 7f23e8c00700 1 --2- 172.21.15.81:0/3256415142 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f23c803e520 0x7f23c80409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:57.227 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.478+0000 7f23e8c00700 1 --2- 172.21.15.81:0/3256415142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e407ee90 0x7f23e419eaa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:33:57.227 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.478+0000 7f23e8c00700 1 -- 172.21.15.81:0/3256415142 >> 172.21.15.81:0/3256415142 conn(0x7f23e41040f0 msgr2=0x7f23e4104b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:33:57.227 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.478+0000 7f23e8c00700 1 -- 172.21.15.81:0/3256415142 shutdown_connections 2024-05-03T16:33:57.227 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:56.478+0000 7f23e8c00700 1 -- 172.21.15.81:0/3256415142 wait complete. 2024-05-03T16:33:57.227 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for the mgr to restart... 2024-05-03T16:33:57.227 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr epoch 9... 2024-05-03T16:33:57.802 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:57 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:57.665+0000 7f8ef583b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-03T16:33:58.099 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:57 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:57.903+0000 7f8ef583b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-03T16:33:58.414 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:58 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:58.125+0000 7f8ef583b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-03T16:33:58.740 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:58 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:58.506+0000 7f8ef583b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-03T16:33:58.740 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:58 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:58.630+0000 7f8ef583b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-03T16:33:59.138 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:58 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:58.882+0000 7f8ef583b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-03T16:33:59.138 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:59 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:59.136+0000 7f8ef583b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-03T16:34:00.202 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:33:59 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:33:59.914+0000 7f8ef583b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-03T16:34:00.490 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:34:00 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:34:00.199+0000 7f8ef583b200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-03T16:34:01.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:34:00 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:34:00.750+0000 7f8ef583b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-03T16:34:01.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:34:00 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:34:00.876+0000 7f8ef583b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-03T16:34:01.740 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:34:01 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:34:01.339+0000 7f8ef583b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-03T16:34:02.231 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:34:01 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:34:01.787+0000 7f8ef583b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-03T16:34:02.231 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:34:01 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:34:01.910+0000 7f8ef583b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-03T16:34:02.231 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:34:02 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:34:02.229+0000 7f8ef583b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-03T16:34:02.490 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:34:02 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:34:02.406+0000 7f8ef583b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-03T16:34:03.049 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:34:02 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:34:02.776+0000 7f8ef583b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-03T16:34:03.050 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:34:02 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:34:02.925+0000 7f8ef583b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-03T16:34:03.050 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:34:03 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:34:03.048+0000 7f8ef583b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-03T16:34:04.087 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:34:03 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:34:03.798+0000 7f8ef583b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-03T16:34:04.087 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:34:04 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:34:04.085+0000 7f8ef583b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-03T16:34:04.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:04 smithi081 ceph-mon[28640]: Active manager daemon x restarted 2024-05-03T16:34:04.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:04 smithi081 ceph-mon[28640]: Activating manager daemon x 2024-05-03T16:34:04.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:04 smithi081 ceph-mon[28640]: osdmap e3: 0 total, 0 up, 0 in 2024-05-03T16:34:04.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:04 smithi081 ceph-mon[28640]: mgrmap e10: x(active, starting, since 0.0101075s) 2024-05-03T16:34:04.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T16:34:04.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-03T16:34:04.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-03T16:34:04.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-03T16:34:04.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-03T16:34:04.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:04 smithi081 ceph-mon[28640]: Manager daemon x is now available 2024-05-03T16:34:05.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:34:05.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-03T16:34:05.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-03T16:34:05.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:05 smithi081 ceph-mon[28640]: [03/May/2024:16:34:04] ENGINE Bus STARTING 2024-05-03T16:34:05.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:05 smithi081 ceph-mon[28640]: [03/May/2024:16:34:04] ENGINE Serving on https://172.21.15.81:7150 2024-05-03T16:34:05.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:05 smithi081 ceph-mon[28640]: [03/May/2024:16:34:04] ENGINE Serving on http://172.21.15.81:8765 2024-05-03T16:34:05.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:05 smithi081 ceph-mon[28640]: [03/May/2024:16:34:04] ENGINE Bus STARTED 2024-05-03T16:34:05.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:05 smithi081 ceph-mon[28640]: mgrmap e11: x(active, since 1.01049s) 2024-05-03T16:34:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-05-03T16:34:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-03T16:34:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-03T16:34:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-05-03T16:34:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.800+0000 7f8b00c00700 1 Processor -- start 2024-05-03T16:34:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.800+0000 7f8b00c00700 1 -- start start 2024-05-03T16:34:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.800+0000 7f8b00c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8afc1075a0 0x7f8afc1099d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.800+0000 7f8b00c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc07cec0 con 0x7f8afc1075a0 2024-05-03T16:34:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.801+0000 7f8af9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8afc1075a0 0x7f8afc1099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.801+0000 7f8af9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8afc1075a0 0x7f8afc1099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34584/0 (socket says 172.21.15.81:34584) 2024-05-03T16:34:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.801+0000 7f8af9e00700 1 -- 172.21.15.81:0/183492172 learned_addr learned my addr 172.21.15.81:0/183492172 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:34:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.801+0000 7f8af9e00700 1 -- 172.21.15.81:0/183492172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8afc109f10 con 0x7f8afc1075a0 2024-05-03T16:34:06.172 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.802+0000 7f8af9e00700 1 --2- 172.21.15.81:0/183492172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8afc1075a0 0x7f8afc1099d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0098a0 tx=0x7f8aec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91c31e6cfb21ac8 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:06.172 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.802+0000 7f8af8a00700 1 -- 172.21.15.81:0/183492172 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aec004160 con 0x7f8afc1075a0 2024-05-03T16:34:06.172 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.802+0000 7f8af8a00700 1 -- 172.21.15.81:0/183492172 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8aec004300 con 0x7f8afc1075a0 2024-05-03T16:34:06.172 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.802+0000 7f8af8a00700 1 -- 172.21.15.81:0/183492172 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aec011960 con 0x7f8afc1075a0 2024-05-03T16:34:06.172 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.803+0000 7f8b00c00700 1 -- 172.21.15.81:0/183492172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8afc1075a0 msgr2=0x7f8afc1099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:06.172 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.803+0000 7f8b00c00700 1 --2- 172.21.15.81:0/183492172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8afc1075a0 0x7f8afc1099d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0098a0 tx=0x7f8aec009bb0 comp rx=0 tx=0).stop 2024-05-03T16:34:06.172 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.803+0000 7f8b00c00700 1 -- 172.21.15.81:0/183492172 shutdown_connections 2024-05-03T16:34:06.172 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.803+0000 7f8b00c00700 1 --2- 172.21.15.81:0/183492172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8afc1075a0 0x7f8afc1099d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:06.172 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.803+0000 7f8b00c00700 1 -- 172.21.15.81:0/183492172 >> 172.21.15.81:0/183492172 conn(0x7f8afc103200 msgr2=0x7f8afc105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:06.172 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.804+0000 7f8b00c00700 1 -- 172.21.15.81:0/183492172 shutdown_connections 2024-05-03T16:34:06.172 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.804+0000 7f8b00c00700 1 -- 172.21.15.81:0/183492172 wait complete. 2024-05-03T16:34:06.172 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.804+0000 7f8b00c00700 1 Processor -- start 2024-05-03T16:34:06.172 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.805+0000 7f8b00c00700 1 -- start start 2024-05-03T16:34:06.172 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.805+0000 7f8b00c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8afc1075a0 0x7f8afc1a3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:06.172 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.805+0000 7f8b00c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc10af20 con 0x7f8afc1075a0 2024-05-03T16:34:06.173 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.805+0000 7f8af9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8afc1075a0 0x7f8afc1a3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:06.173 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.805+0000 7f8af9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8afc1075a0 0x7f8afc1a3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34600/0 (socket says 172.21.15.81:34600) 2024-05-03T16:34:06.173 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.805+0000 7f8af9e00700 1 -- 172.21.15.81:0/1978814416 learned_addr learned my addr 172.21.15.81:0/1978814416 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:34:06.173 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.806+0000 7f8af9e00700 1 -- 172.21.15.81:0/1978814416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8afc1a36a0 con 0x7f8afc1075a0 2024-05-03T16:34:06.173 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.806+0000 7f8af9e00700 1 --2- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8afc1075a0 0x7f8afc1a3160 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8aec011670 tx=0x7f8aec003980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:06.173 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.806+0000 7f8af2a00700 1 -- 172.21.15.81:0/1978814416 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aec011a90 con 0x7f8afc1075a0 2024-05-03T16:34:06.173 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.806+0000 7f8af2a00700 1 -- 172.21.15.81:0/1978814416 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8aec01e070 con 0x7f8afc1075a0 2024-05-03T16:34:06.173 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.806+0000 7f8af2a00700 1 -- 172.21.15.81:0/1978814416 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aec01a430 con 0x7f8afc1075a0 2024-05-03T16:34:06.173 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.806+0000 7f8b00c00700 1 -- 172.21.15.81:0/1978814416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8afc1a3930 con 0x7f8afc1075a0 2024-05-03T16:34:06.173 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.806+0000 7f8b00c00700 1 -- 172.21.15.81:0/1978814416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8afc1a6620 con 0x7f8afc1075a0 2024-05-03T16:34:06.173 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.808+0000 7f8af2a00700 1 -- 172.21.15.81:0/1978814416 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f8aec023470 con 0x7f8afc1075a0 2024-05-03T16:34:06.173 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.808+0000 7f8af2a00700 1 --2- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8ae003e510 0x7f8ae00409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:06.173 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.808+0000 7f8af2a00700 1 -- 172.21.15.81:0/1978814416 --> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8ae00410e0 con 0x7f8ae003e510 2024-05-03T16:34:06.173 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.809+0000 7f8af2a00700 1 -- 172.21.15.81:0/1978814416 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8aec053880 con 0x7f8afc1075a0 2024-05-03T16:34:06.173 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.809+0000 7f8af9400700 1 -- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8ae003e510 msgr2=0x7f8ae00409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2734678359 2024-05-03T16:34:06.174 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:57.809+0000 7f8af9400700 1 --2- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8ae003e510 0x7f8ae00409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-03T16:34:06.174 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:58.010+0000 7f8af9400700 1 -- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8ae003e510 msgr2=0x7f8ae00409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2734678359 2024-05-03T16:34:06.174 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:58.010+0000 7f8af9400700 1 --2- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8ae003e510 0x7f8ae00409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-03T16:34:06.174 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:58.411+0000 7f8af9400700 1 -- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8ae003e510 msgr2=0x7f8ae00409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2734678359 2024-05-03T16:34:06.174 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:58.411+0000 7f8af9400700 1 --2- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8ae003e510 0x7f8ae00409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-03T16:34:06.174 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:59.212+0000 7f8af9400700 1 -- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8ae003e510 msgr2=0x7f8ae00409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2734678359 2024-05-03T16:34:06.174 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:33:59.212+0000 7f8af9400700 1 --2- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8ae003e510 0x7f8ae00409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-03T16:34:06.174 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:00.815+0000 7f8af9400700 1 -- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8ae003e510 msgr2=0x7f8ae00409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2734678359 2024-05-03T16:34:06.174 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:00.815+0000 7f8af9400700 1 --2- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8ae003e510 0x7f8ae00409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-03T16:34:06.174 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:04.018+0000 7f8af9400700 1 -- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8ae003e510 msgr2=0x7f8ae00409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2734678359 2024-05-03T16:34:06.174 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:04.019+0000 7f8af9400700 1 --2- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8ae003e510 0x7f8ae00409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-03T16:34:06.174 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:04.096+0000 7f8af2a00700 1 -- 172.21.15.81:0/1978814416 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mgrmap(e 10) ==== 50002+0+0 (secure 0 0 0) 0x7f8aec016bd0 con 0x7f8afc1075a0 2024-05-03T16:34:06.174 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:04.096+0000 7f8af2a00700 1 -- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8ae003e510 msgr2=0x7f8ae00409d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-03T16:34:06.174 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:04.096+0000 7f8af2a00700 1 --2- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8ae003e510 0x7f8ae00409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:06.175 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:05.096+0000 7f8af2a00700 1 -- 172.21.15.81:0/1978814416 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 11) ==== 50129+0+0 (secure 0 0 0) 0x7f8aec0550c0 con 0x7f8afc1075a0 2024-05-03T16:34:06.175 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:05.096+0000 7f8af2a00700 1 --2- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8ae0041f90 0x7f8ae0044380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:06.175 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:05.096+0000 7f8af2a00700 1 -- 172.21.15.81:0/1978814416 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8aec052ea0 con 0x7f8ae0041f90 2024-05-03T16:34:06.175 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:05.098+0000 7f8af9400700 1 --2- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8ae0041f90 0x7f8ae0044380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:06.175 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:05.100+0000 7f8af9400700 1 --2- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8ae0041f90 0x7f8ae0044380 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8003a10 tx=0x7f8ae80092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:06.175 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:05.101+0000 7f8af2a00700 1 -- 172.21.15.81:0/1978814416 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f8aec052ea0 con 0x7f8ae0041f90 2024-05-03T16:34:06.175 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:05.110+0000 7f8b00c00700 1 -- 172.21.15.81:0/1978814416 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f8afc064b00 con 0x7f8ae0041f90 2024-05-03T16:34:06.175 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:05.111+0000 7f8af2a00700 1 -- 172.21.15.81:0/1978814416 <== mgr.14152 v2:172.21.15.81:6800/1773670984 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f8afc064b00 con 0x7f8ae0041f90 2024-05-03T16:34:06.175 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:05.111+0000 7f8b00c00700 1 -- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8ae0041f90 msgr2=0x7f8ae0044380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:06.175 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:05.111+0000 7f8b00c00700 1 --2- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8ae0041f90 0x7f8ae0044380 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8003a10 tx=0x7f8ae80092b0 comp rx=0 tx=0).stop 2024-05-03T16:34:06.175 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:05.111+0000 7f8b00c00700 1 -- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8afc1075a0 msgr2=0x7f8afc1a3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:06.175 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:05.111+0000 7f8b00c00700 1 --2- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8afc1075a0 0x7f8afc1a3160 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8aec011670 tx=0x7f8aec003980 comp rx=0 tx=0).stop 2024-05-03T16:34:06.175 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:05.112+0000 7f8b00c00700 1 -- 172.21.15.81:0/1978814416 shutdown_connections 2024-05-03T16:34:06.175 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:05.112+0000 7f8b00c00700 1 --2- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8ae0041f90 0x7f8ae0044380 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:06.175 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:05.112+0000 7f8b00c00700 1 --2- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8afc1075a0 0x7f8afc1a3160 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:06.176 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:05.112+0000 7f8b00c00700 1 --2- 172.21.15.81:0/1978814416 >> [v2:172.21.15.81:6800/2734678359,v1:172.21.15.81:6801/2734678359] conn(0x7f8ae003e510 0x7f8ae00409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:06.176 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:05.112+0000 7f8b00c00700 1 -- 172.21.15.81:0/1978814416 >> 172.21.15.81:0/1978814416 conn(0x7f8afc103200 msgr2=0x7f8afc1055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:06.176 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:05.112+0000 7f8b00c00700 1 -- 172.21.15.81:0/1978814416 shutdown_connections 2024-05-03T16:34:06.176 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:05.112+0000 7f8b00c00700 1 -- 172.21.15.81:0/1978814416 wait complete. 2024-05-03T16:34:06.176 INFO:teuthology.orchestra.run.smithi081.stdout:mgr epoch 9 is available 2024-05-03T16:34:06.176 INFO:teuthology.orchestra.run.smithi081.stdout:Generating a dashboard self-signed certificate... 2024-05-03T16:34:06.450 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:06 smithi081 ceph-mon[28640]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-03T16:34:06.450 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:06 smithi081 ceph-mon[28640]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-03T16:34:07.427 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:07 smithi081 ceph-mon[28640]: mgrmap e12: x(active, since 2s) 2024-05-03T16:34:07.427 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:07 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:08.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-03T16:34:08.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.941+0000 7f8ba2e00700 1 Processor -- start 2024-05-03T16:34:08.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.942+0000 7f8ba2e00700 1 -- start start 2024-05-03T16:34:08.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.942+0000 7f8ba2e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9c106ff0 0x7f8b9c107410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:08.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.942+0000 7f8ba2e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c1079e0 con 0x7f8b9c106ff0 2024-05-03T16:34:08.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.942+0000 7f8b9be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9c106ff0 0x7f8b9c107410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:08.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.942+0000 7f8b9be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9c106ff0 0x7f8b9c107410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44622/0 (socket says 172.21.15.81:44622) 2024-05-03T16:34:08.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.942+0000 7f8b9be00700 1 -- 172.21.15.81:0/3600161041 learned_addr learned my addr 172.21.15.81:0/3600161041 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:34:08.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.943+0000 7f8b9be00700 1 -- 172.21.15.81:0/3600161041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c107b60 con 0x7f8b9c106ff0 2024-05-03T16:34:08.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.943+0000 7f8b9be00700 1 --2- 172.21.15.81:0/3600161041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9c106ff0 0x7f8b9c107410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0098a0 tx=0x7f8b8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9662ea0416a227 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:08.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.944+0000 7f8b9aa00700 1 -- 172.21.15.81:0/3600161041 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c004160 con 0x7f8b9c106ff0 2024-05-03T16:34:08.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.944+0000 7f8b9aa00700 1 -- 172.21.15.81:0/3600161041 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b8c004300 con 0x7f8b9c106ff0 2024-05-03T16:34:08.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.944+0000 7f8b9aa00700 1 -- 172.21.15.81:0/3600161041 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c011960 con 0x7f8b9c106ff0 2024-05-03T16:34:08.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.945+0000 7f8ba2e00700 1 -- 172.21.15.81:0/3600161041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9c106ff0 msgr2=0x7f8b9c107410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:08.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.945+0000 7f8ba2e00700 1 --2- 172.21.15.81:0/3600161041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9c106ff0 0x7f8b9c107410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0098a0 tx=0x7f8b8c009bb0 comp rx=0 tx=0).stop 2024-05-03T16:34:08.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.945+0000 7f8ba2e00700 1 -- 172.21.15.81:0/3600161041 shutdown_connections 2024-05-03T16:34:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.945+0000 7f8ba2e00700 1 --2- 172.21.15.81:0/3600161041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9c106ff0 0x7f8b9c107410 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.945+0000 7f8ba2e00700 1 -- 172.21.15.81:0/3600161041 >> 172.21.15.81:0/3600161041 conn(0x7f8b9c102950 msgr2=0x7f8b9c104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.945+0000 7f8ba2e00700 1 -- 172.21.15.81:0/3600161041 shutdown_connections 2024-05-03T16:34:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.945+0000 7f8ba2e00700 1 -- 172.21.15.81:0/3600161041 wait complete. 2024-05-03T16:34:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.946+0000 7f8ba2e00700 1 Processor -- start 2024-05-03T16:34:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.946+0000 7f8ba2e00700 1 -- start start 2024-05-03T16:34:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.946+0000 7f8ba2e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9c106ff0 0x7f8b9c1098f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.946+0000 7f8ba2e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c10aea0 con 0x7f8b9c106ff0 2024-05-03T16:34:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.947+0000 7f8b9be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9c106ff0 0x7f8b9c1098f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.947+0000 7f8b9be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9c106ff0 0x7f8b9c1098f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44638/0 (socket says 172.21.15.81:44638) 2024-05-03T16:34:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.947+0000 7f8b9be00700 1 -- 172.21.15.81:0/3920371467 learned_addr learned my addr 172.21.15.81:0/3920371467 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:34:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.947+0000 7f8b9be00700 1 -- 172.21.15.81:0/3920371467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c109e30 con 0x7f8b9c106ff0 2024-05-03T16:34:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.948+0000 7f8b9be00700 1 --2- 172.21.15.81:0/3920371467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9c106ff0 0x7f8b9c1098f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c011670 tx=0x7f8b8c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:08.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.948+0000 7f8b98c00700 1 -- 172.21.15.81:0/3920371467 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c01f070 con 0x7f8b9c106ff0 2024-05-03T16:34:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.948+0000 7f8b98c00700 1 -- 172.21.15.81:0/3920371467 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b8c003b20 con 0x7f8b9c106ff0 2024-05-03T16:34:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.948+0000 7f8b98c00700 1 -- 172.21.15.81:0/3920371467 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c019580 con 0x7f8b9c106ff0 2024-05-03T16:34:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.948+0000 7f8ba2e00700 1 -- 172.21.15.81:0/3920371467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b9c108020 con 0x7f8b9c106ff0 2024-05-03T16:34:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.948+0000 7f8ba2e00700 1 -- 172.21.15.81:0/3920371467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b9c108560 con 0x7f8b9c106ff0 2024-05-03T16:34:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.949+0000 7f8ba2e00700 1 -- 172.21.15.81:0/3920371467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b9c064b00 con 0x7f8b9c106ff0 2024-05-03T16:34:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.950+0000 7f8b98c00700 1 -- 172.21.15.81:0/3920371467 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f8b8c022070 con 0x7f8b9c106ff0 2024-05-03T16:34:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.950+0000 7f8b98c00700 1 --2- 172.21.15.81:0/3920371467 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8b8003e520 0x7f8b800409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.951+0000 7f8b98c00700 1 -- 172.21.15.81:0/3920371467 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8b8c053a90 con 0x7f8b9c106ff0 2024-05-03T16:34:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.951+0000 7f8b9b400700 1 --2- 172.21.15.81:0/3920371467 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8b8003e520 0x7f8b800409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.952+0000 7f8b9b400700 1 --2- 172.21.15.81:0/3920371467 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8b8003e520 0x7f8b800409e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8b88006fd0 tx=0x7f8b88006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:06.956+0000 7f8b98c00700 1 -- 172.21.15.81:0/3920371467 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8b8c02cd00 con 0x7f8b9c106ff0 2024-05-03T16:34:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:07.195+0000 7f8ba2e00700 1 -- 172.21.15.81:0/3920371467 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f8b9c103b50 con 0x7f8b8003e520 2024-05-03T16:34:08.101 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:07.383+0000 7f8b98c00700 1 -- 172.21.15.81:0/3920371467 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f8b9c103b50 con 0x7f8b8003e520 2024-05-03T16:34:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:07.386+0000 7f8ba2e00700 1 -- 172.21.15.81:0/3920371467 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8b8003e520 msgr2=0x7f8b800409e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:07.386+0000 7f8ba2e00700 1 --2- 172.21.15.81:0/3920371467 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8b8003e520 0x7f8b800409e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8b88006fd0 tx=0x7f8b88006e40 comp rx=0 tx=0).stop 2024-05-03T16:34:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:07.386+0000 7f8ba2e00700 1 -- 172.21.15.81:0/3920371467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9c106ff0 msgr2=0x7f8b9c1098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:07.386+0000 7f8ba2e00700 1 --2- 172.21.15.81:0/3920371467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9c106ff0 0x7f8b9c1098f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c011670 tx=0x7f8b8c011a30 comp rx=0 tx=0).stop 2024-05-03T16:34:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:07.386+0000 7f8ba2e00700 1 -- 172.21.15.81:0/3920371467 shutdown_connections 2024-05-03T16:34:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:07.386+0000 7f8ba2e00700 1 --2- 172.21.15.81:0/3920371467 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8b8003e520 0x7f8b800409e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:07.386+0000 7f8ba2e00700 1 --2- 172.21.15.81:0/3920371467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b9c106ff0 0x7f8b9c1098f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:07.386+0000 7f8ba2e00700 1 -- 172.21.15.81:0/3920371467 >> 172.21.15.81:0/3920371467 conn(0x7f8b9c102950 msgr2=0x7f8b9c103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:07.386+0000 7f8ba2e00700 1 -- 172.21.15.81:0/3920371467 shutdown_connections 2024-05-03T16:34:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:07.386+0000 7f8ba2e00700 1 -- 172.21.15.81:0/3920371467 wait complete. 2024-05-03T16:34:08.102 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial admin user... 2024-05-03T16:34:08.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:08 smithi081 ceph-mon[28640]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:34:08.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:08 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:08.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:08 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:09.904 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:09 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:09.904 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:09 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:09.913 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$zyOinmGST6923ekefSN7Ke82jXckRATeAEoCTxtGk9P0nWWuhvtv6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1714754049, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-03T16:34:09.913 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.688+0000 7fdf69800700 1 Processor -- start 2024-05-03T16:34:09.913 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.688+0000 7fdf69800700 1 -- start start 2024-05-03T16:34:09.913 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.688+0000 7fdf69800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf64108d10 0x7fdf64109130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:09.918 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.688+0000 7fdf69800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdf64109700 con 0x7fdf64108d10 2024-05-03T16:34:09.918 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.689+0000 7fdf62a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf64108d10 0x7fdf64109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:09.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.689+0000 7fdf62a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf64108d10 0x7fdf64109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44642/0 (socket says 172.21.15.81:44642) 2024-05-03T16:34:09.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.689+0000 7fdf62a00700 1 -- 172.21.15.81:0/1289144330 learned_addr learned my addr 172.21.15.81:0/1289144330 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:34:09.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.689+0000 7fdf62a00700 1 -- 172.21.15.81:0/1289144330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf64109f10 con 0x7fdf64108d10 2024-05-03T16:34:09.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.690+0000 7fdf62a00700 1 --2- 172.21.15.81:0/1289144330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf64108d10 0x7fdf64109130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdf540098a0 tx=0x7fdf54009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184d66e9a209d839 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:09.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.690+0000 7fdf61600700 1 -- 172.21.15.81:0/1289144330 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf54004160 con 0x7fdf64108d10 2024-05-03T16:34:09.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.690+0000 7fdf61600700 1 -- 172.21.15.81:0/1289144330 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf54004300 con 0x7fdf64108d10 2024-05-03T16:34:09.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.690+0000 7fdf61600700 1 -- 172.21.15.81:0/1289144330 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf54011960 con 0x7fdf64108d10 2024-05-03T16:34:09.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.691+0000 7fdf69800700 1 -- 172.21.15.81:0/1289144330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf64108d10 msgr2=0x7fdf64109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:09.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.691+0000 7fdf69800700 1 --2- 172.21.15.81:0/1289144330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf64108d10 0x7fdf64109130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdf540098a0 tx=0x7fdf54009bb0 comp rx=0 tx=0).stop 2024-05-03T16:34:09.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.691+0000 7fdf69800700 1 -- 172.21.15.81:0/1289144330 shutdown_connections 2024-05-03T16:34:09.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.691+0000 7fdf69800700 1 --2- 172.21.15.81:0/1289144330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf64108d10 0x7fdf64109130 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:09.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.691+0000 7fdf69800700 1 -- 172.21.15.81:0/1289144330 >> 172.21.15.81:0/1289144330 conn(0x7fdf641042d0 msgr2=0x7fdf641066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:09.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.691+0000 7fdf69800700 1 -- 172.21.15.81:0/1289144330 shutdown_connections 2024-05-03T16:34:09.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.691+0000 7fdf69800700 1 -- 172.21.15.81:0/1289144330 wait complete. 2024-05-03T16:34:09.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.692+0000 7fdf69800700 1 Processor -- start 2024-05-03T16:34:09.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.693+0000 7fdf69800700 1 -- start start 2024-05-03T16:34:09.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.693+0000 7fdf69800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf64108d10 0x7fdf6419ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:09.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.693+0000 7fdf69800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6410d140 con 0x7fdf64108d10 2024-05-03T16:34:09.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.693+0000 7fdf62a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf64108d10 0x7fdf6419ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:09.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.693+0000 7fdf62a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf64108d10 0x7fdf6419ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44648/0 (socket says 172.21.15.81:44648) 2024-05-03T16:34:09.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.693+0000 7fdf62a00700 1 -- 172.21.15.81:0/1370847996 learned_addr learned my addr 172.21.15.81:0/1370847996 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:34:09.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.694+0000 7fdf62a00700 1 -- 172.21.15.81:0/1370847996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6419f260 con 0x7fdf64108d10 2024-05-03T16:34:09.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.694+0000 7fdf62a00700 1 --2- 172.21.15.81:0/1370847996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf64108d10 0x7fdf6419ed20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf54011670 tx=0x7fdf54011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:09.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.694+0000 7fdf5b400700 1 -- 172.21.15.81:0/1370847996 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf5401f070 con 0x7fdf64108d10 2024-05-03T16:34:09.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.694+0000 7fdf5b400700 1 -- 172.21.15.81:0/1370847996 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf54003b20 con 0x7fdf64108d10 2024-05-03T16:34:09.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.694+0000 7fdf5b400700 1 -- 172.21.15.81:0/1370847996 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf54019580 con 0x7fdf64108d10 2024-05-03T16:34:09.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.695+0000 7fdf69800700 1 -- 172.21.15.81:0/1370847996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf6419f4f0 con 0x7fdf64108d10 2024-05-03T16:34:09.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.695+0000 7fdf69800700 1 -- 172.21.15.81:0/1370847996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf641a21d0 con 0x7fdf64108d10 2024-05-03T16:34:09.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.696+0000 7fdf69800700 1 -- 172.21.15.81:0/1370847996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf64064b00 con 0x7fdf64108d10 2024-05-03T16:34:09.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.696+0000 7fdf5b400700 1 -- 172.21.15.81:0/1370847996 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7fdf54022070 con 0x7fdf64108d10 2024-05-03T16:34:09.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.697+0000 7fdf5b400700 1 --2- 172.21.15.81:0/1370847996 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fdf4803e520 0x7fdf480409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:09.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.697+0000 7fdf5b400700 1 -- 172.21.15.81:0/1370847996 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fdf54053d10 con 0x7fdf64108d10 2024-05-03T16:34:09.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.697+0000 7fdf62000700 1 --2- 172.21.15.81:0/1370847996 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fdf4803e520 0x7fdf480409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:09.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.698+0000 7fdf62000700 1 --2- 172.21.15.81:0/1370847996 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fdf4803e520 0x7fdf480409e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdf50006fd0 tx=0x7fdf50006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:09.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.703+0000 7fdf5b400700 1 -- 172.21.15.81:0/1370847996 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fdf5401b7e0 con 0x7fdf64108d10 2024-05-03T16:34:09.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:08.957+0000 7fdf69800700 1 -- 172.21.15.81:0/1370847996 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fdf641a2460 con 0x7fdf4803e520 2024-05-03T16:34:09.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:09.192+0000 7fdf5b400700 1 -- 172.21.15.81:0/1370847996 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fdf641a2460 con 0x7fdf4803e520 2024-05-03T16:34:09.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:09.196+0000 7fdf69800700 1 -- 172.21.15.81:0/1370847996 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fdf4803e520 msgr2=0x7fdf480409e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:09.922 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:09.196+0000 7fdf69800700 1 --2- 172.21.15.81:0/1370847996 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fdf4803e520 0x7fdf480409e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdf50006fd0 tx=0x7fdf50006e40 comp rx=0 tx=0).stop 2024-05-03T16:34:09.922 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:09.196+0000 7fdf69800700 1 -- 172.21.15.81:0/1370847996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf64108d10 msgr2=0x7fdf6419ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:09.922 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:09.196+0000 7fdf69800700 1 --2- 172.21.15.81:0/1370847996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf64108d10 0x7fdf6419ed20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf54011670 tx=0x7fdf54011a30 comp rx=0 tx=0).stop 2024-05-03T16:34:09.922 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:09.197+0000 7fdf69800700 1 -- 172.21.15.81:0/1370847996 shutdown_connections 2024-05-03T16:34:09.922 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:09.197+0000 7fdf69800700 1 --2- 172.21.15.81:0/1370847996 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fdf4803e520 0x7fdf480409e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:09.922 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:09.197+0000 7fdf69800700 1 --2- 172.21.15.81:0/1370847996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf64108d10 0x7fdf6419ed20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:09.922 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:09.197+0000 7fdf69800700 1 -- 172.21.15.81:0/1370847996 >> 172.21.15.81:0/1370847996 conn(0x7fdf641042d0 msgr2=0x7fdf64104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:09.922 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:09.197+0000 7fdf69800700 1 -- 172.21.15.81:0/1370847996 shutdown_connections 2024-05-03T16:34:09.922 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:09.197+0000 7fdf69800700 1 -- 172.21.15.81:0/1370847996 wait complete. 2024-05-03T16:34:09.922 INFO:teuthology.orchestra.run.smithi081.stdout:Fetching dashboard port number... 2024-05-03T16:34:11.036 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:10 smithi081 ceph-mon[28640]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:34:11.036 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:10 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3385346614' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-03T16:34:12.045 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:11 smithi081 ceph-mon[28640]: mgrmap e13: x(active, since 6s) 2024-05-03T16:34:12.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 8443 2024-05-03T16:34:12.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.520+0000 7fd745000700 1 Processor -- start 2024-05-03T16:34:12.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.521+0000 7fd745000700 1 -- start start 2024-05-03T16:34:12.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.521+0000 7fd745000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd740108d20 0x7fd740109140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:12.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.521+0000 7fd745000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd740109710 con 0x7fd740108d20 2024-05-03T16:34:12.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.521+0000 7fd73de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd740108d20 0x7fd740109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:12.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.521+0000 7fd73de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd740108d20 0x7fd740109140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44662/0 (socket says 172.21.15.81:44662) 2024-05-03T16:34:12.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.521+0000 7fd73de00700 1 -- 172.21.15.81:0/3473001116 learned_addr learned my addr 172.21.15.81:0/3473001116 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:34:12.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.522+0000 7fd73de00700 1 -- 172.21.15.81:0/3473001116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd740109f20 con 0x7fd740108d20 2024-05-03T16:34:12.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.522+0000 7fd73de00700 1 --2- 172.21.15.81:0/3473001116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd740108d20 0x7fd740109140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd7300098a0 tx=0x7fd730009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b2b8f94e517e95 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:12.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.522+0000 7fd73ca00700 1 -- 172.21.15.81:0/3473001116 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd730004160 con 0x7fd740108d20 2024-05-03T16:34:12.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.522+0000 7fd73ca00700 1 -- 172.21.15.81:0/3473001116 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd730004300 con 0x7fd740108d20 2024-05-03T16:34:12.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.522+0000 7fd73ca00700 1 -- 172.21.15.81:0/3473001116 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd730011960 con 0x7fd740108d20 2024-05-03T16:34:12.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.523+0000 7fd745000700 1 -- 172.21.15.81:0/3473001116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd740108d20 msgr2=0x7fd740109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:12.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.523+0000 7fd745000700 1 --2- 172.21.15.81:0/3473001116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd740108d20 0x7fd740109140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd7300098a0 tx=0x7fd730009bb0 comp rx=0 tx=0).stop 2024-05-03T16:34:12.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.523+0000 7fd745000700 1 -- 172.21.15.81:0/3473001116 shutdown_connections 2024-05-03T16:34:12.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.523+0000 7fd745000700 1 --2- 172.21.15.81:0/3473001116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd740108d20 0x7fd740109140 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:12.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.523+0000 7fd745000700 1 -- 172.21.15.81:0/3473001116 >> 172.21.15.81:0/3473001116 conn(0x7fd7401042a0 msgr2=0x7fd740106700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:12.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.523+0000 7fd745000700 1 -- 172.21.15.81:0/3473001116 shutdown_connections 2024-05-03T16:34:12.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.524+0000 7fd745000700 1 -- 172.21.15.81:0/3473001116 wait complete. 2024-05-03T16:34:12.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.525+0000 7fd745000700 1 Processor -- start 2024-05-03T16:34:12.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.525+0000 7fd745000700 1 -- start start 2024-05-03T16:34:12.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.525+0000 7fd745000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd740108d20 0x7fd74019eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:12.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.525+0000 7fd745000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd74010d150 con 0x7fd740108d20 2024-05-03T16:34:12.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.525+0000 7fd73de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd740108d20 0x7fd74019eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:12.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.525+0000 7fd73de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd740108d20 0x7fd74019eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44674/0 (socket says 172.21.15.81:44674) 2024-05-03T16:34:12.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.525+0000 7fd73de00700 1 -- 172.21.15.81:0/3385346614 learned_addr learned my addr 172.21.15.81:0/3385346614 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:34:12.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.526+0000 7fd73de00700 1 -- 172.21.15.81:0/3385346614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74019f2e0 con 0x7fd740108d20 2024-05-03T16:34:12.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.526+0000 7fd73de00700 1 --2- 172.21.15.81:0/3385346614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd740108d20 0x7fd74019eda0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd730011670 tx=0x7fd730011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:12.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.526+0000 7fd736a00700 1 -- 172.21.15.81:0/3385346614 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd73001f070 con 0x7fd740108d20 2024-05-03T16:34:12.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.526+0000 7fd736a00700 1 -- 172.21.15.81:0/3385346614 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd730003b20 con 0x7fd740108d20 2024-05-03T16:34:12.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.527+0000 7fd736a00700 1 -- 172.21.15.81:0/3385346614 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd730019580 con 0x7fd740108d20 2024-05-03T16:34:12.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.527+0000 7fd745000700 1 -- 172.21.15.81:0/3385346614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74019f570 con 0x7fd740108d20 2024-05-03T16:34:12.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.527+0000 7fd745000700 1 -- 172.21.15.81:0/3385346614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7401a2220 con 0x7fd740108d20 2024-05-03T16:34:12.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.528+0000 7fd745000700 1 -- 172.21.15.81:0/3385346614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd740064b00 con 0x7fd740108d20 2024-05-03T16:34:12.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.528+0000 7fd736a00700 1 -- 172.21.15.81:0/3385346614 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7fd730022070 con 0x7fd740108d20 2024-05-03T16:34:12.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.529+0000 7fd736a00700 1 --2- 172.21.15.81:0/3385346614 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd72403e520 0x7fd7240409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:12.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.529+0000 7fd736a00700 1 -- 172.21.15.81:0/3385346614 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd730053bb0 con 0x7fd740108d20 2024-05-03T16:34:12.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.529+0000 7fd73d400700 1 --2- 172.21.15.81:0/3385346614 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd72403e520 0x7fd7240409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:12.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.530+0000 7fd73d400700 1 --2- 172.21.15.81:0/3385346614 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd72403e520 0x7fd7240409e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd72c006fd0 tx=0x7fd72c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:12.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.535+0000 7fd736a00700 1 -- 172.21.15.81:0/3385346614 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd7300172b0 con 0x7fd740108d20 2024-05-03T16:34:12.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.771+0000 7fd745000700 1 -- 172.21.15.81:0/3385346614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fd7401a2510 con 0x7fd740108d20 2024-05-03T16:34:12.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.772+0000 7fd736a00700 1 -- 172.21.15.81:0/3385346614 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fd73001ba80 con 0x7fd740108d20 2024-05-03T16:34:12.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.776+0000 7fd745000700 1 -- 172.21.15.81:0/3385346614 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd72403e520 msgr2=0x7fd7240409e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:12.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.776+0000 7fd745000700 1 --2- 172.21.15.81:0/3385346614 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd72403e520 0x7fd7240409e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd72c006fd0 tx=0x7fd72c006e40 comp rx=0 tx=0).stop 2024-05-03T16:34:12.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.776+0000 7fd745000700 1 -- 172.21.15.81:0/3385346614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd740108d20 msgr2=0x7fd74019eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:12.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.776+0000 7fd745000700 1 --2- 172.21.15.81:0/3385346614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd740108d20 0x7fd74019eda0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd730011670 tx=0x7fd730011a30 comp rx=0 tx=0).stop 2024-05-03T16:34:12.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.776+0000 7fd745000700 1 -- 172.21.15.81:0/3385346614 shutdown_connections 2024-05-03T16:34:12.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.776+0000 7fd745000700 1 --2- 172.21.15.81:0/3385346614 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd72403e520 0x7fd7240409e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:12.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.776+0000 7fd745000700 1 --2- 172.21.15.81:0/3385346614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd740108d20 0x7fd74019eda0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:12.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.776+0000 7fd745000700 1 -- 172.21.15.81:0/3385346614 >> 172.21.15.81:0/3385346614 conn(0x7fd7401042a0 msgr2=0x7fd740104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:12.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.777+0000 7fd745000700 1 -- 172.21.15.81:0/3385346614 shutdown_connections 2024-05-03T16:34:12.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:10.777+0000 7fd745000700 1 -- 172.21.15.81:0/3385346614 wait complete. 2024-05-03T16:34:12.379 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-03T16:34:12.380 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-05-03T16:34:12.408 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-03T16:34:12.408 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-05-03T16:34:12.408 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-05-03T16:34:12.408 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-03T16:34:12.415 INFO:teuthology.orchestra.run.smithi081.stdout:Ceph Dashboard is now available at: 2024-05-03T16:34:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:34:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: URL: https://smithi081.front.sepia.ceph.com:8443/ 2024-05-03T16:34:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: User: admin 2024-05-03T16:34:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: Password: qfqh749wmy 2024-05-03T16:34:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:34:12.416 INFO:teuthology.orchestra.run.smithi081.stdout:Saving cluster configuration to /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config directory 2024-05-03T16:34:12.418 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling autotune for osd_memory_target 2024-05-03T16:34:13.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.044+0000 7ff14be00700 1 Processor -- start 2024-05-03T16:34:13.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.044+0000 7ff14be00700 1 -- start start 2024-05-03T16:34:13.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.044+0000 7ff14be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14c07eeb0 0x7ff14c07d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:13.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.044+0000 7ff14be00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c07d8e0 con 0x7ff14c07eeb0 2024-05-03T16:34:13.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.045+0000 7ff14aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14c07eeb0 0x7ff14c07d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:13.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.045+0000 7ff14aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14c07eeb0 0x7ff14c07d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44690/0 (socket says 172.21.15.81:44690) 2024-05-03T16:34:13.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.045+0000 7ff14aa00700 1 -- 172.21.15.81:0/3475777079 learned_addr learned my addr 172.21.15.81:0/3475777079 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:34:13.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.045+0000 7ff14aa00700 1 -- 172.21.15.81:0/3475777079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14c07da60 con 0x7ff14c07eeb0 2024-05-03T16:34:13.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.045+0000 7ff14aa00700 1 --2- 172.21.15.81:0/3475777079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14c07eeb0 0x7ff14c07d310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0098a0 tx=0x7ff13c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6aeb44c14c6c0ba server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:13.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.046+0000 7ff149600700 1 -- 172.21.15.81:0/3475777079 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13c004160 con 0x7ff14c07eeb0 2024-05-03T16:34:13.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.046+0000 7ff149600700 1 -- 172.21.15.81:0/3475777079 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff13c004300 con 0x7ff14c07eeb0 2024-05-03T16:34:13.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.046+0000 7ff149600700 1 -- 172.21.15.81:0/3475777079 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13c011960 con 0x7ff14c07eeb0 2024-05-03T16:34:13.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.046+0000 7ff14be00700 1 -- 172.21.15.81:0/3475777079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14c07eeb0 msgr2=0x7ff14c07d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:13.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.046+0000 7ff14be00700 1 --2- 172.21.15.81:0/3475777079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14c07eeb0 0x7ff14c07d310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0098a0 tx=0x7ff13c009bb0 comp rx=0 tx=0).stop 2024-05-03T16:34:13.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.046+0000 7ff14be00700 1 -- 172.21.15.81:0/3475777079 shutdown_connections 2024-05-03T16:34:13.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.047+0000 7ff14be00700 1 --2- 172.21.15.81:0/3475777079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14c07eeb0 0x7ff14c07d310 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:13.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.047+0000 7ff14be00700 1 -- 172.21.15.81:0/3475777079 >> 172.21.15.81:0/3475777079 conn(0x7ff14c1040f0 msgr2=0x7ff14c106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:13.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.047+0000 7ff14be00700 1 -- 172.21.15.81:0/3475777079 shutdown_connections 2024-05-03T16:34:13.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.047+0000 7ff14be00700 1 -- 172.21.15.81:0/3475777079 wait complete. 2024-05-03T16:34:13.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.048+0000 7ff14be00700 1 Processor -- start 2024-05-03T16:34:13.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.048+0000 7ff14be00700 1 -- start start 2024-05-03T16:34:13.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.048+0000 7ff14be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14c07eeb0 0x7ff14c19eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:13.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.048+0000 7ff14be00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c10f0f0 con 0x7ff14c07eeb0 2024-05-03T16:34:13.956 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.048+0000 7ff14aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14c07eeb0 0x7ff14c19eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:13.956 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.048+0000 7ff14aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14c07eeb0 0x7ff14c19eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44702/0 (socket says 172.21.15.81:44702) 2024-05-03T16:34:13.956 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.048+0000 7ff14aa00700 1 -- 172.21.15.81:0/2904054368 learned_addr learned my addr 172.21.15.81:0/2904054368 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:34:13.956 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.049+0000 7ff14aa00700 1 -- 172.21.15.81:0/2904054368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14c19f030 con 0x7ff14c07eeb0 2024-05-03T16:34:13.956 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.049+0000 7ff14aa00700 1 --2- 172.21.15.81:0/2904054368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14c07eeb0 0x7ff14c19eaf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff13c011670 tx=0x7ff13c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:13.956 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.049+0000 7ff143400700 1 -- 172.21.15.81:0/2904054368 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13c003a60 con 0x7ff14c07eeb0 2024-05-03T16:34:13.956 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.049+0000 7ff143400700 1 -- 172.21.15.81:0/2904054368 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff13c01b8d0 con 0x7ff14c07eeb0 2024-05-03T16:34:13.956 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.049+0000 7ff14be00700 1 -- 172.21.15.81:0/2904054368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff14c19f2c0 con 0x7ff14c07eeb0 2024-05-03T16:34:13.956 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.049+0000 7ff143400700 1 -- 172.21.15.81:0/2904054368 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13c023790 con 0x7ff14c07eeb0 2024-05-03T16:34:13.956 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.050+0000 7ff14be00700 1 -- 172.21.15.81:0/2904054368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff14c1a1fb0 con 0x7ff14c07eeb0 2024-05-03T16:34:13.956 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.051+0000 7ff14be00700 1 -- 172.21.15.81:0/2904054368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff14c064b00 con 0x7ff14c07eeb0 2024-05-03T16:34:13.956 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.051+0000 7ff143400700 1 -- 172.21.15.81:0/2904054368 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7ff13c01b440 con 0x7ff14c07eeb0 2024-05-03T16:34:13.956 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.051+0000 7ff143400700 1 --2- 172.21.15.81:0/2904054368 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff13003e5c0 0x7ff130040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:13.956 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.051+0000 7ff143400700 1 -- 172.21.15.81:0/2904054368 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff13c054090 con 0x7ff14c07eeb0 2024-05-03T16:34:13.957 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.052+0000 7ff14a000700 1 --2- 172.21.15.81:0/2904054368 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff13003e5c0 0x7ff130040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:13.957 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.052+0000 7ff14a000700 1 --2- 172.21.15.81:0/2904054368 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff13003e5c0 0x7ff130040a80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff138006fd0 tx=0x7ff138006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:13.957 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.057+0000 7ff143400700 1 -- 172.21.15.81:0/2904054368 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff13c01f030 con 0x7ff14c07eeb0 2024-05-03T16:34:13.957 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.285+0000 7ff14be00700 1 -- 172.21.15.81:0/2904054368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7ff14c1a25d0 con 0x7ff14c07eeb0 2024-05-03T16:34:13.957 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.285+0000 7ff143400700 1 -- 172.21.15.81:0/2904054368 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7ff13c0202b0 con 0x7ff14c07eeb0 2024-05-03T16:34:13.957 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.288+0000 7ff14be00700 1 -- 172.21.15.81:0/2904054368 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff13003e5c0 msgr2=0x7ff130040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:13.957 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.288+0000 7ff14be00700 1 --2- 172.21.15.81:0/2904054368 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff13003e5c0 0x7ff130040a80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff138006fd0 tx=0x7ff138006e40 comp rx=0 tx=0).stop 2024-05-03T16:34:13.957 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.288+0000 7ff14be00700 1 -- 172.21.15.81:0/2904054368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14c07eeb0 msgr2=0x7ff14c19eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:13.957 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.288+0000 7ff14be00700 1 --2- 172.21.15.81:0/2904054368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14c07eeb0 0x7ff14c19eaf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff13c011670 tx=0x7ff13c011a30 comp rx=0 tx=0).stop 2024-05-03T16:34:13.957 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.288+0000 7ff14be00700 1 -- 172.21.15.81:0/2904054368 shutdown_connections 2024-05-03T16:34:13.957 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.288+0000 7ff14be00700 1 --2- 172.21.15.81:0/2904054368 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff13003e5c0 0x7ff130040a80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:13.957 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.288+0000 7ff14be00700 1 --2- 172.21.15.81:0/2904054368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff14c07eeb0 0x7ff14c19eaf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:13.957 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.288+0000 7ff14be00700 1 -- 172.21.15.81:0/2904054368 >> 172.21.15.81:0/2904054368 conn(0x7ff14c1040f0 msgr2=0x7ff14c104b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:13.957 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.289+0000 7ff14be00700 1 -- 172.21.15.81:0/2904054368 shutdown_connections 2024-05-03T16:34:13.958 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:13.289+0000 7ff14be00700 1 -- 172.21.15.81:0/2904054368 wait complete. 2024-05-03T16:34:15.597 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.557+0000 7f3e48600700 1 Processor -- start 2024-05-03T16:34:15.597 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.557+0000 7f3e48600700 1 -- start start 2024-05-03T16:34:15.597 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.558+0000 7f3e48600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e401097b0 0x7f3e4010bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:15.597 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.558+0000 7f3e48600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4007cec0 con 0x7f3e401097b0 2024-05-03T16:34:15.597 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.558+0000 7f3e45c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e401097b0 0x7f3e4010bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:15.597 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.558+0000 7f3e45c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e401097b0 0x7f3e4010bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44712/0 (socket says 172.21.15.81:44712) 2024-05-03T16:34:15.597 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.558+0000 7f3e45c00700 1 -- 172.21.15.81:0/3976994817 learned_addr learned my addr 172.21.15.81:0/3976994817 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:34:15.597 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.559+0000 7f3e45c00700 1 -- 172.21.15.81:0/3976994817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4010c0e0 con 0x7f3e401097b0 2024-05-03T16:34:15.597 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.559+0000 7f3e45c00700 1 --2- 172.21.15.81:0/3976994817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e401097b0 0x7f3e4010bba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3e340098a0 tx=0x7f3e34009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c8c395801eafab server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:15.597 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.559+0000 7f3e3fe00700 1 -- 172.21.15.81:0/3976994817 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e34004160 con 0x7f3e401097b0 2024-05-03T16:34:15.598 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.560+0000 7f3e3fe00700 1 -- 172.21.15.81:0/3976994817 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e34004300 con 0x7f3e401097b0 2024-05-03T16:34:15.602 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.560+0000 7f3e3fe00700 1 -- 172.21.15.81:0/3976994817 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e34011960 con 0x7f3e401097b0 2024-05-03T16:34:15.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.560+0000 7f3e48600700 1 -- 172.21.15.81:0/3976994817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e401097b0 msgr2=0x7f3e4010bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:15.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.560+0000 7f3e48600700 1 --2- 172.21.15.81:0/3976994817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e401097b0 0x7f3e4010bba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3e340098a0 tx=0x7f3e34009bb0 comp rx=0 tx=0).stop 2024-05-03T16:34:15.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.560+0000 7f3e48600700 1 -- 172.21.15.81:0/3976994817 shutdown_connections 2024-05-03T16:34:15.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.560+0000 7f3e48600700 1 --2- 172.21.15.81:0/3976994817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e401097b0 0x7f3e4010bba0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:15.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.560+0000 7f3e48600700 1 -- 172.21.15.81:0/3976994817 >> 172.21.15.81:0/3976994817 conn(0x7f3e40103200 msgr2=0x7f3e40105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:15.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.560+0000 7f3e48600700 1 -- 172.21.15.81:0/3976994817 shutdown_connections 2024-05-03T16:34:15.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.560+0000 7f3e48600700 1 -- 172.21.15.81:0/3976994817 wait complete. 2024-05-03T16:34:15.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.561+0000 7f3e48600700 1 Processor -- start 2024-05-03T16:34:15.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.562+0000 7f3e48600700 1 -- start start 2024-05-03T16:34:15.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.562+0000 7f3e48600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e401097b0 0x7f3e4019ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:15.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.562+0000 7f3e48600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4010d090 con 0x7f3e401097b0 2024-05-03T16:34:15.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.562+0000 7f3e45c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e401097b0 0x7f3e4019ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:15.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.562+0000 7f3e45c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e401097b0 0x7f3e4019ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44724/0 (socket says 172.21.15.81:44724) 2024-05-03T16:34:15.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.562+0000 7f3e45c00700 1 -- 172.21.15.81:0/4246814388 learned_addr learned my addr 172.21.15.81:0/4246814388 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:34:15.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.563+0000 7f3e45c00700 1 -- 172.21.15.81:0/4246814388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4019f2d0 con 0x7f3e401097b0 2024-05-03T16:34:15.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.563+0000 7f3e45c00700 1 --2- 172.21.15.81:0/4246814388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e401097b0 0x7f3e4019ed90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3e34011670 tx=0x7f3e34011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:15.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.563+0000 7f3e3e000700 1 -- 172.21.15.81:0/4246814388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e3401f070 con 0x7f3e401097b0 2024-05-03T16:34:15.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.563+0000 7f3e3e000700 1 -- 172.21.15.81:0/4246814388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e34003b20 con 0x7f3e401097b0 2024-05-03T16:34:15.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.563+0000 7f3e3e000700 1 -- 172.21.15.81:0/4246814388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e340195f0 con 0x7f3e401097b0 2024-05-03T16:34:15.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.563+0000 7f3e48600700 1 -- 172.21.15.81:0/4246814388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e4019f560 con 0x7f3e401097b0 2024-05-03T16:34:15.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.563+0000 7f3e48600700 1 -- 172.21.15.81:0/4246814388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e401a2210 con 0x7f3e401097b0 2024-05-03T16:34:15.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.564+0000 7f3e48600700 1 -- 172.21.15.81:0/4246814388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e40064b00 con 0x7f3e401097b0 2024-05-03T16:34:15.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.565+0000 7f3e3e000700 1 -- 172.21.15.81:0/4246814388 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f3e34022070 con 0x7f3e401097b0 2024-05-03T16:34:15.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.565+0000 7f3e3e000700 1 --2- 172.21.15.81:0/4246814388 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3e2803e5c0 0x7f3e28040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:15.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.565+0000 7f3e3e000700 1 -- 172.21.15.81:0/4246814388 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3e34053bc0 con 0x7f3e401097b0 2024-05-03T16:34:15.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.565+0000 7f3e45200700 1 --2- 172.21.15.81:0/4246814388 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3e2803e5c0 0x7f3e28040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:15.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.566+0000 7f3e45200700 1 --2- 172.21.15.81:0/4246814388 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3e2803e5c0 0x7f3e28040a80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c006fd0 tx=0x7f3e2c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:15.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.571+0000 7f3e3e000700 1 -- 172.21.15.81:0/4246814388 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f3e3401baf0 con 0x7f3e401097b0 2024-05-03T16:34:15.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.927+0000 7f3e48600700 1 -- 172.21.15.81:0/4246814388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f3e401a2500 con 0x7f3e401097b0 2024-05-03T16:34:15.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.932+0000 7f3e3e000700 1 -- 172.21.15.81:0/4246814388 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f3e3402ca40 con 0x7f3e401097b0 2024-05-03T16:34:15.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.935+0000 7f3e48600700 1 -- 172.21.15.81:0/4246814388 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3e2803e5c0 msgr2=0x7f3e28040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:15.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.935+0000 7f3e48600700 1 --2- 172.21.15.81:0/4246814388 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3e2803e5c0 0x7f3e28040a80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c006fd0 tx=0x7f3e2c006e40 comp rx=0 tx=0).stop 2024-05-03T16:34:15.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.935+0000 7f3e48600700 1 -- 172.21.15.81:0/4246814388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e401097b0 msgr2=0x7f3e4019ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:15.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.935+0000 7f3e48600700 1 --2- 172.21.15.81:0/4246814388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e401097b0 0x7f3e4019ed90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3e34011670 tx=0x7f3e34011a30 comp rx=0 tx=0).stop 2024-05-03T16:34:15.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.935+0000 7f3e48600700 1 -- 172.21.15.81:0/4246814388 shutdown_connections 2024-05-03T16:34:15.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.935+0000 7f3e48600700 1 --2- 172.21.15.81:0/4246814388 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3e2803e5c0 0x7f3e28040a80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:15.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.935+0000 7f3e48600700 1 --2- 172.21.15.81:0/4246814388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e401097b0 0x7f3e4019ed90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:15.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.935+0000 7f3e48600700 1 -- 172.21.15.81:0/4246814388 >> 172.21.15.81:0/4246814388 conn(0x7f3e40103200 msgr2=0x7f3e40103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:15.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.936+0000 7f3e48600700 1 -- 172.21.15.81:0/4246814388 shutdown_connections 2024-05-03T16:34:15.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-03T16:34:14.936+0000 7f3e48600700 1 -- 172.21.15.81:0/4246814388 wait complete. 2024-05-03T16:34:15.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-03T16:34:15.606 INFO:teuthology.orchestra.run.smithi081.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-03T16:34:15.606 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:34:15.606 INFO:teuthology.orchestra.run.smithi081.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-03T16:34:15.606 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:34:15.606 INFO:teuthology.orchestra.run.smithi081.stdout:Or, if you are only running a single cluster on this host: 2024-05-03T16:34:15.606 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:34:15.606 INFO:teuthology.orchestra.run.smithi081.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-03T16:34:15.606 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:34:15.606 INFO:teuthology.orchestra.run.smithi081.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-03T16:34:15.606 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:34:15.606 INFO:teuthology.orchestra.run.smithi081.stdout: ceph telemetry on 2024-05-03T16:34:15.606 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:34:15.606 INFO:teuthology.orchestra.run.smithi081.stdout:For more information see: 2024-05-03T16:34:15.606 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:34:15.607 INFO:teuthology.orchestra.run.smithi081.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-03T16:34:15.607 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:34:15.607 INFO:teuthology.orchestra.run.smithi081.stdout:Bootstrap complete. 2024-05-03T16:34:15.680 INFO:tasks.cephadm:Fetching config... 2024-05-03T16:34:15.680 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T16:34:15.680 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-03T16:34:15.724 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-03T16:34:15.724 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T16:34:15.725 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-03T16:34:15.804 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-03T16:34:15.805 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T16:34:15.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-03T16:34:15.923 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-03T16:34:15.923 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T16:34:15.923 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-03T16:34:16.017 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-03T16:34:16.018 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNJCHo2UTASoBoUGCEHJdDQ0EgL0PfuwAer6Xvj3ITrDIlDfiSMEoU70ogNjKVBqrns+Ne+bISI281eseszkSqd1W58nNv/tswnoz9NuSP2qUsvCTy9z0n9YPc22VokzDDX0FvIZmQQYvmwYrv24V6ioCQ7zN9OZn+GGzRcpW5iuupwep+jCOj8zMD8kzoLpHJ4UlR1QHWAsHnw6ms9+mTIaDlrIn0RtjHTnb+TjW13CKQSkECxFKWRGKKNDcSS+wDnf14Qql69c14Q+XfGxaQ9VlZSu50uAwAkr3+ZcEkakwgAEKTdu+M5RBUqkiqynYqHyQcGVNRnV7CSDx/ZnuyhqpcpeNZUAz11truTAisVl2H9AD+lulOG5y5ERSS1J4NXo/wSyHqPqBDgAoCDjKfclilO/SCzaQq9KDlURpzEfpGfL3RwKXojwa9JP04jCx5NqypuyaGWcgkRopUGujzEHLEZGYPbwJVhfozW/gbcN4nSfMFtQTLF7SDZP2+etU= ceph-8988869e-096a-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-03T16:34:16.115 INFO:teuthology.orchestra.run.smithi081.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNJCHo2UTASoBoUGCEHJdDQ0EgL0PfuwAer6Xvj3ITrDIlDfiSMEoU70ogNjKVBqrns+Ne+bISI281eseszkSqd1W58nNv/tswnoz9NuSP2qUsvCTy9z0n9YPc22VokzDDX0FvIZmQQYvmwYrv24V6ioCQ7zN9OZn+GGzRcpW5iuupwep+jCOj8zMD8kzoLpHJ4UlR1QHWAsHnw6ms9+mTIaDlrIn0RtjHTnb+TjW13CKQSkECxFKWRGKKNDcSS+wDnf14Qql69c14Q+XfGxaQ9VlZSu50uAwAkr3+ZcEkakwgAEKTdu+M5RBUqkiqynYqHyQcGVNRnV7CSDx/ZnuyhqpcpeNZUAz11truTAisVl2H9AD+lulOG5y5ERSS1J4NXo/wSyHqPqBDgAoCDjKfclilO/SCzaQq9KDlURpzEfpGfL3RwKXojwa9JP04jCx5NqypuyaGWcgkRopUGujzEHLEZGYPbwJVhfozW/gbcN4nSfMFtQTLF7SDZP2+etU= ceph-8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:34:16.138 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:15 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/4246814388' entity='client.admin' 2024-05-03T16:34:16.156 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNJCHo2UTASoBoUGCEHJdDQ0EgL0PfuwAer6Xvj3ITrDIlDfiSMEoU70ogNjKVBqrns+Ne+bISI281eseszkSqd1W58nNv/tswnoz9NuSP2qUsvCTy9z0n9YPc22VokzDDX0FvIZmQQYvmwYrv24V6ioCQ7zN9OZn+GGzRcpW5iuupwep+jCOj8zMD8kzoLpHJ4UlR1QHWAsHnw6ms9+mTIaDlrIn0RtjHTnb+TjW13CKQSkECxFKWRGKKNDcSS+wDnf14Qql69c14Q+XfGxaQ9VlZSu50uAwAkr3+ZcEkakwgAEKTdu+M5RBUqkiqynYqHyQcGVNRnV7CSDx/ZnuyhqpcpeNZUAz11truTAisVl2H9AD+lulOG5y5ERSS1J4NXo/wSyHqPqBDgAoCDjKfclilO/SCzaQq9KDlURpzEfpGfL3RwKXojwa9JP04jCx5NqypuyaGWcgkRopUGujzEHLEZGYPbwJVhfozW/gbcN4nSfMFtQTLF7SDZP2+etU= ceph-8988869e-096a-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-03T16:34:16.274 INFO:teuthology.orchestra.run.smithi134.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNJCHo2UTASoBoUGCEHJdDQ0EgL0PfuwAer6Xvj3ITrDIlDfiSMEoU70ogNjKVBqrns+Ne+bISI281eseszkSqd1W58nNv/tswnoz9NuSP2qUsvCTy9z0n9YPc22VokzDDX0FvIZmQQYvmwYrv24V6ioCQ7zN9OZn+GGzRcpW5iuupwep+jCOj8zMD8kzoLpHJ4UlR1QHWAsHnw6ms9+mTIaDlrIn0RtjHTnb+TjW13CKQSkECxFKWRGKKNDcSS+wDnf14Qql69c14Q+XfGxaQ9VlZSu50uAwAkr3+ZcEkakwgAEKTdu+M5RBUqkiqynYqHyQcGVNRnV7CSDx/ZnuyhqpcpeNZUAz11truTAisVl2H9AD+lulOG5y5ERSS1J4NXo/wSyHqPqBDgAoCDjKfclilO/SCzaQq9KDlURpzEfpGfL3RwKXojwa9JP04jCx5NqypuyaGWcgkRopUGujzEHLEZGYPbwJVhfozW/gbcN4nSfMFtQTLF7SDZP2+etU= ceph-8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:34:16.311 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNJCHo2UTASoBoUGCEHJdDQ0EgL0PfuwAer6Xvj3ITrDIlDfiSMEoU70ogNjKVBqrns+Ne+bISI281eseszkSqd1W58nNv/tswnoz9NuSP2qUsvCTy9z0n9YPc22VokzDDX0FvIZmQQYvmwYrv24V6ioCQ7zN9OZn+GGzRcpW5iuupwep+jCOj8zMD8kzoLpHJ4UlR1QHWAsHnw6ms9+mTIaDlrIn0RtjHTnb+TjW13CKQSkECxFKWRGKKNDcSS+wDnf14Qql69c14Q+XfGxaQ9VlZSu50uAwAkr3+ZcEkakwgAEKTdu+M5RBUqkiqynYqHyQcGVNRnV7CSDx/ZnuyhqpcpeNZUAz11truTAisVl2H9AD+lulOG5y5ERSS1J4NXo/wSyHqPqBDgAoCDjKfclilO/SCzaQq9KDlURpzEfpGfL3RwKXojwa9JP04jCx5NqypuyaGWcgkRopUGujzEHLEZGYPbwJVhfozW/gbcN4nSfMFtQTLF7SDZP2+etU= ceph-8988869e-096a-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-03T16:34:16.430 INFO:teuthology.orchestra.run.smithi146.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNJCHo2UTASoBoUGCEHJdDQ0EgL0PfuwAer6Xvj3ITrDIlDfiSMEoU70ogNjKVBqrns+Ne+bISI281eseszkSqd1W58nNv/tswnoz9NuSP2qUsvCTy9z0n9YPc22VokzDDX0FvIZmQQYvmwYrv24V6ioCQ7zN9OZn+GGzRcpW5iuupwep+jCOj8zMD8kzoLpHJ4UlR1QHWAsHnw6ms9+mTIaDlrIn0RtjHTnb+TjW13CKQSkECxFKWRGKKNDcSS+wDnf14Qql69c14Q+XfGxaQ9VlZSu50uAwAkr3+ZcEkakwgAEKTdu+M5RBUqkiqynYqHyQcGVNRnV7CSDx/ZnuyhqpcpeNZUAz11truTAisVl2H9AD+lulOG5y5ERSS1J4NXo/wSyHqPqBDgAoCDjKfclilO/SCzaQq9KDlURpzEfpGfL3RwKXojwa9JP04jCx5NqypuyaGWcgkRopUGujzEHLEZGYPbwJVhfozW/gbcN4nSfMFtQTLF7SDZP2+etU= ceph-8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:34:16.466 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-03T16:34:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:34:19.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.585+0000 7ff1dd200700 1 -- 172.21.15.81:0/3681448049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d81096b0 msgr2=0x7ff1d8109ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:19.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.585+0000 7ff1dd200700 1 --2- 172.21.15.81:0/3681448049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d81096b0 0x7ff1d8109ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800b0a0 tx=0x7ff1c800b3b0 comp rx=0 tx=0).stop 2024-05-03T16:34:19.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.585+0000 7ff1dd200700 1 -- 172.21.15.81:0/3681448049 shutdown_connections 2024-05-03T16:34:19.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.585+0000 7ff1dd200700 1 --2- 172.21.15.81:0/3681448049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d81096b0 0x7ff1d8109ad0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:19.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.585+0000 7ff1dd200700 1 -- 172.21.15.81:0/3681448049 >> 172.21.15.81:0/3681448049 conn(0x7ff1d8078590 msgr2=0x7ff1d807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:19.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.585+0000 7ff1dd200700 1 -- 172.21.15.81:0/3681448049 shutdown_connections 2024-05-03T16:34:19.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.585+0000 7ff1dd200700 1 -- 172.21.15.81:0/3681448049 wait complete. 2024-05-03T16:34:19.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.586+0000 7ff1dd200700 1 Processor -- start 2024-05-03T16:34:19.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.586+0000 7ff1dd200700 1 -- start start 2024-05-03T16:34:19.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.587+0000 7ff1dd200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d81096b0 0x7ff1d819ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:19.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.587+0000 7ff1dd200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d810f330 con 0x7ff1d81096b0 2024-05-03T16:34:19.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.587+0000 7ff1d5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d81096b0 0x7ff1d819ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:19.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.587+0000 7ff1d5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d81096b0 0x7ff1d819ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38288/0 (socket says 172.21.15.81:38288) 2024-05-03T16:34:19.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.587+0000 7ff1d5e00700 1 -- 172.21.15.81:0/2456395894 learned_addr learned my addr 172.21.15.81:0/2456395894 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:34:19.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.587+0000 7ff1d5e00700 1 -- 172.21.15.81:0/2456395894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d819efd0 con 0x7ff1d81096b0 2024-05-03T16:34:19.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.588+0000 7ff1d5e00700 1 --2- 172.21.15.81:0/2456395894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d81096b0 0x7ff1d819ea90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009cd0 tx=0x7ff1c8007b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:19.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.588+0000 7ff1cf400700 1 -- 172.21.15.81:0/2456395894 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1c8017040 con 0x7ff1d81096b0 2024-05-03T16:34:19.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.588+0000 7ff1cf400700 1 -- 172.21.15.81:0/2456395894 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1c8022070 con 0x7ff1d81096b0 2024-05-03T16:34:19.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.588+0000 7ff1dd200700 1 -- 172.21.15.81:0/2456395894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d819f260 con 0x7ff1d81096b0 2024-05-03T16:34:19.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.588+0000 7ff1cf400700 1 -- 172.21.15.81:0/2456395894 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1c801dd50 con 0x7ff1d81096b0 2024-05-03T16:34:19.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.588+0000 7ff1dd200700 1 -- 172.21.15.81:0/2456395894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d81a1f50 con 0x7ff1d81096b0 2024-05-03T16:34:19.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.589+0000 7ff1dd200700 1 -- 172.21.15.81:0/2456395894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d810fab0 con 0x7ff1d81096b0 2024-05-03T16:34:19.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.589+0000 7ff1cf400700 1 -- 172.21.15.81:0/2456395894 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7ff1c801d560 con 0x7ff1d81096b0 2024-05-03T16:34:19.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.590+0000 7ff1cf400700 1 --2- 172.21.15.81:0/2456395894 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff1bc03e560 0x7ff1bc040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:19.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.590+0000 7ff1cf400700 1 -- 172.21.15.81:0/2456395894 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff1c800f050 con 0x7ff1d81096b0 2024-05-03T16:34:19.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.590+0000 7ff1cd400700 1 --2- 172.21.15.81:0/2456395894 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff1bc03e560 0x7ff1bc040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:19.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.591+0000 7ff1cd400700 1 --2- 172.21.15.81:0/2456395894 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff1bc03e560 0x7ff1bc040a20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0006fd0 tx=0x7ff1c0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:19.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.595+0000 7ff1cf400700 1 -- 172.21.15.81:0/2456395894 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff1c8055e20 con 0x7ff1d81096b0 2024-05-03T16:34:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.830+0000 7ff1dd200700 1 -- 172.21.15.81:0/2456395894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7ff1d802e620 con 0x7ff1d81096b0 2024-05-03T16:34:19.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.837+0000 7ff1cf400700 1 -- 172.21.15.81:0/2456395894 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7ff1c80263c0 con 0x7ff1d81096b0 2024-05-03T16:34:19.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.840+0000 7ff1dd200700 1 -- 172.21.15.81:0/2456395894 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff1bc03e560 msgr2=0x7ff1bc040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:19.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.840+0000 7ff1dd200700 1 --2- 172.21.15.81:0/2456395894 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff1bc03e560 0x7ff1bc040a20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0006fd0 tx=0x7ff1c0006e40 comp rx=0 tx=0).stop 2024-05-03T16:34:19.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.840+0000 7ff1dd200700 1 -- 172.21.15.81:0/2456395894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d81096b0 msgr2=0x7ff1d819ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:19.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.840+0000 7ff1dd200700 1 --2- 172.21.15.81:0/2456395894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d81096b0 0x7ff1d819ea90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009cd0 tx=0x7ff1c8007b40 comp rx=0 tx=0).stop 2024-05-03T16:34:19.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.840+0000 7ff1dd200700 1 -- 172.21.15.81:0/2456395894 shutdown_connections 2024-05-03T16:34:19.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.840+0000 7ff1dd200700 1 --2- 172.21.15.81:0/2456395894 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff1bc03e560 0x7ff1bc040a20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:19.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.840+0000 7ff1dd200700 1 --2- 172.21.15.81:0/2456395894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d81096b0 0x7ff1d819ea90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:19.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.840+0000 7ff1dd200700 1 -- 172.21.15.81:0/2456395894 >> 172.21.15.81:0/2456395894 conn(0x7ff1d8078590 msgr2=0x7ff1d8079100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:19.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.841+0000 7ff1dd200700 1 -- 172.21.15.81:0/2456395894 shutdown_connections 2024-05-03T16:34:19.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:19.841+0000 7ff1dd200700 1 -- 172.21.15.81:0/2456395894 wait complete. 2024-05-03T16:34:20.232 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:20.232 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:20.232 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi081", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:34:20.232 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:20.232 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:34:20.232 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:20.556 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-03T16:34:20.556 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-03T16:34:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:34:21.159 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:20 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2456395894' entity='client.admin' 2024-05-03T16:34:21.159 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:34:21.159 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:22.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.972+0000 7fd8f7000700 1 -- 172.21.15.81:0/1321716512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f01096b0 msgr2=0x7fd8f0109ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:22.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.972+0000 7fd8f7000700 1 --2- 172.21.15.81:0/1321716512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f01096b0 0x7fd8f0109ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0009910 tx=0x7fd8e0009c20 comp rx=0 tx=0).stop 2024-05-03T16:34:22.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.973+0000 7fd8f7000700 1 -- 172.21.15.81:0/1321716512 shutdown_connections 2024-05-03T16:34:22.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.973+0000 7fd8f7000700 1 --2- 172.21.15.81:0/1321716512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f01096b0 0x7fd8f0109ad0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:22.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.973+0000 7fd8f7000700 1 -- 172.21.15.81:0/1321716512 >> 172.21.15.81:0/1321716512 conn(0x7fd8f0078590 msgr2=0x7fd8f007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:22.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.973+0000 7fd8f7000700 1 -- 172.21.15.81:0/1321716512 shutdown_connections 2024-05-03T16:34:22.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.973+0000 7fd8f7000700 1 -- 172.21.15.81:0/1321716512 wait complete. 2024-05-03T16:34:22.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.974+0000 7fd8f7000700 1 Processor -- start 2024-05-03T16:34:22.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.974+0000 7fd8f7000700 1 -- start start 2024-05-03T16:34:22.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.974+0000 7fd8f7000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f01096b0 0x7fd8f019ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:22.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.974+0000 7fd8f7000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f010f330 con 0x7fd8f01096b0 2024-05-03T16:34:22.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.974+0000 7fd8efe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f01096b0 0x7fd8f019ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:22.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.974+0000 7fd8efe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f01096b0 0x7fd8f019ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38316/0 (socket says 172.21.15.81:38316) 2024-05-03T16:34:22.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.974+0000 7fd8efe00700 1 -- 172.21.15.81:0/787318126 learned_addr learned my addr 172.21.15.81:0/787318126 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:34:22.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.975+0000 7fd8efe00700 1 -- 172.21.15.81:0/787318126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f019efd0 con 0x7fd8f01096b0 2024-05-03T16:34:22.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.975+0000 7fd8efe00700 1 --2- 172.21.15.81:0/787318126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f01096b0 0x7fd8f019ea90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0005120 tx=0x7fd8e0005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:22.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.975+0000 7fd8ecc00700 1 -- 172.21.15.81:0/787318126 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8e0027070 con 0x7fd8f01096b0 2024-05-03T16:34:22.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.975+0000 7fd8ecc00700 1 -- 172.21.15.81:0/787318126 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8e000f460 con 0x7fd8f01096b0 2024-05-03T16:34:22.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.975+0000 7fd8f7000700 1 -- 172.21.15.81:0/787318126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f019f260 con 0x7fd8f01096b0 2024-05-03T16:34:22.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.976+0000 7fd8ecc00700 1 -- 172.21.15.81:0/787318126 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8e0017440 con 0x7fd8f01096b0 2024-05-03T16:34:22.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.976+0000 7fd8f7000700 1 -- 172.21.15.81:0/787318126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f01a1f50 con 0x7fd8f01096b0 2024-05-03T16:34:22.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.977+0000 7fd8f7000700 1 -- 172.21.15.81:0/787318126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8f010fab0 con 0x7fd8f01096b0 2024-05-03T16:34:22.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.977+0000 7fd8ecc00700 1 -- 172.21.15.81:0/787318126 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fd8e002a070 con 0x7fd8f01096b0 2024-05-03T16:34:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.978+0000 7fd8ecc00700 1 --2- 172.21.15.81:0/787318126 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd8d403e510 0x7fd8d40409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.978+0000 7fd8ecc00700 1 -- 172.21.15.81:0/787318126 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd8e00538e0 con 0x7fd8f01096b0 2024-05-03T16:34:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.978+0000 7fd8ef400700 1 --2- 172.21.15.81:0/787318126 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd8d403e510 0x7fd8d40409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.979+0000 7fd8ef400700 1 --2- 172.21.15.81:0/787318126 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd8d403e510 0x7fd8d40409d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc006fd0 tx=0x7fd8dc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:22.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:22.983+0000 7fd8ecc00700 1 -- 172.21.15.81:0/787318126 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd8e0013070 con 0x7fd8f01096b0 2024-05-03T16:34:23.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:23.215+0000 7fd8f7000700 1 -- 172.21.15.81:0/787318126 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fd8f002e620 con 0x7fd8d403e510 2024-05-03T16:34:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:23.224+0000 7fd8ecc00700 1 -- 172.21.15.81:0/787318126 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd8f002e620 con 0x7fd8d403e510 2024-05-03T16:34:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:23.227+0000 7fd8f7000700 1 -- 172.21.15.81:0/787318126 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd8d403e510 msgr2=0x7fd8d40409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:23.227+0000 7fd8f7000700 1 --2- 172.21.15.81:0/787318126 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd8d403e510 0x7fd8d40409d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc006fd0 tx=0x7fd8dc006e40 comp rx=0 tx=0).stop 2024-05-03T16:34:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:23.227+0000 7fd8f7000700 1 -- 172.21.15.81:0/787318126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f01096b0 msgr2=0x7fd8f019ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:23.227+0000 7fd8f7000700 1 --2- 172.21.15.81:0/787318126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f01096b0 0x7fd8f019ea90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0005120 tx=0x7fd8e0005810 comp rx=0 tx=0).stop 2024-05-03T16:34:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:23.227+0000 7fd8f7000700 1 -- 172.21.15.81:0/787318126 shutdown_connections 2024-05-03T16:34:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:23.227+0000 7fd8f7000700 1 --2- 172.21.15.81:0/787318126 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd8d403e510 0x7fd8d40409d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:23.227+0000 7fd8f7000700 1 --2- 172.21.15.81:0/787318126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f01096b0 0x7fd8f019ea90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:23.227+0000 7fd8f7000700 1 -- 172.21.15.81:0/787318126 >> 172.21.15.81:0/787318126 conn(0x7fd8f0078590 msgr2=0x7fd8f0079130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:23.227+0000 7fd8f7000700 1 -- 172.21.15.81:0/787318126 shutdown_connections 2024-05-03T16:34:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:23.227+0000 7fd8f7000700 1 -- 172.21.15.81:0/787318126 wait complete. 2024-05-03T16:34:24.026 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi134 2024-05-03T16:34:24.026 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-03T16:34:24.027 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.conf 2024-05-03T16:34:24.085 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-03T16:34:24.085 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-03T16:34:24.182 INFO:tasks.cephadm:Adding host smithi134 to orchestrator... 2024-05-03T16:34:24.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch host add smithi134 2024-05-03T16:34:24.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:24 smithi081 ceph-mon[28640]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:34:24.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:24 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:24.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:24 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:34:24.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:24 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:34:24.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:24 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:34:24.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:24 smithi081 ceph-mon[28640]: Updating smithi081:/etc/ceph/ceph.conf 2024-05-03T16:34:24.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:24 smithi081 ceph-mon[28640]: Updating smithi081:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T16:34:24.601 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:34:25.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:25 smithi081 ceph-mon[28640]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:34:25.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:25 smithi081 ceph-mon[28640]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-05-03T16:34:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.686+0000 7fd243800700 1 -- 172.21.15.81:0/209360331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c103110 msgr2=0x7fd23c1034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.686+0000 7fd243800700 1 --2- 172.21.15.81:0/209360331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c103110 0x7fd23c1034f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009910 tx=0x7fd22c009c20 comp rx=0 tx=0).stop 2024-05-03T16:34:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.686+0000 7fd243800700 1 -- 172.21.15.81:0/209360331 shutdown_connections 2024-05-03T16:34:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.686+0000 7fd243800700 1 --2- 172.21.15.81:0/209360331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c103110 0x7fd23c1034f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.686+0000 7fd243800700 1 -- 172.21.15.81:0/209360331 >> 172.21.15.81:0/209360331 conn(0x7fd23c0fe9e0 msgr2=0x7fd23c100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.686+0000 7fd243800700 1 -- 172.21.15.81:0/209360331 shutdown_connections 2024-05-03T16:34:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.686+0000 7fd243800700 1 -- 172.21.15.81:0/209360331 wait complete. 2024-05-03T16:34:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.687+0000 7fd243800700 1 Processor -- start 2024-05-03T16:34:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.688+0000 7fd243800700 1 -- start start 2024-05-03T16:34:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.688+0000 7fd243800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c103110 0x7fd23c1a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.688+0000 7fd243800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd23c10d240 con 0x7fd23c103110 2024-05-03T16:34:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.688+0000 7fd240e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c103110 0x7fd23c1a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.688+0000 7fd240e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c103110 0x7fd23c1a06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47866/0 (socket says 172.21.15.81:47866) 2024-05-03T16:34:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.688+0000 7fd240e00700 1 -- 172.21.15.81:0/1201873385 learned_addr learned my addr 172.21.15.81:0/1201873385 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:34:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.689+0000 7fd240e00700 1 -- 172.21.15.81:0/1201873385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23c1a0c20 con 0x7fd23c103110 2024-05-03T16:34:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.689+0000 7fd240e00700 1 --2- 172.21.15.81:0/1201873385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c103110 0x7fd23c1a06e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd22c006010 tx=0x7fd22c005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.689+0000 7fd23a000700 1 -- 172.21.15.81:0/1201873385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd22c026070 con 0x7fd23c103110 2024-05-03T16:34:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.689+0000 7fd23a000700 1 -- 172.21.15.81:0/1201873385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd22c00b6f0 con 0x7fd23c103110 2024-05-03T16:34:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.689+0000 7fd243800700 1 -- 172.21.15.81:0/1201873385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd23c1a0f10 con 0x7fd23c103110 2024-05-03T16:34:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.689+0000 7fd23a000700 1 -- 172.21.15.81:0/1201873385 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd22c003810 con 0x7fd23c103110 2024-05-03T16:34:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.690+0000 7fd243800700 1 -- 172.21.15.81:0/1201873385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd23c19a8a0 con 0x7fd23c103110 2024-05-03T16:34:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.691+0000 7fd23a000700 1 -- 172.21.15.81:0/1201873385 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fd22c029070 con 0x7fd23c103110 2024-05-03T16:34:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.691+0000 7fd243800700 1 -- 172.21.15.81:0/1201873385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd23c1045f0 con 0x7fd23c103110 2024-05-03T16:34:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.691+0000 7fd23a000700 1 --2- 172.21.15.81:0/1201873385 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd22003e510 0x7fd2200409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.691+0000 7fd23a000700 1 -- 172.21.15.81:0/1201873385 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd22c01e070 con 0x7fd23c103110 2024-05-03T16:34:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.692+0000 7fd233e00700 1 --2- 172.21.15.81:0/1201873385 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd22003e510 0x7fd2200409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.692+0000 7fd233e00700 1 --2- 172.21.15.81:0/1201873385 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd22003e510 0x7fd2200409d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd224006fd0 tx=0x7fd224006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.697+0000 7fd23a000700 1 -- 172.21.15.81:0/1201873385 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd22c013070 con 0x7fd23c103110 2024-05-03T16:34:26.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:26.936+0000 7fd243800700 1 -- 172.21.15.81:0/1201873385 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}) -- 0x7fd23c19bee0 con 0x7fd22003e510 2024-05-03T16:34:27.242 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:26 smithi081 ceph-mon[28640]: Updating smithi081:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T16:34:27.242 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:26 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:27.242 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:26 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:27.242 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:26 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:28.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:27 smithi081 ceph-mon[28640]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:34:28.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:27 smithi081 ceph-mon[28640]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:34:30.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:29 smithi081 ceph-mon[28640]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:34:30.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:29 smithi081 ceph-mon[28640]: Deploying cephadm binary to smithi134 2024-05-03T16:34:32.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:31 smithi081 ceph-mon[28640]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:34:33.085 INFO:teuthology.orchestra.run.smithi081.stdout:Added host 'smithi134' with addr '172.21.15.134' 2024-05-03T16:34:33.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:33.081+0000 7fd23a000700 1 -- 172.21.15.81:0/1201873385 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fd23c19bee0 con 0x7fd22003e510 2024-05-03T16:34:33.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:33.085+0000 7fd243800700 1 -- 172.21.15.81:0/1201873385 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd22003e510 msgr2=0x7fd2200409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:33.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:33.085+0000 7fd243800700 1 --2- 172.21.15.81:0/1201873385 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd22003e510 0x7fd2200409d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd224006fd0 tx=0x7fd224006e40 comp rx=0 tx=0).stop 2024-05-03T16:34:33.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:33.086+0000 7fd243800700 1 -- 172.21.15.81:0/1201873385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c103110 msgr2=0x7fd23c1a06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:33.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:33.086+0000 7fd243800700 1 --2- 172.21.15.81:0/1201873385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c103110 0x7fd23c1a06e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd22c006010 tx=0x7fd22c005710 comp rx=0 tx=0).stop 2024-05-03T16:34:33.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:33.086+0000 7fd243800700 1 -- 172.21.15.81:0/1201873385 shutdown_connections 2024-05-03T16:34:33.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:33.086+0000 7fd243800700 1 --2- 172.21.15.81:0/1201873385 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd22003e510 0x7fd2200409d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:33.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:33.086+0000 7fd243800700 1 --2- 172.21.15.81:0/1201873385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c103110 0x7fd23c1a06e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:33.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:33.086+0000 7fd243800700 1 -- 172.21.15.81:0/1201873385 >> 172.21.15.81:0/1201873385 conn(0x7fd23c0fe9e0 msgr2=0x7fd23c0756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:33.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:33.086+0000 7fd243800700 1 -- 172.21.15.81:0/1201873385 shutdown_connections 2024-05-03T16:34:33.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:33.086+0000 7fd243800700 1 -- 172.21.15.81:0/1201873385 wait complete. 2024-05-03T16:34:34.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-03T16:34:34.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:33 smithi081 ceph-mon[28640]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:34:34.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:33 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:34.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:33 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:34:34.453 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:34:35.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:34 smithi081 ceph-mon[28640]: Added host smithi134 2024-05-03T16:34:35.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:34 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:35.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:34 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:36.211 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:35 smithi081 ceph-mon[28640]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:34:36.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.514+0000 7f8fc3600700 1 -- 172.21.15.81:0/523202179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc10e4e0 msgr2=0x7f8fbc10e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.514+0000 7f8fc3600700 1 --2- 172.21.15.81:0/523202179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc10e4e0 0x7f8fbc10e8c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009910 tx=0x7f8fb0009c20 comp rx=0 tx=0).stop 2024-05-03T16:34:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.514+0000 7f8fc3600700 1 -- 172.21.15.81:0/523202179 shutdown_connections 2024-05-03T16:34:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.514+0000 7f8fc3600700 1 --2- 172.21.15.81:0/523202179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc10e4e0 0x7f8fbc10e8c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.514+0000 7f8fc3600700 1 -- 172.21.15.81:0/523202179 >> 172.21.15.81:0/523202179 conn(0x7f8fbc078c40 msgr2=0x7f8fbc07b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.515+0000 7f8fc3600700 1 -- 172.21.15.81:0/523202179 shutdown_connections 2024-05-03T16:34:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.515+0000 7f8fc3600700 1 -- 172.21.15.81:0/523202179 wait complete. 2024-05-03T16:34:36.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.516+0000 7f8fc3600700 1 Processor -- start 2024-05-03T16:34:36.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.516+0000 7f8fc3600700 1 -- start start 2024-05-03T16:34:36.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.516+0000 7f8fc3600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc10e4e0 0x7f8fbc19edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:36.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.516+0000 7f8fc3600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc1138b0 con 0x7f8fbc10e4e0 2024-05-03T16:34:36.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.516+0000 7f8fc0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc10e4e0 0x7f8fbc19edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.517+0000 7f8fc0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc10e4e0 0x7f8fbc19edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57304/0 (socket says 172.21.15.81:57304) 2024-05-03T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.517+0000 7f8fc0c00700 1 -- 172.21.15.81:0/2265844219 learned_addr learned my addr 172.21.15.81:0/2265844219 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.517+0000 7f8fc0c00700 1 -- 172.21.15.81:0/2265844219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fbc19f310 con 0x7f8fbc10e4e0 2024-05-03T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.517+0000 7f8fc0c00700 1 --2- 172.21.15.81:0/2265844219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc10e4e0 0x7f8fbc19edd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00092e0 tx=0x7f8fb0005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.517+0000 7f8fb9600700 1 -- 172.21.15.81:0/2265844219 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb0026070 con 0x7f8fbc10e4e0 2024-05-03T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.517+0000 7f8fb9600700 1 -- 172.21.15.81:0/2265844219 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8fb000b750 con 0x7f8fbc10e4e0 2024-05-03T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.517+0000 7f8fc3600700 1 -- 172.21.15.81:0/2265844219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fbc19f5a0 con 0x7f8fbc10e4e0 2024-05-03T16:34:36.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.518+0000 7f8fb9600700 1 -- 172.21.15.81:0/2265844219 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb0003810 con 0x7f8fbc10e4e0 2024-05-03T16:34:36.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.518+0000 7f8fc3600700 1 -- 172.21.15.81:0/2265844219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fbc1a36a0 con 0x7f8fbc10e4e0 2024-05-03T16:34:36.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.519+0000 7f8fc3600700 1 -- 172.21.15.81:0/2265844219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fbc10abe0 con 0x7f8fbc10e4e0 2024-05-03T16:34:36.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.519+0000 7f8fb9600700 1 -- 172.21.15.81:0/2265844219 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f8fb0029070 con 0x7f8fbc10e4e0 2024-05-03T16:34:36.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.520+0000 7f8fb9600700 1 --2- 172.21.15.81:0/2265844219 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8fa403e510 0x7f8fa40409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:36.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.520+0000 7f8fb9600700 1 -- 172.21.15.81:0/2265844219 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8fb001e070 con 0x7f8fbc10e4e0 2024-05-03T16:34:36.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.520+0000 7f8fbbe00700 1 --2- 172.21.15.81:0/2265844219 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8fa403e510 0x7f8fa40409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:36.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.521+0000 7f8fbbe00700 1 --2- 172.21.15.81:0/2265844219 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8fa403e510 0x7f8fa40409d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8006fd0 tx=0x7f8fa8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:36.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.526+0000 7f8fb9600700 1 -- 172.21.15.81:0/2265844219 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8fb0013070 con 0x7f8fbc10e4e0 2024-05-03T16:34:36.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.759+0000 7f8fc3600700 1 -- 172.21.15.81:0/2265844219 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8fbc1a0130 con 0x7f8fa403e510 2024-05-03T16:34:36.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.762+0000 7f8fb9600700 1 -- 172.21.15.81:0/2265844219 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f8fbc1a0130 con 0x7f8fa403e510 2024-05-03T16:34:36.764 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:34:36.765 INFO:teuthology.orchestra.run.smithi081.stdout:[{"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}, {"addr": "172.21.15.134", "hostname": "smithi134", "labels": [], "status": ""}] 2024-05-03T16:34:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.765+0000 7f8fc3600700 1 -- 172.21.15.81:0/2265844219 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8fa403e510 msgr2=0x7f8fa40409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.765+0000 7f8fc3600700 1 --2- 172.21.15.81:0/2265844219 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8fa403e510 0x7f8fa40409d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8006fd0 tx=0x7f8fa8006e40 comp rx=0 tx=0).stop 2024-05-03T16:34:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.765+0000 7f8fc3600700 1 -- 172.21.15.81:0/2265844219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc10e4e0 msgr2=0x7f8fbc19edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.765+0000 7f8fc3600700 1 --2- 172.21.15.81:0/2265844219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc10e4e0 0x7f8fbc19edd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00092e0 tx=0x7f8fb0005710 comp rx=0 tx=0).stop 2024-05-03T16:34:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.765+0000 7f8fc3600700 1 -- 172.21.15.81:0/2265844219 shutdown_connections 2024-05-03T16:34:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.765+0000 7f8fc3600700 1 --2- 172.21.15.81:0/2265844219 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8fa403e510 0x7f8fa40409d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.765+0000 7f8fc3600700 1 --2- 172.21.15.81:0/2265844219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc10e4e0 0x7f8fbc19edd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:36.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.765+0000 7f8fc3600700 1 -- 172.21.15.81:0/2265844219 >> 172.21.15.81:0/2265844219 conn(0x7f8fbc078c40 msgr2=0x7f8fbc0799c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:36.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.765+0000 7f8fc3600700 1 -- 172.21.15.81:0/2265844219 shutdown_connections 2024-05-03T16:34:36.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:36.766+0000 7f8fc3600700 1 -- 172.21.15.81:0/2265844219 wait complete. 2024-05-03T16:34:37.453 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi146 2024-05-03T16:34:37.453 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-05-03T16:34:37.453 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/etc/ceph/ceph.conf 2024-05-03T16:34:37.509 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-05-03T16:34:37.510 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-03T16:34:37.606 INFO:tasks.cephadm:Adding host smithi146 to orchestrator... 2024-05-03T16:34:37.607 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch host add smithi146 2024-05-03T16:34:38.030 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:34:38.195 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:37 smithi081 ceph-mon[28640]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:34:38.195 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:37 smithi081 ceph-mon[28640]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T16:34:38.195 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:40.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.068+0000 7fe041a00700 1 -- 172.21.15.81:0/3411564331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe03c10f5b0 msgr2=0x7fe03c10f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:40.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.068+0000 7fe041a00700 1 --2- 172.21.15.81:0/3411564331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe03c10f5b0 0x7fe03c10f990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009910 tx=0x7fe02c009c20 comp rx=0 tx=0).stop 2024-05-03T16:34:40.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.068+0000 7fe041a00700 1 -- 172.21.15.81:0/3411564331 shutdown_connections 2024-05-03T16:34:40.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.068+0000 7fe041a00700 1 --2- 172.21.15.81:0/3411564331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe03c10f5b0 0x7fe03c10f990 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:40.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.068+0000 7fe041a00700 1 -- 172.21.15.81:0/3411564331 >> 172.21.15.81:0/3411564331 conn(0x7fe03c078d30 msgr2=0x7fe03c07b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:40.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.069+0000 7fe041a00700 1 -- 172.21.15.81:0/3411564331 shutdown_connections 2024-05-03T16:34:40.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.069+0000 7fe041a00700 1 -- 172.21.15.81:0/3411564331 wait complete. 2024-05-03T16:34:40.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.070+0000 7fe041a00700 1 Processor -- start 2024-05-03T16:34:40.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.070+0000 7fe041a00700 1 -- start start 2024-05-03T16:34:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.070+0000 7fe041a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe03c10f5b0 0x7fe03c19ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.070+0000 7fe041a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c1138d0 con 0x7fe03c10f5b0 2024-05-03T16:34:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.070+0000 7fe03aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe03c10f5b0 0x7fe03c19ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.070+0000 7fe03aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe03c10f5b0 0x7fe03c19ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57324/0 (socket says 172.21.15.81:57324) 2024-05-03T16:34:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.070+0000 7fe03aa00700 1 -- 172.21.15.81:0/2472601073 learned_addr learned my addr 172.21.15.81:0/2472601073 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:34:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.071+0000 7fe03aa00700 1 -- 172.21.15.81:0/2472601073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03c19f2d0 con 0x7fe03c10f5b0 2024-05-03T16:34:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.071+0000 7fe03aa00700 1 --2- 172.21.15.81:0/2472601073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe03c10f5b0 0x7fe03c19ed90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe02c006010 tx=0x7fe02c005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.071+0000 7fe033400700 1 -- 172.21.15.81:0/2472601073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe02c026070 con 0x7fe03c10f5b0 2024-05-03T16:34:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.071+0000 7fe033400700 1 -- 172.21.15.81:0/2472601073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe02c00b750 con 0x7fe03c10f5b0 2024-05-03T16:34:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.071+0000 7fe033400700 1 -- 172.21.15.81:0/2472601073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe02c003810 con 0x7fe03c10f5b0 2024-05-03T16:34:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.071+0000 7fe041a00700 1 -- 172.21.15.81:0/2472601073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe03c19f560 con 0x7fe03c10f5b0 2024-05-03T16:34:40.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.072+0000 7fe041a00700 1 -- 172.21.15.81:0/2472601073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe03c1a3660 con 0x7fe03c10f5b0 2024-05-03T16:34:40.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.073+0000 7fe041a00700 1 -- 172.21.15.81:0/2472601073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe03c10ac20 con 0x7fe03c10f5b0 2024-05-03T16:34:40.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.073+0000 7fe033400700 1 -- 172.21.15.81:0/2472601073 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fe02c029070 con 0x7fe03c10f5b0 2024-05-03T16:34:40.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.073+0000 7fe033400700 1 --2- 172.21.15.81:0/2472601073 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe02003e510 0x7fe0200409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:40.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.073+0000 7fe033400700 1 -- 172.21.15.81:0/2472601073 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe02c01e070 con 0x7fe03c10f5b0 2024-05-03T16:34:40.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.074+0000 7fe03a000700 1 --2- 172.21.15.81:0/2472601073 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe02003e510 0x7fe0200409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:40.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.074+0000 7fe03a000700 1 --2- 172.21.15.81:0/2472601073 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe02003e510 0x7fe0200409d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe028006fd0 tx=0x7fe028006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:40.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.079+0000 7fe033400700 1 -- 172.21.15.81:0/2472601073 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe02c013070 con 0x7fe03c10f5b0 2024-05-03T16:34:40.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:39 smithi081 ceph-mon[28640]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:34:40.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:40.318+0000 7fe041a00700 1 -- 172.21.15.81:0/2472601073 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi146", "target": ["mon-mgr", ""]}) -- 0x7fe03c1a00f0 con 0x7fe02003e510 2024-05-03T16:34:42.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:41 smithi081 ceph-mon[28640]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:34:42.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:41 smithi081 ceph-mon[28640]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi146", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:34:42.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:42.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:42.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:42.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:42.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:34:42.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:34:42.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:34:43.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:42 smithi081 ceph-mon[28640]: Deploying cephadm binary to smithi146 2024-05-03T16:34:43.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:42 smithi081 ceph-mon[28640]: Updating smithi134:/etc/ceph/ceph.conf 2024-05-03T16:34:44.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:43 smithi081 ceph-mon[28640]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:34:44.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:43 smithi081 ceph-mon[28640]: Updating smithi134:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T16:34:46.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:45 smithi081 ceph-mon[28640]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:34:46.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:46.397+0000 7fe033400700 1 -- 172.21.15.81:0/2472601073 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fe03c1a00f0 con 0x7fe02003e510 2024-05-03T16:34:46.400 INFO:teuthology.orchestra.run.smithi081.stdout:Added host 'smithi146' with addr '172.21.15.146' 2024-05-03T16:34:46.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:46.401+0000 7fe041a00700 1 -- 172.21.15.81:0/2472601073 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe02003e510 msgr2=0x7fe0200409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:46.401+0000 7fe041a00700 1 --2- 172.21.15.81:0/2472601073 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe02003e510 0x7fe0200409d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe028006fd0 tx=0x7fe028006e40 comp rx=0 tx=0).stop 2024-05-03T16:34:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:46.401+0000 7fe041a00700 1 -- 172.21.15.81:0/2472601073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe03c10f5b0 msgr2=0x7fe03c19ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:46.401+0000 7fe041a00700 1 --2- 172.21.15.81:0/2472601073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe03c10f5b0 0x7fe03c19ed90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe02c006010 tx=0x7fe02c005710 comp rx=0 tx=0).stop 2024-05-03T16:34:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:46.401+0000 7fe041a00700 1 -- 172.21.15.81:0/2472601073 shutdown_connections 2024-05-03T16:34:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:46.401+0000 7fe041a00700 1 --2- 172.21.15.81:0/2472601073 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe02003e510 0x7fe0200409d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:46.401+0000 7fe041a00700 1 --2- 172.21.15.81:0/2472601073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe03c10f5b0 0x7fe03c19ed90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:46.401+0000 7fe041a00700 1 -- 172.21.15.81:0/2472601073 >> 172.21.15.81:0/2472601073 conn(0x7fe03c078d30 msgr2=0x7fe03c07a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:46.401+0000 7fe041a00700 1 -- 172.21.15.81:0/2472601073 shutdown_connections 2024-05-03T16:34:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:46.402+0000 7fe041a00700 1 -- 172.21.15.81:0/2472601073 wait complete. 2024-05-03T16:34:47.107 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:46 smithi081 ceph-mon[28640]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-05-03T16:34:47.107 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:46 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:47.176 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-03T16:34:47.601 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:34:48.062 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:47 smithi081 ceph-mon[28640]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:34:48.062 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:47 smithi081 ceph-mon[28640]: Added host smithi146 2024-05-03T16:34:48.062 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:47 smithi081 ceph-mon[28640]: Updating smithi134:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T16:34:48.062 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:48.062 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:48.062 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:48.063 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:34:49.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.680+0000 7f504e200700 1 -- 172.21.15.81:0/2719284105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5048105320 msgr2=0x7f5048105700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:49.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.680+0000 7f504e200700 1 --2- 172.21.15.81:0/2719284105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5048105320 0x7f5048105700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5038009910 tx=0x7f5038009c20 comp rx=0 tx=0).stop 2024-05-03T16:34:49.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.680+0000 7f504e200700 1 -- 172.21.15.81:0/2719284105 shutdown_connections 2024-05-03T16:34:49.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.680+0000 7f504e200700 1 --2- 172.21.15.81:0/2719284105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5048105320 0x7f5048105700 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:49.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.680+0000 7f504e200700 1 -- 172.21.15.81:0/2719284105 >> 172.21.15.81:0/2719284105 conn(0x7f5048100bf0 msgr2=0x7f5048103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:49.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.680+0000 7f504e200700 1 -- 172.21.15.81:0/2719284105 shutdown_connections 2024-05-03T16:34:49.683 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:49 smithi081 ceph-mon[28640]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:34:49.684 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:49 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:49.684 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:49 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:49.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.680+0000 7f504e200700 1 -- 172.21.15.81:0/2719284105 wait complete. 2024-05-03T16:34:49.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.681+0000 7f504e200700 1 Processor -- start 2024-05-03T16:34:49.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.682+0000 7f504e200700 1 -- start start 2024-05-03T16:34:49.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.682+0000 7f504e200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5048105320 0x7f50481a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:49.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.682+0000 7f504e200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f504810f450 con 0x7f5048105320 2024-05-03T16:34:49.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.682+0000 7f5047400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5048105320 0x7f50481a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:49.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.682+0000 7f5047400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5048105320 0x7f50481a06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55952/0 (socket says 172.21.15.81:55952) 2024-05-03T16:34:49.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.682+0000 7f5047400700 1 -- 172.21.15.81:0/8135022 learned_addr learned my addr 172.21.15.81:0/8135022 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:34:49.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.683+0000 7f5047400700 1 -- 172.21.15.81:0/8135022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50481a0c10 con 0x7f5048105320 2024-05-03T16:34:49.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.683+0000 7f5047400700 1 --2- 172.21.15.81:0/8135022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5048105320 0x7f50481a06d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5038006010 tx=0x7f5038005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:49.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.683+0000 7f503fe00700 1 -- 172.21.15.81:0/8135022 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5038026070 con 0x7f5048105320 2024-05-03T16:34:49.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.683+0000 7f503fe00700 1 -- 172.21.15.81:0/8135022 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f503800b6f0 con 0x7f5048105320 2024-05-03T16:34:49.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.683+0000 7f504e200700 1 -- 172.21.15.81:0/8135022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50481a0f00 con 0x7f5048105320 2024-05-03T16:34:49.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.683+0000 7f503fe00700 1 -- 172.21.15.81:0/8135022 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5038003810 con 0x7f5048105320 2024-05-03T16:34:49.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.684+0000 7f504e200700 1 -- 172.21.15.81:0/8135022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f504819a8e0 con 0x7f5048105320 2024-05-03T16:34:49.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.685+0000 7f504e200700 1 -- 172.21.15.81:0/8135022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5048106800 con 0x7f5048105320 2024-05-03T16:34:49.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.685+0000 7f503fe00700 1 -- 172.21.15.81:0/8135022 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f5038029070 con 0x7f5048105320 2024-05-03T16:34:49.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.685+0000 7f503fe00700 1 --2- 172.21.15.81:0/8135022 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f502c03e5c0 0x7f502c040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:49.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.686+0000 7f503fe00700 1 -- 172.21.15.81:0/8135022 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f503801e070 con 0x7f5048105320 2024-05-03T16:34:49.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.686+0000 7f5046a00700 1 --2- 172.21.15.81:0/8135022 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f502c03e5c0 0x7f502c040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:49.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.686+0000 7f5046a00700 1 --2- 172.21.15.81:0/8135022 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f502c03e5c0 0x7f502c040a80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5034006fd0 tx=0x7f5034006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:49.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.691+0000 7f503fe00700 1 -- 172.21.15.81:0/8135022 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f5038013070 con 0x7f5048105320 2024-05-03T16:34:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.930+0000 7f504e200700 1 -- 172.21.15.81:0/8135022 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f504819bdc0 con 0x7f502c03e5c0 2024-05-03T16:34:49.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.932+0000 7f503fe00700 1 -- 172.21.15.81:0/8135022 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f504819bdc0 con 0x7f502c03e5c0 2024-05-03T16:34:49.935 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:34:49.935 INFO:teuthology.orchestra.run.smithi081.stdout:[{"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}, {"addr": "172.21.15.134", "hostname": "smithi134", "labels": [], "status": ""}, {"addr": "172.21.15.146", "hostname": "smithi146", "labels": [], "status": ""}] 2024-05-03T16:34:49.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.936+0000 7f504e200700 1 -- 172.21.15.81:0/8135022 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f502c03e5c0 msgr2=0x7f502c040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.936+0000 7f504e200700 1 --2- 172.21.15.81:0/8135022 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f502c03e5c0 0x7f502c040a80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5034006fd0 tx=0x7f5034006e40 comp rx=0 tx=0).stop 2024-05-03T16:34:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.936+0000 7f504e200700 1 -- 172.21.15.81:0/8135022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5048105320 msgr2=0x7f50481a06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.936+0000 7f504e200700 1 --2- 172.21.15.81:0/8135022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5048105320 0x7f50481a06d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5038006010 tx=0x7f5038005710 comp rx=0 tx=0).stop 2024-05-03T16:34:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.936+0000 7f504e200700 1 -- 172.21.15.81:0/8135022 shutdown_connections 2024-05-03T16:34:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.936+0000 7f504e200700 1 --2- 172.21.15.81:0/8135022 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f502c03e5c0 0x7f502c040a80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.936+0000 7f504e200700 1 --2- 172.21.15.81:0/8135022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5048105320 0x7f50481a06d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.936+0000 7f504e200700 1 -- 172.21.15.81:0/8135022 >> 172.21.15.81:0/8135022 conn(0x7f5048100bf0 msgr2=0x7f5048106cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.936+0000 7f504e200700 1 -- 172.21.15.81:0/8135022 shutdown_connections 2024-05-03T16:34:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:49.936+0000 7f504e200700 1 -- 172.21.15.81:0/8135022 wait complete. 2024-05-03T16:34:50.537 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:50 smithi081 ceph-mon[28640]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T16:34:50.596 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-03T16:34:50.597 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd crush tunables default 2024-05-03T16:34:51.029 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:34:51.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:51 smithi081 ceph-mon[28640]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:34:51.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:51 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:53.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.063+0000 7ff76b400700 1 -- 172.21.15.81:0/3372673482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7640779d0 msgr2=0x7ff764077db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:53.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.063+0000 7ff76b400700 1 --2- 172.21.15.81:0/3372673482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7640779d0 0x7ff764077db0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff758009910 tx=0x7ff758009c20 comp rx=0 tx=0).stop 2024-05-03T16:34:53.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.063+0000 7ff76b400700 1 -- 172.21.15.81:0/3372673482 shutdown_connections 2024-05-03T16:34:53.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.063+0000 7ff76b400700 1 --2- 172.21.15.81:0/3372673482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7640779d0 0x7ff764077db0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:53.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.063+0000 7ff76b400700 1 -- 172.21.15.81:0/3372673482 >> 172.21.15.81:0/3372673482 conn(0x7ff764100bf0 msgr2=0x7ff764103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:53.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.063+0000 7ff76b400700 1 -- 172.21.15.81:0/3372673482 shutdown_connections 2024-05-03T16:34:53.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.063+0000 7ff76b400700 1 -- 172.21.15.81:0/3372673482 wait complete. 2024-05-03T16:34:53.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.064+0000 7ff76b400700 1 Processor -- start 2024-05-03T16:34:53.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.064+0000 7ff76b400700 1 -- start start 2024-05-03T16:34:53.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.065+0000 7ff76b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7640779d0 0x7ff76419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:53.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.065+0000 7ff76b400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641138b0 con 0x7ff7640779d0 2024-05-03T16:34:53.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.065+0000 7ff768a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7640779d0 0x7ff76419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:53.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.065+0000 7ff768a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7640779d0 0x7ff76419ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55956/0 (socket says 172.21.15.81:55956) 2024-05-03T16:34:53.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.065+0000 7ff768a00700 1 -- 172.21.15.81:0/3776218218 learned_addr learned my addr 172.21.15.81:0/3776218218 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:34:53.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.065+0000 7ff768a00700 1 -- 172.21.15.81:0/3776218218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76419f3d0 con 0x7ff7640779d0 2024-05-03T16:34:53.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.066+0000 7ff768a00700 1 --2- 172.21.15.81:0/3776218218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7640779d0 0x7ff76419ee90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff758006010 tx=0x7ff758005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:53.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.066+0000 7ff761600700 1 -- 172.21.15.81:0/3776218218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff758026070 con 0x7ff7640779d0 2024-05-03T16:34:53.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.066+0000 7ff761600700 1 -- 172.21.15.81:0/3776218218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff75800b750 con 0x7ff7640779d0 2024-05-03T16:34:53.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.066+0000 7ff76b400700 1 -- 172.21.15.81:0/3776218218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76419f660 con 0x7ff7640779d0 2024-05-03T16:34:53.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.066+0000 7ff761600700 1 -- 172.21.15.81:0/3776218218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff758003810 con 0x7ff7640779d0 2024-05-03T16:34:53.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.066+0000 7ff76b400700 1 -- 172.21.15.81:0/3776218218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76419fac0 con 0x7ff7640779d0 2024-05-03T16:34:53.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.067+0000 7ff76b400700 1 -- 172.21.15.81:0/3776218218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff764079110 con 0x7ff7640779d0 2024-05-03T16:34:53.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.067+0000 7ff761600700 1 -- 172.21.15.81:0/3776218218 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7ff758029070 con 0x7ff7640779d0 2024-05-03T16:34:53.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.068+0000 7ff761600700 1 --2- 172.21.15.81:0/3776218218 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff74c03e570 0x7ff74c040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:53.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.068+0000 7ff761600700 1 -- 172.21.15.81:0/3776218218 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff75801e070 con 0x7ff7640779d0 2024-05-03T16:34:53.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.068+0000 7ff763e00700 1 --2- 172.21.15.81:0/3776218218 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff74c03e570 0x7ff74c040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:53.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.069+0000 7ff763e00700 1 --2- 172.21.15.81:0/3776218218 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff74c03e570 0x7ff74c040a30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff750006fd0 tx=0x7ff750006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:53.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.074+0000 7ff761600700 1 -- 172.21.15.81:0/3776218218 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff758013070 con 0x7ff7640779d0 2024-05-03T16:34:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.311+0000 7ff76b400700 1 -- 172.21.15.81:0/3776218218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ff7641a01f0 con 0x7ff7640779d0 2024-05-03T16:34:53.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.452+0000 7ff761600700 1 -- 172.21.15.81:0/3776218218 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7ff758029360 con 0x7ff7640779d0 2024-05-03T16:34:53.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.458+0000 7ff76b400700 1 -- 172.21.15.81:0/3776218218 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff74c03e570 msgr2=0x7ff74c040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:53.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.458+0000 7ff76b400700 1 --2- 172.21.15.81:0/3776218218 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff74c03e570 0x7ff74c040a30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff750006fd0 tx=0x7ff750006e40 comp rx=0 tx=0).stop 2024-05-03T16:34:53.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.458+0000 7ff76b400700 1 -- 172.21.15.81:0/3776218218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7640779d0 msgr2=0x7ff76419ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:53.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.458+0000 7ff76b400700 1 --2- 172.21.15.81:0/3776218218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7640779d0 0x7ff76419ee90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff758006010 tx=0x7ff758005710 comp rx=0 tx=0).stop 2024-05-03T16:34:53.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.458+0000 7ff76b400700 1 -- 172.21.15.81:0/3776218218 shutdown_connections 2024-05-03T16:34:53.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.458+0000 7ff76b400700 1 --2- 172.21.15.81:0/3776218218 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff74c03e570 0x7ff74c040a30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:53.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.458+0000 7ff76b400700 1 --2- 172.21.15.81:0/3776218218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7640779d0 0x7ff76419ee90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:53.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.458+0000 7ff76b400700 1 -- 172.21.15.81:0/3776218218 >> 172.21.15.81:0/3776218218 conn(0x7ff764100bf0 msgr2=0x7ff76410f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:53.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.459+0000 7ff76b400700 1 -- 172.21.15.81:0/3776218218 shutdown_connections 2024-05-03T16:34:53.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:34:53.459+0000 7ff76b400700 1 -- 172.21.15.81:0/3776218218 wait complete. 2024-05-03T16:34:53.462 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2024-05-03T16:34:53.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:53 smithi081 ceph-mon[28640]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:34:53.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:53 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3776218218' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-03T16:34:54.192 INFO:tasks.cephadm:Adding mon.a on smithi081 2024-05-03T16:34:54.192 INFO:tasks.cephadm:Adding mon.b on smithi134 2024-05-03T16:34:54.192 INFO:tasks.cephadm:Adding mon.c on smithi146 2024-05-03T16:34:54.192 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch apply mon '3;smithi081:172.21.15.81=a;smithi134:172.21.15.134=b;smithi146:172.21.15.146=c' 2024-05-03T16:34:54.602 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-03T16:34:54.717 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-03T16:34:54.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:54 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3776218218' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-03T16:34:54.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:54 smithi081 ceph-mon[28640]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T16:34:55.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:55 smithi081 ceph-mon[28640]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:34:57.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.327+0000 7f1c6d000700 1 -- 172.21.15.146:0/1532406739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c68105140 msgr2=0x7f1c68105560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:57.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.327+0000 7f1c6d000700 1 --2- 172.21.15.146:0/1532406739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c68105140 0x7f1c68105560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1c58009910 tx=0x7f1c58009c20 comp rx=0 tx=0).stop 2024-05-03T16:34:57.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.327+0000 7f1c6d000700 1 -- 172.21.15.146:0/1532406739 shutdown_connections 2024-05-03T16:34:57.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.327+0000 7f1c6d000700 1 --2- 172.21.15.146:0/1532406739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c68105140 0x7f1c68105560 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:57.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.327+0000 7f1c6d000700 1 -- 172.21.15.146:0/1532406739 >> 172.21.15.146:0/1532406739 conn(0x7f1c681006e0 msgr2=0x7f1c68102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:57.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.327+0000 7f1c6d000700 1 -- 172.21.15.146:0/1532406739 shutdown_connections 2024-05-03T16:34:57.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.327+0000 7f1c6d000700 1 -- 172.21.15.146:0/1532406739 wait complete. 2024-05-03T16:34:57.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.329+0000 7f1c6d000700 1 Processor -- start 2024-05-03T16:34:57.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.329+0000 7f1c6d000700 1 -- start start 2024-05-03T16:34:57.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.329+0000 7f1c6d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c68105140 0x7f1c6819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:57.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.329+0000 7f1c6d000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6810af30 con 0x7f1c68105140 2024-05-03T16:34:57.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.330+0000 7f1c65e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c68105140 0x7f1c6819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:57.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.330+0000 7f1c65e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c68105140 0x7f1c6819a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.146:35492/0 (socket says 172.21.15.146:35492) 2024-05-03T16:34:57.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.330+0000 7f1c65e00700 1 -- 172.21.15.146:0/287582202 learned_addr learned my addr 172.21.15.146:0/287582202 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-05-03T16:34:57.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.331+0000 7f1c65e00700 1 -- 172.21.15.146:0/287582202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6819abd0 con 0x7f1c68105140 2024-05-03T16:34:57.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.331+0000 7f1c65e00700 1 --2- 172.21.15.146:0/287582202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c68105140 0x7f1c6819a690 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1c58005790 tx=0x7f1c580057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:57.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.332+0000 7f1c5ea00700 1 -- 172.21.15.146:0/287582202 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c58027070 con 0x7f1c68105140 2024-05-03T16:34:57.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.332+0000 7f1c6d000700 1 -- 172.21.15.146:0/287582202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c6819ae60 con 0x7f1c68105140 2024-05-03T16:34:57.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.332+0000 7f1c5ea00700 1 -- 172.21.15.146:0/287582202 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c5800bdf0 con 0x7f1c68105140 2024-05-03T16:34:57.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.332+0000 7f1c5ea00700 1 -- 172.21.15.146:0/287582202 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c5800fe50 con 0x7f1c68105140 2024-05-03T16:34:57.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.332+0000 7f1c6d000700 1 -- 172.21.15.146:0/287582202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c6819db50 con 0x7f1c68105140 2024-05-03T16:34:57.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.333+0000 7f1c6d000700 1 -- 172.21.15.146:0/287582202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c6810b6b0 con 0x7f1c68105140 2024-05-03T16:34:57.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.334+0000 7f1c5ea00700 1 -- 172.21.15.146:0/287582202 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f1c5802a070 con 0x7f1c68105140 2024-05-03T16:34:57.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.334+0000 7f1c5ea00700 1 --2- 172.21.15.146:0/287582202 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f1c4c03e710 0x7f1c4c040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:34:57.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.334+0000 7f1c5ea00700 1 -- 172.21.15.146:0/287582202 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1c580539a0 con 0x7f1c68105140 2024-05-03T16:34:57.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.335+0000 7f1c65400700 1 --2- 172.21.15.146:0/287582202 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f1c4c03e710 0x7f1c4c040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:34:57.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.336+0000 7f1c65400700 1 --2- 172.21.15.146:0/287582202 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f1c4c03e710 0x7f1c4c040bd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1c54006fd0 tx=0x7f1c54006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:34:57.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.351+0000 7f1c5ea00700 1 -- 172.21.15.146:0/287582202 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f1c58013070 con 0x7f1c68105140 2024-05-03T16:34:57.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:57 smithi081 ceph-mon[28640]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:34:57.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:57 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:57.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:57 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:57.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:57 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:57.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:57 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:57.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:57 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi146", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:34:57.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:57 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:34:57.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:57 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:34:57.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:57 smithi081 ceph-mon[28640]: Updating smithi146:/etc/ceph/ceph.conf 2024-05-03T16:34:57.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:57 smithi081 ceph-mon[28640]: Updating smithi146:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T16:34:57.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.619+0000 7f1c6d000700 1 -- 172.21.15.146:0/287582202 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi081:172.21.15.81=a;smithi134:172.21.15.134=b;smithi146:172.21.15.146=c", "target": ["mon-mgr", ""]}) -- 0x7f1c6802e7a0 con 0x7f1c4c03e710 2024-05-03T16:34:57.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.636+0000 7f1c5ea00700 1 -- 172.21.15.146:0/287582202 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1c6802e7a0 con 0x7f1c4c03e710 2024-05-03T16:34:57.638 INFO:teuthology.orchestra.run.smithi146.stdout:Scheduled mon update... 2024-05-03T16:34:57.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.639+0000 7f1c6d000700 1 -- 172.21.15.146:0/287582202 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f1c4c03e710 msgr2=0x7f1c4c040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:57.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.639+0000 7f1c6d000700 1 --2- 172.21.15.146:0/287582202 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f1c4c03e710 0x7f1c4c040bd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1c54006fd0 tx=0x7f1c54006e40 comp rx=0 tx=0).stop 2024-05-03T16:34:57.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.639+0000 7f1c6d000700 1 -- 172.21.15.146:0/287582202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c68105140 msgr2=0x7f1c6819a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:34:57.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.639+0000 7f1c6d000700 1 --2- 172.21.15.146:0/287582202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c68105140 0x7f1c6819a690 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1c58005790 tx=0x7f1c580057c0 comp rx=0 tx=0).stop 2024-05-03T16:34:57.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.639+0000 7f1c6d000700 1 -- 172.21.15.146:0/287582202 shutdown_connections 2024-05-03T16:34:57.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.639+0000 7f1c6d000700 1 --2- 172.21.15.146:0/287582202 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f1c4c03e710 0x7f1c4c040bd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:57.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.639+0000 7f1c6d000700 1 --2- 172.21.15.146:0/287582202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c68105140 0x7f1c6819a690 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:34:57.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.639+0000 7f1c6d000700 1 -- 172.21.15.146:0/287582202 >> 172.21.15.146:0/287582202 conn(0x7f1c681006e0 msgr2=0x7f1c681012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:34:57.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.639+0000 7f1c6d000700 1 -- 172.21.15.146:0/287582202 shutdown_connections 2024-05-03T16:34:57.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:34:57.639+0000 7f1c6d000700 1 -- 172.21.15.146:0/287582202 wait complete. 2024-05-03T16:34:58.641 DEBUG:teuthology.orchestra.run.smithi134:mon.b> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mon.b.service 2024-05-03T16:34:58.649 DEBUG:teuthology.orchestra.run.smithi146:mon.c> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mon.c.service 2024-05-03T16:34:58.654 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-03T16:34:58.654 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-03T16:34:58.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:58 smithi081 ceph-mon[28640]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi081:172.21.15.81=a;smithi134:172.21.15.134=b;smithi146:172.21.15.146=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:34:58.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:58 smithi081 ceph-mon[28640]: Saving service mon spec with placement smithi081:172.21.15.81=a;smithi134:172.21.15.134=b;smithi146:172.21.15.146=c;count:3 2024-05-03T16:34:58.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:58 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:58.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:58 smithi081 ceph-mon[28640]: Updating smithi146:/etc/ceph/ceph.client.admin.keyring 2024-05-03T16:34:59.073 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T16:34:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:59 smithi081 ceph-mon[28640]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:34:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:59 smithi081 ceph-mon[28640]: Updating smithi146:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T16:34:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:59 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:59.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:59 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:59.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:59 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:34:59.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:59 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T16:34:59.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:34:59 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:00.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:00 smithi081 ceph-mon[28640]: Deploying daemon mon.c on smithi146 2024-05-03T16:35:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.684+0000 7f4ae2200700 1 -- 172.21.15.146:0/3798375903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4adc104070 msgr2=0x7f4adc104450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.684+0000 7f4ae2200700 1 --2- 172.21.15.146:0/3798375903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4adc104070 0x7f4adc104450 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009910 tx=0x7f4acc009c20 comp rx=0 tx=0).stop 2024-05-03T16:35:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.685+0000 7f4ae2200700 1 -- 172.21.15.146:0/3798375903 shutdown_connections 2024-05-03T16:35:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.685+0000 7f4ae2200700 1 --2- 172.21.15.146:0/3798375903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4adc104070 0x7f4adc104450 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.685+0000 7f4ae2200700 1 -- 172.21.15.146:0/3798375903 >> 172.21.15.146:0/3798375903 conn(0x7f4adc0fd8a0 msgr2=0x7f4adc0ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:35:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.685+0000 7f4ae2200700 1 -- 172.21.15.146:0/3798375903 shutdown_connections 2024-05-03T16:35:01.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.685+0000 7f4ae2200700 1 -- 172.21.15.146:0/3798375903 wait complete. 2024-05-03T16:35:01.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.686+0000 7f4ae2200700 1 Processor -- start 2024-05-03T16:35:01.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.686+0000 7f4ae2200700 1 -- start start 2024-05-03T16:35:01.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.686+0000 7f4ae2200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4adc104070 0x7f4adc1a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:01.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.686+0000 7f4ae2200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4adc10d2a0 con 0x7f4adc104070 2024-05-03T16:35:01.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.687+0000 7f4adb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4adc104070 0x7f4adc1a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:35:01.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.687+0000 7f4adb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4adc104070 0x7f4adc1a0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.146:35514/0 (socket says 172.21.15.146:35514) 2024-05-03T16:35:01.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.687+0000 7f4adb400700 1 -- 172.21.15.146:0/3682779893 learned_addr learned my addr 172.21.15.146:0/3682779893 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-05-03T16:35:01.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.688+0000 7f4adb400700 1 -- 172.21.15.146:0/3682779893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4adc1a0cc0 con 0x7f4adc104070 2024-05-03T16:35:01.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.688+0000 7f4adb400700 1 --2- 172.21.15.146:0/3682779893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4adc104070 0x7f4adc1a0780 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4acc006010 tx=0x7f4acc005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:35:01.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.689+0000 7f4ad8c00700 1 -- 172.21.15.146:0/3682779893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4acc026070 con 0x7f4adc104070 2024-05-03T16:35:01.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.689+0000 7f4ad8c00700 1 -- 172.21.15.146:0/3682779893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4acc00b750 con 0x7f4adc104070 2024-05-03T16:35:01.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.689+0000 7f4ad8c00700 1 -- 172.21.15.146:0/3682779893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4acc0038a0 con 0x7f4adc104070 2024-05-03T16:35:01.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.689+0000 7f4ae2200700 1 -- 172.21.15.146:0/3682779893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4adc1a0f50 con 0x7f4adc104070 2024-05-03T16:35:01.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.689+0000 7f4ae2200700 1 -- 172.21.15.146:0/3682779893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4adc19a940 con 0x7f4adc104070 2024-05-03T16:35:01.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.690+0000 7f4ae2200700 1 -- 172.21.15.146:0/3682779893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4adc06bb90 con 0x7f4adc104070 2024-05-03T16:35:01.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.691+0000 7f4ad8c00700 1 -- 172.21.15.146:0/3682779893 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f4acc029070 con 0x7f4adc104070 2024-05-03T16:35:01.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.692+0000 7f4ad8c00700 1 --2- 172.21.15.146:0/3682779893 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f4ac003e570 0x7f4ac0040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:01.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.692+0000 7f4ad8c00700 1 -- 172.21.15.146:0/3682779893 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4acc01e070 con 0x7f4adc104070 2024-05-03T16:35:01.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.692+0000 7f4ad3e00700 1 --2- 172.21.15.146:0/3682779893 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f4ac003e570 0x7f4ac0040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:35:01.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.694+0000 7f4ad3e00700 1 --2- 172.21.15.146:0/3682779893 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f4ac003e570 0x7f4ac0040a30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4006fd0 tx=0x7f4ac4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:35:01.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:01.708+0000 7f4ad8c00700 1 -- 172.21.15.146:0/3682779893 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4acc013070 con 0x7f4adc104070 2024-05-03T16:35:01.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:01 smithi081 ceph-mon[28640]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:02.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:02.034+0000 7f4ae2200700 1 -- 172.21.15.146:0/3682779893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f4adc19be70 con 0x7f4adc104070 2024-05-03T16:35:02.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:02.035+0000 7f4ad8c00700 1 -- 172.21.15.146:0/3682779893 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f4acc030030 con 0x7f4adc104070 2024-05-03T16:35:02.037 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:35:02.037 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":1,"fsid":"8988869e-096a-11ef-bc97-c7b262605968","modified":"2024-05-03T16:32:44.597150Z","created":"2024-05-03T16:32:44.597150Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-03T16:35:02.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:02.038+0000 7f4ae2200700 1 -- 172.21.15.146:0/3682779893 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f4ac003e570 msgr2=0x7f4ac0040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:02.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:02.038+0000 7f4ae2200700 1 --2- 172.21.15.146:0/3682779893 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f4ac003e570 0x7f4ac0040a30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4006fd0 tx=0x7f4ac4006e40 comp rx=0 tx=0).stop 2024-05-03T16:35:02.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:02.038+0000 7f4ae2200700 1 -- 172.21.15.146:0/3682779893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4adc104070 msgr2=0x7f4adc1a0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:02.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:02.038+0000 7f4ae2200700 1 --2- 172.21.15.146:0/3682779893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4adc104070 0x7f4adc1a0780 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4acc006010 tx=0x7f4acc005710 comp rx=0 tx=0).stop 2024-05-03T16:35:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:02.038+0000 7f4ae2200700 1 -- 172.21.15.146:0/3682779893 shutdown_connections 2024-05-03T16:35:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:02.038+0000 7f4ae2200700 1 --2- 172.21.15.146:0/3682779893 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f4ac003e570 0x7f4ac0040a30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:02.038+0000 7f4ae2200700 1 --2- 172.21.15.146:0/3682779893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4adc104070 0x7f4adc1a0780 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:02.038+0000 7f4ae2200700 1 -- 172.21.15.146:0/3682779893 >> 172.21.15.146:0/3682779893 conn(0x7f4adc0fd8a0 msgr2=0x7f4adc109210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:35:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:02.038+0000 7f4ae2200700 1 -- 172.21.15.146:0/3682779893 shutdown_connections 2024-05-03T16:35:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:02.038+0000 7f4ae2200700 1 -- 172.21.15.146:0/3682779893 wait complete. 2024-05-03T16:35:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:dumped monmap epoch 1 2024-05-03T16:35:02.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:02 smithi081 ceph-mon[28640]: from='client.? 172.21.15.146:0/3682779893' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T16:35:03.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:03 smithi081 ceph-mon[28640]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:04.141 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-03T16:35:04.141 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-03T16:35:04.563 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T16:35:05.867 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:05 smithi146 systemd[1]: Starting Ceph mon.c for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T16:35:05.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:05 smithi081 ceph-mon[28640]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:06.533 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 podman[32314]: 2024-05-03 16:35:06.230825844 +0000 UTC m=+0.035740220 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T16:35:06.533 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 podman[32314]: 2024-05-03 16:35:06.337562843 +0000 UTC m=+0.142477227 container create a6467fcc8a320296b757171e31c1066e189097941ab5e6ee824ebe474d94cabd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-c, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T16:35:07.238 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 podman[32314]: 2024-05-03 16:35:06.885426037 +0000 UTC m=+0.690340478 container init a6467fcc8a320296b757171e31c1066e189097941ab5e6ee824ebe474d94cabd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-03T16:35:07.238 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 podman[32314]: 2024-05-03 16:35:06.898828521 +0000 UTC m=+0.703742946 container start a6467fcc8a320296b757171e31c1066e189097941ab5e6ee824ebe474d94cabd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-c, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-05-03T16:35:07.238 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: set uid:gid to 167:167 (ceph:ceph) 2024-05-03T16:35:07.238 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev), process ceph-mon, pid 2 2024-05-03T16:35:07.238 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: pidfile_write: ignore empty --pid-file 2024-05-03T16:35:07.238 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: load: jerasure load: lrc 2024-05-03T16:35:07.238 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: RocksDB version: 7.9.2 2024-05-03T16:35:07.238 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Git sha 0 2024-05-03T16:35:07.238 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Compile date 2024-05-01 21:12:03 2024-05-03T16:35:07.238 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: DB SUMMARY 2024-05-03T16:35:07.239 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: DB Session ID: AOM0ZOSWS87JGR2E62HA 2024-05-03T16:35:07.239 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: CURRENT file: CURRENT 2024-05-03T16:35:07.239 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: IDENTITY file: IDENTITY 2024-05-03T16:35:07.239 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-03T16:35:07.239 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-05-03T16:35:07.239 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-05-03T16:35:07.239 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.error_if_exists: 0 2024-05-03T16:35:07.239 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.create_if_missing: 0 2024-05-03T16:35:07.239 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.paranoid_checks: 1 2024-05-03T16:35:07.239 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-03T16:35:07.239 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-03T16:35:07.239 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-03T16:35:07.239 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.env: 0x563130b92cc0 2024-05-03T16:35:07.239 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.fs: PosixFileSystem 2024-05-03T16:35:07.239 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.info_log: 0x56315247bde0 2024-05-03T16:35:07.240 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_file_opening_threads: 16 2024-05-03T16:35:07.240 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.statistics: (nil) 2024-05-03T16:35:07.240 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.use_fsync: 0 2024-05-03T16:35:07.240 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_log_file_size: 0 2024-05-03T16:35:07.240 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-03T16:35:07.240 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-03T16:35:07.240 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.keep_log_file_num: 1000 2024-05-03T16:35:07.240 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.recycle_log_file_num: 0 2024-05-03T16:35:07.240 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.allow_fallocate: 1 2024-05-03T16:35:07.240 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.allow_mmap_reads: 0 2024-05-03T16:35:07.240 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.allow_mmap_writes: 0 2024-05-03T16:35:07.241 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.use_direct_reads: 0 2024-05-03T16:35:07.241 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-03T16:35:07.241 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.create_missing_column_families: 0 2024-05-03T16:35:07.241 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.db_log_dir: 2024-05-03T16:35:07.241 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.wal_dir: 2024-05-03T16:35:07.241 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-03T16:35:07.241 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-03T16:35:07.241 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-03T16:35:07.241 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-03T16:35:07.241 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-03T16:35:07.241 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-03T16:35:07.241 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.advise_random_on_open: 1 2024-05-03T16:35:07.241 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.db_write_buffer_size: 0 2024-05-03T16:35:07.241 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.write_buffer_manager: 0x56315244d0e0 2024-05-03T16:35:07.241 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-03T16:35:07.241 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-03T16:35:07.242 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-03T16:35:07.242 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.rate_limiter: (nil) 2024-05-03T16:35:07.242 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-03T16:35:07.242 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.wal_recovery_mode: 2 2024-05-03T16:35:07.242 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.enable_thread_tracking: 0 2024-05-03T16:35:07.242 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.enable_pipelined_write: 0 2024-05-03T16:35:07.242 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.unordered_write: 0 2024-05-03T16:35:07.242 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-03T16:35:07.242 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-03T16:35:07.242 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-03T16:35:07.242 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-03T16:35:07.242 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.row_cache: None 2024-05-03T16:35:07.242 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.wal_filter: None 2024-05-03T16:35:07.243 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-03T16:35:07.243 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.allow_ingest_behind: 0 2024-05-03T16:35:07.243 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.two_write_queues: 0 2024-05-03T16:35:07.243 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.manual_wal_flush: 0 2024-05-03T16:35:07.243 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.wal_compression: 0 2024-05-03T16:35:07.243 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.atomic_flush: 0 2024-05-03T16:35:07.243 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-03T16:35:07.244 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-03T16:35:07.244 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-03T16:35:07.244 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.log_readahead_size: 0 2024-05-03T16:35:07.244 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-03T16:35:07.244 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.best_efforts_recovery: 0 2024-05-03T16:35:07.244 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-03T16:35:07.244 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-03T16:35:07.244 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.allow_data_in_errors: 0 2024-05-03T16:35:07.244 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.db_host_id: __hostname__ 2024-05-03T16:35:07.245 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-03T16:35:07.245 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_background_jobs: 2 2024-05-03T16:35:07.245 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_background_compactions: -1 2024-05-03T16:35:07.245 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_subcompactions: 1 2024-05-03T16:35:07.245 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-03T16:35:07.245 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-03T16:35:07.245 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-03T16:35:07.245 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_total_wal_size: 0 2024-05-03T16:35:07.245 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-03T16:35:07.245 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-03T16:35:07.245 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-03T16:35:07.245 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-03T16:35:07.245 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_open_files: -1 2024-05-03T16:35:07.245 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.bytes_per_sync: 0 2024-05-03T16:35:07.245 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-03T16:35:07.246 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-03T16:35:07.246 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compaction_readahead_size: 0 2024-05-03T16:35:07.246 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_background_flushes: -1 2024-05-03T16:35:07.246 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Compression algorithms supported: 2024-05-03T16:35:07.246 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-03T16:35:07.246 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: kZSTD supported: 0 2024-05-03T16:35:07.246 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: kXpressCompression supported: 0 2024-05-03T16:35:07.246 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: kLZ4HCCompression supported: 1 2024-05-03T16:35:07.246 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: kZlibCompression supported: 1 2024-05-03T16:35:07.246 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: kSnappyCompression supported: 1 2024-05-03T16:35:07.246 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: kLZ4Compression supported: 1 2024-05-03T16:35:07.246 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: kBZip2Compression supported: 0 2024-05-03T16:35:07.246 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-03T16:35:07.246 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-03T16:35:07.247 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-05-03T16:35:07.247 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-03T16:35:07.247 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-03T16:35:07.247 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.merge_operator: 2024-05-03T16:35:07.247 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compaction_filter: None 2024-05-03T16:35:07.247 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compaction_filter_factory: None 2024-05-03T16:35:07.247 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.sst_partitioner_factory: None 2024-05-03T16:35:07.247 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-03T16:35:07.247 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-03T16:35:07.247 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56315247bfa0) 2024-05-03T16:35:07.247 INFO:journalctl@ceph.mon.c.smithi146.stdout: cache_index_and_filter_blocks: 1 2024-05-03T16:35:07.247 INFO:journalctl@ceph.mon.c.smithi146.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-03T16:35:07.247 INFO:journalctl@ceph.mon.c.smithi146.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-03T16:35:07.247 INFO:journalctl@ceph.mon.c.smithi146.stdout: pin_top_level_index_and_filter: 1 2024-05-03T16:35:07.247 INFO:journalctl@ceph.mon.c.smithi146.stdout: index_type: 0 2024-05-03T16:35:07.248 INFO:journalctl@ceph.mon.c.smithi146.stdout: data_block_index_type: 0 2024-05-03T16:35:07.248 INFO:journalctl@ceph.mon.c.smithi146.stdout: index_shortening: 1 2024-05-03T16:35:07.248 INFO:journalctl@ceph.mon.c.smithi146.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-03T16:35:07.248 INFO:journalctl@ceph.mon.c.smithi146.stdout: checksum: 4 2024-05-03T16:35:07.248 INFO:journalctl@ceph.mon.c.smithi146.stdout: no_block_cache: 0 2024-05-03T16:35:07.248 INFO:journalctl@ceph.mon.c.smithi146.stdout: block_cache: 0x56315247f1f0 2024-05-03T16:35:07.248 INFO:journalctl@ceph.mon.c.smithi146.stdout: block_cache_name: BinnedLRUCache 2024-05-03T16:35:07.248 INFO:journalctl@ceph.mon.c.smithi146.stdout: block_cache_options: 2024-05-03T16:35:07.248 INFO:journalctl@ceph.mon.c.smithi146.stdout: capacity : 536870912 2024-05-03T16:35:07.248 INFO:journalctl@ceph.mon.c.smithi146.stdout: num_shard_bits : 4 2024-05-03T16:35:07.248 INFO:journalctl@ceph.mon.c.smithi146.stdout: strict_capacity_limit : 0 2024-05-03T16:35:07.248 INFO:journalctl@ceph.mon.c.smithi146.stdout: high_pri_pool_ratio: 0.000 2024-05-03T16:35:07.248 INFO:journalctl@ceph.mon.c.smithi146.stdout: block_cache_compressed: (nil) 2024-05-03T16:35:07.248 INFO:journalctl@ceph.mon.c.smithi146.stdout: persistent_cache: (nil) 2024-05-03T16:35:07.249 INFO:journalctl@ceph.mon.c.smithi146.stdout: block_size: 4096 2024-05-03T16:35:07.249 INFO:journalctl@ceph.mon.c.smithi146.stdout: block_size_deviation: 10 2024-05-03T16:35:07.249 INFO:journalctl@ceph.mon.c.smithi146.stdout: block_restart_interval: 16 2024-05-03T16:35:07.249 INFO:journalctl@ceph.mon.c.smithi146.stdout: index_block_restart_interval: 1 2024-05-03T16:35:07.249 INFO:journalctl@ceph.mon.c.smithi146.stdout: metadata_block_size: 4096 2024-05-03T16:35:07.249 INFO:journalctl@ceph.mon.c.smithi146.stdout: partition_filters: 0 2024-05-03T16:35:07.249 INFO:journalctl@ceph.mon.c.smithi146.stdout: use_delta_encoding: 1 2024-05-03T16:35:07.249 INFO:journalctl@ceph.mon.c.smithi146.stdout: filter_policy: bloomfilter 2024-05-03T16:35:07.249 INFO:journalctl@ceph.mon.c.smithi146.stdout: whole_key_filtering: 1 2024-05-03T16:35:07.249 INFO:journalctl@ceph.mon.c.smithi146.stdout: verify_compression: 0 2024-05-03T16:35:07.249 INFO:journalctl@ceph.mon.c.smithi146.stdout: read_amp_bytes_per_bit: 0 2024-05-03T16:35:07.249 INFO:journalctl@ceph.mon.c.smithi146.stdout: format_version: 5 2024-05-03T16:35:07.249 INFO:journalctl@ceph.mon.c.smithi146.stdout: enable_index_compression: 1 2024-05-03T16:35:07.250 INFO:journalctl@ceph.mon.c.smithi146.stdout: block_align: 0 2024-05-03T16:35:07.250 INFO:journalctl@ceph.mon.c.smithi146.stdout: max_auto_readahead_size: 262144 2024-05-03T16:35:07.250 INFO:journalctl@ceph.mon.c.smithi146.stdout: prepopulate_block_cache: 0 2024-05-03T16:35:07.250 INFO:journalctl@ceph.mon.c.smithi146.stdout: initial_auto_readahead_size: 8192 2024-05-03T16:35:07.251 INFO:journalctl@ceph.mon.c.smithi146.stdout: num_file_reads_for_auto_readahead: 2 2024-05-03T16:35:07.251 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.write_buffer_size: 33554432 2024-05-03T16:35:07.251 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_write_buffer_number: 2 2024-05-03T16:35:07.251 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compression: NoCompression 2024-05-03T16:35:07.251 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.bottommost_compression: Disabled 2024-05-03T16:35:07.251 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.prefix_extractor: nullptr 2024-05-03T16:35:07.251 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-03T16:35:07.251 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.num_levels: 7 2024-05-03T16:35:07.251 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-03T16:35:07.251 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-03T16:35:07.252 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-03T16:35:07.252 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-03T16:35:07.252 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-03T16:35:07.252 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-03T16:35:07.252 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-03T16:35:07.252 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-03T16:35:07.252 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-03T16:35:07.252 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-03T16:35:07.252 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-03T16:35:07.252 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-03T16:35:07.252 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-03T16:35:07.252 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compression_opts.level: 32767 2024-05-03T16:35:07.252 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compression_opts.strategy: 0 2024-05-03T16:35:07.252 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-03T16:35:07.253 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-03T16:35:07.253 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-03T16:35:07.253 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-03T16:35:07.253 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compression_opts.enabled: false 2024-05-03T16:35:07.253 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-03T16:35:07.253 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-03T16:35:07.253 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-03T16:35:07.253 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-03T16:35:07.253 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.target_file_size_base: 67108864 2024-05-03T16:35:07.253 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-03T16:35:07.253 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-03T16:35:07.253 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-03T16:35:07.253 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-03T16:35:07.253 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-03T16:35:07.253 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-03T16:35:07.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-03T16:35:07.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-03T16:35:07.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-03T16:35:07.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-03T16:35:07.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-03T16:35:07.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-03T16:35:07.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-03T16:35:07.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-03T16:35:07.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.arena_block_size: 1048576 2024-05-03T16:35:07.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-03T16:35:07.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-03T16:35:07.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.disable_auto_compactions: 0 2024-05-03T16:35:07.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-03T16:35:07.255 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-03T16:35:07.255 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-03T16:35:07.255 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-03T16:35:07.255 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-03T16:35:07.255 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-03T16:35:07.255 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-03T16:35:07.255 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-03T16:35:07.255 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-03T16:35:07.255 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-03T16:35:07.255 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-03T16:35:07.255 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.inplace_update_support: 0 2024-05-03T16:35:07.255 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-03T16:35:07.255 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-03T16:35:07.255 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-03T16:35:07.255 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-03T16:35:07.256 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.bloom_locality: 0 2024-05-03T16:35:07.256 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.max_successive_merges: 0 2024-05-03T16:35:07.256 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-03T16:35:07.256 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.paranoid_file_checks: 0 2024-05-03T16:35:07.256 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.force_consistency_checks: 1 2024-05-03T16:35:07.256 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.report_bg_io_stats: 0 2024-05-03T16:35:07.256 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.ttl: 2592000 2024-05-03T16:35:07.256 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-03T16:35:07.256 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-03T16:35:07.256 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-03T16:35:07.256 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.enable_blob_files: false 2024-05-03T16:35:07.256 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.min_blob_size: 0 2024-05-03T16:35:07.256 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.blob_file_size: 268435456 2024-05-03T16:35:07.256 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-03T16:35:07.256 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-03T16:35:07.256 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-03T16:35:07.257 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-03T16:35:07.257 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-03T16:35:07.257 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.blob_file_starting_level: 0 2024-05-03T16:35:07.257 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-03T16:35:07.257 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-03T16:35:07.257 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-03T16:35:07.257 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7ee7fbb8-cb47-442f-ac99-c439fdaf143c 2024-05-03T16:35:07.257 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714754106955691, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-03T16:35:07.257 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-03T16:35:07.257 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714754106957114, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714754106, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7ee7fbb8-cb47-442f-ac99-c439fdaf143c", "db_session_id": "AOM0ZOSWS87JGR2E62HA", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-03T16:35:07.257 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714754106957367, "job": 1, "event": "recovery_finished"} 2024-05-03T16:35:07.257 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-03T16:35:07.257 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-03T16:35:07.257 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56315259c000 2024-05-03T16:35:07.257 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: DB pointer 0x563152588000 2024-05-03T16:35:07.258 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-05-03T16:35:07.258 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-03T16:35:07.258 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-03T16:35:07.258 INFO:journalctl@ceph.mon.c.smithi146.stdout: ** DB Stats ** 2024-05-03T16:35:07.258 INFO:journalctl@ceph.mon.c.smithi146.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-03T16:35:07.258 INFO:journalctl@ceph.mon.c.smithi146.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-03T16:35:07.258 INFO:journalctl@ceph.mon.c.smithi146.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-03T16:35:07.258 INFO:journalctl@ceph.mon.c.smithi146.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-03T16:35:07.258 INFO:journalctl@ceph.mon.c.smithi146.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-03T16:35:07.258 INFO:journalctl@ceph.mon.c.smithi146.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-03T16:35:07.258 INFO:journalctl@ceph.mon.c.smithi146.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-03T16:35:07.258 INFO:journalctl@ceph.mon.c.smithi146.stdout: 2024-05-03T16:35:07.258 INFO:journalctl@ceph.mon.c.smithi146.stdout: ** Compaction Stats [default] ** 2024-05-03T16:35:07.258 INFO:journalctl@ceph.mon.c.smithi146.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-03T16:35:07.258 INFO:journalctl@ceph.mon.c.smithi146.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-03T16:35:07.259 INFO:journalctl@ceph.mon.c.smithi146.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T16:35:07.259 INFO:journalctl@ceph.mon.c.smithi146.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T16:35:07.259 INFO:journalctl@ceph.mon.c.smithi146.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T16:35:07.259 INFO:journalctl@ceph.mon.c.smithi146.stdout: 2024-05-03T16:35:07.259 INFO:journalctl@ceph.mon.c.smithi146.stdout: ** Compaction Stats [default] ** 2024-05-03T16:35:07.259 INFO:journalctl@ceph.mon.c.smithi146.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-03T16:35:07.259 INFO:journalctl@ceph.mon.c.smithi146.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-03T16:35:07.259 INFO:journalctl@ceph.mon.c.smithi146.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T16:35:07.259 INFO:journalctl@ceph.mon.c.smithi146.stdout: 2024-05-03T16:35:07.259 INFO:journalctl@ceph.mon.c.smithi146.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-03T16:35:07.259 INFO:journalctl@ceph.mon.c.smithi146.stdout: 2024-05-03T16:35:07.259 INFO:journalctl@ceph.mon.c.smithi146.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-03T16:35:07.259 INFO:journalctl@ceph.mon.c.smithi146.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-03T16:35:07.259 INFO:journalctl@ceph.mon.c.smithi146.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-03T16:35:07.259 INFO:journalctl@ceph.mon.c.smithi146.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-03T16:35:07.259 INFO:journalctl@ceph.mon.c.smithi146.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-03T16:35:07.260 INFO:journalctl@ceph.mon.c.smithi146.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-03T16:35:07.260 INFO:journalctl@ceph.mon.c.smithi146.stdout: Cumulative compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-03T16:35:07.260 INFO:journalctl@ceph.mon.c.smithi146.stdout: Interval compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-03T16:35:07.260 INFO:journalctl@ceph.mon.c.smithi146.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-03T16:35:07.260 INFO:journalctl@ceph.mon.c.smithi146.stdout: Block cache BinnedLRUCache@0x56315247f1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-05-03T16:35:07.260 INFO:journalctl@ceph.mon.c.smithi146.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-03T16:35:07.260 INFO:journalctl@ceph.mon.c.smithi146.stdout: 2024-05-03T16:35:07.260 INFO:journalctl@ceph.mon.c.smithi146.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-03T16:35:07.260 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: using public_addr v2:172.21.15.146:0/0 -> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] 2024-05-03T16:35:07.260 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: starting mon.c rank -1 at public addrs [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] at bind addrs [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:35:07.260 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:06 smithi146 ceph-mon[32357]: mon.c@-1(???) e0 preinit fsid 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:35:07.260 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: mon.c@-1(synchronizing).mds e1 new map 2024-05-03T16:35:07.260 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: mon.c@-1(synchronizing).mds e1 print_map 2024-05-03T16:35:07.260 INFO:journalctl@ceph.mon.c.smithi146.stdout: e1 2024-05-03T16:35:07.260 INFO:journalctl@ceph.mon.c.smithi146.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-03T16:35:07.260 INFO:journalctl@ceph.mon.c.smithi146.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-03T16:35:07.261 INFO:journalctl@ceph.mon.c.smithi146.stdout: legacy client fscid: -1 2024-05-03T16:35:07.261 INFO:journalctl@ceph.mon.c.smithi146.stdout: 2024-05-03T16:35:07.261 INFO:journalctl@ceph.mon.c.smithi146.stdout: No filesystems configured 2024-05-03T16:35:07.261 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-03T16:35:07.261 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-03T16:35:07.261 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-03T16:35:07.261 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-03T16:35:07.261 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-03T16:35:07.261 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-03T16:35:07.261 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-03T16:35:07.261 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T16:35:07.261 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T16:35:07.261 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T16:35:07.261 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:07.262 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: Deploying cephadm binary to smithi134 2024-05-03T16:35:07.262 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:07.262 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:07.262 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.262 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:35:07.262 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: Added host smithi134 2024-05-03T16:35:07.262 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.262 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.262 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:07.262 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:07.262 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T16:35:07.262 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.262 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:07.262 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:07.262 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi146", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:35:07.263 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.263 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.263 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.263 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.263 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:35:07.263 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:07.263 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:35:07.263 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: Deploying cephadm binary to smithi146 2024-05-03T16:35:07.263 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: Updating smithi134:/etc/ceph/ceph.conf 2024-05-03T16:35:07.263 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:07.263 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: Updating smithi134:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T16:35:07.263 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:07.263 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-05-03T16:35:07.263 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.263 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:07.263 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: Added host smithi146 2024-05-03T16:35:07.264 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: Updating smithi134:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T16:35:07.264 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.264 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.264 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.264 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:35:07.264 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:07.264 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.264 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.264 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T16:35:07.265 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:07.265 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.265 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:07.265 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3776218218' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-03T16:35:07.265 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3776218218' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-03T16:35:07.265 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T16:35:07.265 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:07.265 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:07.265 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.265 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.265 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.265 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.265 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi146", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:35:07.265 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:07.266 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:35:07.266 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: Updating smithi146:/etc/ceph/ceph.conf 2024-05-03T16:35:07.266 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: Updating smithi146:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T16:35:07.266 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi081:172.21.15.81=a;smithi134:172.21.15.134=b;smithi146:172.21.15.146=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:35:07.266 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: Saving service mon spec with placement smithi081:172.21.15.81=a;smithi134:172.21.15.134=b;smithi146:172.21.15.146=c;count:3 2024-05-03T16:35:07.266 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.266 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: Updating smithi146:/etc/ceph/ceph.client.admin.keyring 2024-05-03T16:35:07.266 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:07.266 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: Updating smithi146:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T16:35:07.266 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.266 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.266 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:07.266 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T16:35:07.266 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:07.267 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: Deploying daemon mon.c on smithi146 2024-05-03T16:35:07.267 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:07.267 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: from='client.? 172.21.15.146:0/3682779893' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T16:35:07.267 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:07.267 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:07.267 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 ceph-mon[32357]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-03T16:35:07.267 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 bash[32314]: a6467fcc8a320296b757171e31c1066e189097941ab5e6ee824ebe474d94cabd 2024-05-03T16:35:07.267 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:07 smithi146 systemd[1]: Started Ceph mon.c for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:35:12.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:12.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T16:35:12.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: mon.a calling monitor election 2024-05-03T16:35:12.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:12.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:12.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:12.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:12.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: mon.c calling monitor election 2024-05-03T16:35:12.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:12.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:12.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:12.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:12.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-03T16:35:12.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: monmap epoch 2 2024-05-03T16:35:12.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: fsid 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:35:12.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: last_changed 2024-05-03T16:35:07.010578+0000 2024-05-03T16:35:12.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: created 2024-05-03T16:32:44.597150+0000 2024-05-03T16:35:12.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: min_mon_release 19 (squid) 2024-05-03T16:35:12.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: election_strategy: 1 2024-05-03T16:35:12.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-05-03T16:35:12.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: 1: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.c 2024-05-03T16:35:12.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: fsmap 2024-05-03T16:35:12.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T16:35:12.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: mgrmap e13: x(active, since 67s) 2024-05-03T16:35:12.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: overall HEALTH_OK 2024-05-03T16:35:12.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:12.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:12 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:12.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:12.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T16:35:12.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: mon.a calling monitor election 2024-05-03T16:35:12.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:12.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:12.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:12.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:12.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: mon.c calling monitor election 2024-05-03T16:35:12.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:12.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:12.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:12.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:12.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-03T16:35:12.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: monmap epoch 2 2024-05-03T16:35:12.565 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: fsid 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:35:12.565 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: last_changed 2024-05-03T16:35:07.010578+0000 2024-05-03T16:35:12.565 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: created 2024-05-03T16:32:44.597150+0000 2024-05-03T16:35:12.565 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: min_mon_release 19 (squid) 2024-05-03T16:35:12.565 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: election_strategy: 1 2024-05-03T16:35:12.565 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-05-03T16:35:12.565 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: 1: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.c 2024-05-03T16:35:12.565 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: fsmap 2024-05-03T16:35:12.565 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T16:35:12.565 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: mgrmap e13: x(active, since 67s) 2024-05-03T16:35:12.565 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: overall HEALTH_OK 2024-05-03T16:35:12.565 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:12.565 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:12 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:13.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.145+0000 7f9157e00700 1 -- 172.21.15.146:0/2549932981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9138005c90 msgr2=0x7f9138008120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:13.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.145+0000 7f9157e00700 1 --2- 172.21.15.146:0/2549932981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9138005c90 0x7f9138008120 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9150104470 tx=0x7f914400ff20 comp rx=0 tx=0).stop 2024-05-03T16:35:13.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.145+0000 7f9157e00700 1 -- 172.21.15.146:0/2549932981 shutdown_connections 2024-05-03T16:35:13.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.145+0000 7f9157e00700 1 --2- 172.21.15.146:0/2549932981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9138005c90 0x7f9138008120 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:13.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.145+0000 7f9157e00700 1 -- 172.21.15.146:0/2549932981 >> 172.21.15.146:0/2549932981 conn(0x7f91500fea90 msgr2=0x7f9150100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:35:13.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.145+0000 7f9157e00700 1 -- 172.21.15.146:0/2549932981 shutdown_connections 2024-05-03T16:35:13.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.145+0000 7f9157e00700 1 -- 172.21.15.146:0/2549932981 wait complete. 2024-05-03T16:35:13.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.149+0000 7f9157e00700 1 Processor -- start 2024-05-03T16:35:13.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.149+0000 7f9157e00700 1 -- start start 2024-05-03T16:35:13.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.151+0000 7f9157e00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9138005c90 0x7f91501a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:13.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.151+0000 7f9157e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91501a0e50 0x7f915019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:13.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.151+0000 7f9157e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f915010adc0 con 0x7f91501a0e50 2024-05-03T16:35:13.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.151+0000 7f9157e00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f915010ac40 con 0x7f9138005c90 2024-05-03T16:35:13.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.152+0000 7f9154a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91501a0e50 0x7f915019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:35:13.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.152+0000 7f9154a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91501a0e50 0x7f915019aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.146:38392/0 (socket says 172.21.15.146:38392) 2024-05-03T16:35:13.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.152+0000 7f9154a00700 1 -- 172.21.15.146:0/2947610283 learned_addr learned my addr 172.21.15.146:0/2947610283 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-05-03T16:35:13.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.152+0000 7f9155400700 1 --2- 172.21.15.146:0/2947610283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9138005c90 0x7f91501a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:35:13.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.153+0000 7f9155400700 1 -- 172.21.15.146:0/2947610283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9138005c90 msgr2=0x7f91501a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-03T16:35:13.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.153+0000 7f9155400700 1 -- 172.21.15.146:0/2947610283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9138005c90 msgr2=0x7f91501a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-03T16:35:13.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.153+0000 7f9155400700 1 --2- 172.21.15.146:0/2947610283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9138005c90 0x7f91501a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-03T16:35:13.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.153+0000 7f9155400700 1 --2- 172.21.15.146:0/2947610283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9138005c90 0x7f91501a0910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-03T16:35:13.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.153+0000 7f9154a00700 1 -- 172.21.15.146:0/2947610283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9138005c90 msgr2=0x7f91501a0910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-03T16:35:13.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.153+0000 7f9154a00700 1 --2- 172.21.15.146:0/2947610283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9138005c90 0x7f91501a0910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:13.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.153+0000 7f9154a00700 1 -- 172.21.15.146:0/2947610283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91501a1490 con 0x7f91501a0e50 2024-05-03T16:35:13.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.153+0000 7f9154a00700 1 --2- 172.21.15.146:0/2947610283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91501a0e50 0x7f915019aad0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f914000b700 tx=0x7f914000bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:35:13.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.154+0000 7f914e000700 1 -- 172.21.15.146:0/2947610283 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f9140011630 con 0x7f91501a0e50 2024-05-03T16:35:13.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.154+0000 7f914e000700 1 -- 172.21.15.146:0/2947610283 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9140011c60 con 0x7f91501a0e50 2024-05-03T16:35:13.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.154+0000 7f914e000700 1 -- 172.21.15.146:0/2947610283 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f9140010c90 con 0x7f91501a0e50 2024-05-03T16:35:13.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.154+0000 7f9157e00700 1 -- 172.21.15.146:0/2947610283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f915019b010 con 0x7f91501a0e50 2024-05-03T16:35:13.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.154+0000 7f9157e00700 1 -- 172.21.15.146:0/2947610283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f915019b5a0 con 0x7f91501a0e50 2024-05-03T16:35:13.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.155+0000 7f9157e00700 1 -- 172.21.15.146:0/2947610283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9150104720 con 0x7f91501a0e50 2024-05-03T16:35:13.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.156+0000 7f914e000700 1 -- 172.21.15.146:0/2947610283 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f9140018020 con 0x7f91501a0e50 2024-05-03T16:35:13.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.157+0000 7f914e000700 1 --2- 172.21.15.146:0/2947610283 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f913403e320 0x7f91340407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:13.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.157+0000 7f914e000700 1 -- 172.21.15.146:0/2947610283 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9140052110 con 0x7f91501a0e50 2024-05-03T16:35:13.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.157+0000 7f9155400700 1 --2- 172.21.15.146:0/2947610283 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f913403e320 0x7f91340407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:35:13.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.159+0000 7f9155400700 1 --2- 172.21.15.146:0/2947610283 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f913403e320 0x7f91340407e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9144000c00 tx=0x7f9144014040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:35:13.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.172+0000 7f914e000700 1 -- 172.21.15.146:0/2947610283 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f914001f020 con 0x7f91501a0e50 2024-05-03T16:35:13.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:13.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T16:35:13.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:13.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:13 smithi081 ceph-mon[28640]: Deploying daemon mon.b on smithi134 2024-05-03T16:35:13.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:13 smithi081 ceph-mon[28640]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:13.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:13.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.504+0000 7f9157e00700 1 -- 172.21.15.146:0/2947610283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f915019bfc0 con 0x7f91501a0e50 2024-05-03T16:35:13.506 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:13.507 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T16:35:13.507 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:13.507 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:13 smithi146 ceph-mon[32357]: Deploying daemon mon.b on smithi134 2024-05-03T16:35:13.507 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:13 smithi146 ceph-mon[32357]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:13.507 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:13.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.506+0000 7f914e000700 1 -- 172.21.15.146:0/2947610283 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f9140014da0 con 0x7f91501a0e50 2024-05-03T16:35:13.508 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:35:13.508 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":2,"fsid":"8988869e-096a-11ef-bc97-c7b262605968","modified":"2024-05-03T16:35:07.010578Z","created":"2024-05-03T16:32:44.597150Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:3300","nonce":0},{"type":"v1","addr":"172.21.15.146:6789","nonce":0}]},"addr":"172.21.15.146:6789/0","public_addr":"172.21.15.146:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-03T16:35:13.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.509+0000 7f9157e00700 1 -- 172.21.15.146:0/2947610283 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f913403e320 msgr2=0x7f91340407e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:13.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.509+0000 7f9157e00700 1 --2- 172.21.15.146:0/2947610283 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f913403e320 0x7f91340407e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9144000c00 tx=0x7f9144014040 comp rx=0 tx=0).stop 2024-05-03T16:35:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.509+0000 7f9157e00700 1 -- 172.21.15.146:0/2947610283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91501a0e50 msgr2=0x7f915019aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.509+0000 7f9157e00700 1 --2- 172.21.15.146:0/2947610283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91501a0e50 0x7f915019aad0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f914000b700 tx=0x7f914000bac0 comp rx=0 tx=0).stop 2024-05-03T16:35:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.510+0000 7f9157e00700 1 -- 172.21.15.146:0/2947610283 shutdown_connections 2024-05-03T16:35:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.510+0000 7f9157e00700 1 --2- 172.21.15.146:0/2947610283 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f913403e320 0x7f91340407e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.510+0000 7f9157e00700 1 --2- 172.21.15.146:0/2947610283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9138005c90 0x7f91501a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.510+0000 7f9157e00700 1 --2- 172.21.15.146:0/2947610283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91501a0e50 0x7f915019aad0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.510+0000 7f9157e00700 1 -- 172.21.15.146:0/2947610283 >> 172.21.15.146:0/2947610283 conn(0x7f91500fea90 msgr2=0x7f91500ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:35:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.510+0000 7f9157e00700 1 -- 172.21.15.146:0/2947610283 shutdown_connections 2024-05-03T16:35:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:13.510+0000 7f9157e00700 1 -- 172.21.15.146:0/2947610283 wait complete. 2024-05-03T16:35:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:dumped monmap epoch 2 2024-05-03T16:35:14.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:14 smithi081 ceph-mon[28640]: from='client.? 172.21.15.146:0/2947610283' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T16:35:14.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:14 smithi146 ceph-mon[32357]: from='client.? 172.21.15.146:0/2947610283' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T16:35:15.278 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-03T16:35:15.279 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-03T16:35:15.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:15 smithi081 ceph-mon[28640]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:15.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:15 smithi146 ceph-mon[32357]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:15.716 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T16:35:17.197 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:17 smithi146 ceph-mon[32357]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:17.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:17 smithi081 ceph-mon[28640]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:17.496 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 podman[31690]: 2024-05-03 16:35:17.141776834 +0000 UTC m=+0.032987826 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T16:35:17.496 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 podman[31690]: 2024-05-03 16:35:17.49378271 +0000 UTC m=+0.384993746 container init 609640d09339d7acfc38e4f6fcdbb769c4403e074001e92b20f9cdfccd6cf256 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-03T16:35:17.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 podman[31690]: 2024-05-03 16:35:17.50417778 +0000 UTC m=+0.395388789 container start 609640d09339d7acfc38e4f6fcdbb769c4403e074001e92b20f9cdfccd6cf256 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-b, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240430) 2024-05-03T16:35:17.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: set uid:gid to 167:167 (ceph:ceph) 2024-05-03T16:35:17.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev), process ceph-mon, pid 2 2024-05-03T16:35:17.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pidfile_write: ignore empty --pid-file 2024-05-03T16:35:17.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: load: jerasure load: lrc 2024-05-03T16:35:17.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: RocksDB version: 7.9.2 2024-05-03T16:35:17.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Git sha 0 2024-05-03T16:35:17.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Compile date 2024-05-01 21:12:03 2024-05-03T16:35:17.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: DB SUMMARY 2024-05-03T16:35:17.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: DB Session ID: ZIG24MGA5TYU0J0GKGUC 2024-05-03T16:35:17.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: CURRENT file: CURRENT 2024-05-03T16:35:17.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: IDENTITY file: IDENTITY 2024-05-03T16:35:17.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-03T16:35:17.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-05-03T16:35:17.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-05-03T16:35:17.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.error_if_exists: 0 2024-05-03T16:35:17.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.create_if_missing: 0 2024-05-03T16:35:17.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.paranoid_checks: 1 2024-05-03T16:35:17.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-03T16:35:17.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-03T16:35:17.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-03T16:35:17.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.env: 0x55a597177cc0 2024-05-03T16:35:17.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.fs: PosixFileSystem 2024-05-03T16:35:17.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.info_log: 0x55a5c6a05de0 2024-05-03T16:35:17.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_file_opening_threads: 16 2024-05-03T16:35:17.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.statistics: (nil) 2024-05-03T16:35:17.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.use_fsync: 0 2024-05-03T16:35:17.971 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_log_file_size: 0 2024-05-03T16:35:17.971 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-03T16:35:17.971 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-03T16:35:17.971 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.keep_log_file_num: 1000 2024-05-03T16:35:17.971 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.recycle_log_file_num: 0 2024-05-03T16:35:17.971 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.allow_fallocate: 1 2024-05-03T16:35:17.972 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.allow_mmap_reads: 0 2024-05-03T16:35:17.972 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.allow_mmap_writes: 0 2024-05-03T16:35:17.972 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.use_direct_reads: 0 2024-05-03T16:35:17.972 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-03T16:35:17.972 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.create_missing_column_families: 0 2024-05-03T16:35:17.972 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.db_log_dir: 2024-05-03T16:35:17.972 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.wal_dir: 2024-05-03T16:35:17.972 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-03T16:35:17.972 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-03T16:35:17.972 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-03T16:35:17.972 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-03T16:35:17.972 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-03T16:35:17.972 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-03T16:35:17.973 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.advise_random_on_open: 1 2024-05-03T16:35:17.973 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.db_write_buffer_size: 0 2024-05-03T16:35:17.973 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.write_buffer_manager: 0x55a5c69d70e0 2024-05-03T16:35:17.973 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-03T16:35:17.973 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-03T16:35:17.973 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-03T16:35:17.973 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.rate_limiter: (nil) 2024-05-03T16:35:17.973 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-03T16:35:17.973 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.wal_recovery_mode: 2 2024-05-03T16:35:17.973 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.enable_thread_tracking: 0 2024-05-03T16:35:17.973 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.enable_pipelined_write: 0 2024-05-03T16:35:17.973 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.unordered_write: 0 2024-05-03T16:35:17.974 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-03T16:35:17.974 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-03T16:35:17.974 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-03T16:35:17.974 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-03T16:35:17.974 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.row_cache: None 2024-05-03T16:35:17.974 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.wal_filter: None 2024-05-03T16:35:17.974 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-03T16:35:17.974 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.allow_ingest_behind: 0 2024-05-03T16:35:17.974 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.two_write_queues: 0 2024-05-03T16:35:17.974 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.manual_wal_flush: 0 2024-05-03T16:35:17.974 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.wal_compression: 0 2024-05-03T16:35:17.974 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.atomic_flush: 0 2024-05-03T16:35:17.974 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-03T16:35:17.975 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-03T16:35:17.975 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-03T16:35:17.975 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.log_readahead_size: 0 2024-05-03T16:35:17.975 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-03T16:35:17.975 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.best_efforts_recovery: 0 2024-05-03T16:35:17.975 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-03T16:35:17.975 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-03T16:35:17.975 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.allow_data_in_errors: 0 2024-05-03T16:35:17.975 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.db_host_id: __hostname__ 2024-05-03T16:35:17.975 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-03T16:35:17.975 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_background_jobs: 2 2024-05-03T16:35:17.975 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_background_compactions: -1 2024-05-03T16:35:17.975 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_subcompactions: 1 2024-05-03T16:35:17.976 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-03T16:35:17.976 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-03T16:35:17.976 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-03T16:35:17.976 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_total_wal_size: 0 2024-05-03T16:35:17.976 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-03T16:35:17.976 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-03T16:35:17.976 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-03T16:35:17.976 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-03T16:35:17.976 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_open_files: -1 2024-05-03T16:35:17.976 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.bytes_per_sync: 0 2024-05-03T16:35:17.976 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-03T16:35:17.976 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-03T16:35:17.976 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compaction_readahead_size: 0 2024-05-03T16:35:17.976 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_background_flushes: -1 2024-05-03T16:35:17.977 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Compression algorithms supported: 2024-05-03T16:35:17.977 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-03T16:35:17.977 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: kZSTD supported: 0 2024-05-03T16:35:17.977 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: kXpressCompression supported: 0 2024-05-03T16:35:17.977 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: kLZ4HCCompression supported: 1 2024-05-03T16:35:17.977 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: kZlibCompression supported: 1 2024-05-03T16:35:17.977 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: kSnappyCompression supported: 1 2024-05-03T16:35:17.977 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: kLZ4Compression supported: 1 2024-05-03T16:35:17.977 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: kBZip2Compression supported: 0 2024-05-03T16:35:17.977 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-03T16:35:17.977 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-03T16:35:17.977 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-05-03T16:35:17.977 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-03T16:35:17.977 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-03T16:35:17.978 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.merge_operator: 2024-05-03T16:35:17.978 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compaction_filter: None 2024-05-03T16:35:17.978 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compaction_filter_factory: None 2024-05-03T16:35:17.978 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.sst_partitioner_factory: None 2024-05-03T16:35:17.978 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-03T16:35:17.978 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-03T16:35:17.978 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a5c6a05fa0) 2024-05-03T16:35:17.978 INFO:journalctl@ceph.mon.b.smithi134.stdout: cache_index_and_filter_blocks: 1 2024-05-03T16:35:17.978 INFO:journalctl@ceph.mon.b.smithi134.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-03T16:35:17.978 INFO:journalctl@ceph.mon.b.smithi134.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-03T16:35:17.978 INFO:journalctl@ceph.mon.b.smithi134.stdout: pin_top_level_index_and_filter: 1 2024-05-03T16:35:17.978 INFO:journalctl@ceph.mon.b.smithi134.stdout: index_type: 0 2024-05-03T16:35:17.978 INFO:journalctl@ceph.mon.b.smithi134.stdout: data_block_index_type: 0 2024-05-03T16:35:17.979 INFO:journalctl@ceph.mon.b.smithi134.stdout: index_shortening: 1 2024-05-03T16:35:17.979 INFO:journalctl@ceph.mon.b.smithi134.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-03T16:35:17.979 INFO:journalctl@ceph.mon.b.smithi134.stdout: checksum: 4 2024-05-03T16:35:17.979 INFO:journalctl@ceph.mon.b.smithi134.stdout: no_block_cache: 0 2024-05-03T16:35:17.979 INFO:journalctl@ceph.mon.b.smithi134.stdout: block_cache: 0x55a5c6a091f0 2024-05-03T16:35:17.979 INFO:journalctl@ceph.mon.b.smithi134.stdout: block_cache_name: BinnedLRUCache 2024-05-03T16:35:17.979 INFO:journalctl@ceph.mon.b.smithi134.stdout: block_cache_options: 2024-05-03T16:35:17.979 INFO:journalctl@ceph.mon.b.smithi134.stdout: capacity : 536870912 2024-05-03T16:35:17.979 INFO:journalctl@ceph.mon.b.smithi134.stdout: num_shard_bits : 4 2024-05-03T16:35:17.979 INFO:journalctl@ceph.mon.b.smithi134.stdout: strict_capacity_limit : 0 2024-05-03T16:35:17.979 INFO:journalctl@ceph.mon.b.smithi134.stdout: high_pri_pool_ratio: 0.000 2024-05-03T16:35:17.979 INFO:journalctl@ceph.mon.b.smithi134.stdout: block_cache_compressed: (nil) 2024-05-03T16:35:17.980 INFO:journalctl@ceph.mon.b.smithi134.stdout: persistent_cache: (nil) 2024-05-03T16:35:17.980 INFO:journalctl@ceph.mon.b.smithi134.stdout: block_size: 4096 2024-05-03T16:35:17.980 INFO:journalctl@ceph.mon.b.smithi134.stdout: block_size_deviation: 10 2024-05-03T16:35:17.980 INFO:journalctl@ceph.mon.b.smithi134.stdout: block_restart_interval: 16 2024-05-03T16:35:17.980 INFO:journalctl@ceph.mon.b.smithi134.stdout: index_block_restart_interval: 1 2024-05-03T16:35:17.980 INFO:journalctl@ceph.mon.b.smithi134.stdout: metadata_block_size: 4096 2024-05-03T16:35:17.980 INFO:journalctl@ceph.mon.b.smithi134.stdout: partition_filters: 0 2024-05-03T16:35:17.980 INFO:journalctl@ceph.mon.b.smithi134.stdout: use_delta_encoding: 1 2024-05-03T16:35:17.980 INFO:journalctl@ceph.mon.b.smithi134.stdout: filter_policy: bloomfilter 2024-05-03T16:35:17.980 INFO:journalctl@ceph.mon.b.smithi134.stdout: whole_key_filtering: 1 2024-05-03T16:35:17.980 INFO:journalctl@ceph.mon.b.smithi134.stdout: verify_compression: 0 2024-05-03T16:35:17.980 INFO:journalctl@ceph.mon.b.smithi134.stdout: read_amp_bytes_per_bit: 0 2024-05-03T16:35:17.981 INFO:journalctl@ceph.mon.b.smithi134.stdout: format_version: 5 2024-05-03T16:35:17.981 INFO:journalctl@ceph.mon.b.smithi134.stdout: enable_index_compression: 1 2024-05-03T16:35:17.981 INFO:journalctl@ceph.mon.b.smithi134.stdout: block_align: 0 2024-05-03T16:35:17.981 INFO:journalctl@ceph.mon.b.smithi134.stdout: max_auto_readahead_size: 262144 2024-05-03T16:35:17.981 INFO:journalctl@ceph.mon.b.smithi134.stdout: prepopulate_block_cache: 0 2024-05-03T16:35:17.981 INFO:journalctl@ceph.mon.b.smithi134.stdout: initial_auto_readahead_size: 8192 2024-05-03T16:35:17.981 INFO:journalctl@ceph.mon.b.smithi134.stdout: num_file_reads_for_auto_readahead: 2 2024-05-03T16:35:17.981 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.write_buffer_size: 33554432 2024-05-03T16:35:17.981 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_write_buffer_number: 2 2024-05-03T16:35:17.981 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compression: NoCompression 2024-05-03T16:35:17.981 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.bottommost_compression: Disabled 2024-05-03T16:35:17.981 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.prefix_extractor: nullptr 2024-05-03T16:35:17.981 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-03T16:35:17.981 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.num_levels: 7 2024-05-03T16:35:17.982 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-03T16:35:17.983 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-03T16:35:17.983 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-03T16:35:17.983 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-03T16:35:17.983 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-03T16:35:17.983 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-03T16:35:17.983 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-03T16:35:17.983 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-03T16:35:17.984 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-03T16:35:17.984 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-03T16:35:17.984 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-03T16:35:17.984 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-03T16:35:17.984 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-03T16:35:17.984 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compression_opts.level: 32767 2024-05-03T16:35:17.984 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compression_opts.strategy: 0 2024-05-03T16:35:17.984 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-03T16:35:17.984 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-03T16:35:17.984 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-03T16:35:17.984 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-03T16:35:17.984 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compression_opts.enabled: false 2024-05-03T16:35:17.984 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-03T16:35:17.984 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-03T16:35:17.985 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-03T16:35:17.985 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-03T16:35:17.985 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.target_file_size_base: 67108864 2024-05-03T16:35:17.985 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-03T16:35:17.985 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-03T16:35:17.985 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-03T16:35:17.985 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-03T16:35:17.985 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-03T16:35:17.985 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-03T16:35:17.985 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-03T16:35:17.985 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-03T16:35:17.985 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-03T16:35:17.985 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-03T16:35:17.985 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-03T16:35:17.986 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-03T16:35:17.986 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-03T16:35:17.986 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-03T16:35:17.986 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.arena_block_size: 1048576 2024-05-03T16:35:17.986 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-03T16:35:17.986 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-03T16:35:17.986 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.disable_auto_compactions: 0 2024-05-03T16:35:17.986 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-03T16:35:17.986 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-03T16:35:17.986 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-03T16:35:17.986 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-03T16:35:17.986 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-03T16:35:17.986 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-03T16:35:17.987 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-03T16:35:17.987 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-03T16:35:17.987 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-03T16:35:17.987 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-03T16:35:17.987 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-03T16:35:17.987 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.inplace_update_support: 0 2024-05-03T16:35:17.987 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-03T16:35:17.987 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-03T16:35:17.987 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-03T16:35:17.987 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-03T16:35:17.987 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.bloom_locality: 0 2024-05-03T16:35:17.987 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.max_successive_merges: 0 2024-05-03T16:35:17.987 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-03T16:35:17.987 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.paranoid_file_checks: 0 2024-05-03T16:35:17.988 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.force_consistency_checks: 1 2024-05-03T16:35:17.988 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.report_bg_io_stats: 0 2024-05-03T16:35:17.988 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.ttl: 2592000 2024-05-03T16:35:17.988 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-03T16:35:17.988 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-03T16:35:17.988 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-03T16:35:17.988 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.enable_blob_files: false 2024-05-03T16:35:17.988 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.min_blob_size: 0 2024-05-03T16:35:17.988 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.blob_file_size: 268435456 2024-05-03T16:35:17.988 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-03T16:35:17.988 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-03T16:35:17.988 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-03T16:35:17.988 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-03T16:35:17.989 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-03T16:35:17.989 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.blob_file_starting_level: 0 2024-05-03T16:35:17.989 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-03T16:35:17.989 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-03T16:35:17.989 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-03T16:35:17.989 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1f57f739-a7ae-4dad-ac74-a9e4a977b50e 2024-05-03T16:35:17.989 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714754117566549, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-03T16:35:17.989 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-03T16:35:17.989 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714754117567859, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714754117, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1f57f739-a7ae-4dad-ac74-a9e4a977b50e", "db_session_id": "ZIG24MGA5TYU0J0GKGUC", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-03T16:35:17.989 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714754117568201, "job": 1, "event": "recovery_finished"} 2024-05-03T16:35:17.990 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-03T16:35:17.990 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-03T16:35:17.990 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a5c6b26000 2024-05-03T16:35:17.990 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: DB pointer 0x55a5c6b12000 2024-05-03T16:35:17.990 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-03T16:35:17.990 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-03T16:35:17.990 INFO:journalctl@ceph.mon.b.smithi134.stdout: ** DB Stats ** 2024-05-03T16:35:17.990 INFO:journalctl@ceph.mon.b.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-03T16:35:17.990 INFO:journalctl@ceph.mon.b.smithi134.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-03T16:35:17.990 INFO:journalctl@ceph.mon.b.smithi134.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-03T16:35:17.990 INFO:journalctl@ceph.mon.b.smithi134.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-03T16:35:17.990 INFO:journalctl@ceph.mon.b.smithi134.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-03T16:35:17.991 INFO:journalctl@ceph.mon.b.smithi134.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-03T16:35:17.991 INFO:journalctl@ceph.mon.b.smithi134.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-03T16:35:17.991 INFO:journalctl@ceph.mon.b.smithi134.stdout: 2024-05-03T16:35:17.991 INFO:journalctl@ceph.mon.b.smithi134.stdout: ** Compaction Stats [default] ** 2024-05-03T16:35:17.991 INFO:journalctl@ceph.mon.b.smithi134.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-03T16:35:17.991 INFO:journalctl@ceph.mon.b.smithi134.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-03T16:35:17.991 INFO:journalctl@ceph.mon.b.smithi134.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T16:35:17.991 INFO:journalctl@ceph.mon.b.smithi134.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T16:35:17.991 INFO:journalctl@ceph.mon.b.smithi134.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T16:35:17.991 INFO:journalctl@ceph.mon.b.smithi134.stdout: 2024-05-03T16:35:17.991 INFO:journalctl@ceph.mon.b.smithi134.stdout: ** Compaction Stats [default] ** 2024-05-03T16:35:17.991 INFO:journalctl@ceph.mon.b.smithi134.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-03T16:35:17.992 INFO:journalctl@ceph.mon.b.smithi134.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-03T16:35:17.992 INFO:journalctl@ceph.mon.b.smithi134.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T16:35:17.992 INFO:journalctl@ceph.mon.b.smithi134.stdout: 2024-05-03T16:35:17.992 INFO:journalctl@ceph.mon.b.smithi134.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-03T16:35:17.992 INFO:journalctl@ceph.mon.b.smithi134.stdout: 2024-05-03T16:35:17.992 INFO:journalctl@ceph.mon.b.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-03T16:35:17.992 INFO:journalctl@ceph.mon.b.smithi134.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-03T16:35:17.992 INFO:journalctl@ceph.mon.b.smithi134.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-03T16:35:17.992 INFO:journalctl@ceph.mon.b.smithi134.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-03T16:35:17.992 INFO:journalctl@ceph.mon.b.smithi134.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-03T16:35:17.992 INFO:journalctl@ceph.mon.b.smithi134.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-03T16:35:17.992 INFO:journalctl@ceph.mon.b.smithi134.stdout: Cumulative compaction: 0.00 GB write, 0.18 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-03T16:35:17.992 INFO:journalctl@ceph.mon.b.smithi134.stdout: Interval compaction: 0.00 GB write, 0.18 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-03T16:35:17.992 INFO:journalctl@ceph.mon.b.smithi134.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-03T16:35:17.993 INFO:journalctl@ceph.mon.b.smithi134.stdout: Block cache BinnedLRUCache@0x55a5c6a091f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-05-03T16:35:17.993 INFO:journalctl@ceph.mon.b.smithi134.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-03T16:35:17.993 INFO:journalctl@ceph.mon.b.smithi134.stdout: 2024-05-03T16:35:17.993 INFO:journalctl@ceph.mon.b.smithi134.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-03T16:35:17.993 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-05-03T16:35:17.993 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: using public_addr v2:172.21.15.134:0/0 -> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] 2024-05-03T16:35:17.993 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: starting mon.b rank -1 at public addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] at bind addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:35:17.993 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: mon.b@-1(???) e0 preinit fsid 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:35:17.993 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 bash[31690]: 609640d09339d7acfc38e4f6fcdbb769c4403e074001e92b20f9cdfccd6cf256 2024-05-03T16:35:17.993 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 systemd[1]: Started Ceph mon.b for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:35:17.993 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: mon.b@-1(synchronizing).mds e1 new map 2024-05-03T16:35:17.994 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: mon.b@-1(synchronizing).mds e1 print_map 2024-05-03T16:35:17.994 INFO:journalctl@ceph.mon.b.smithi134.stdout: e1 2024-05-03T16:35:17.994 INFO:journalctl@ceph.mon.b.smithi134.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-03T16:35:17.994 INFO:journalctl@ceph.mon.b.smithi134.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-03T16:35:17.994 INFO:journalctl@ceph.mon.b.smithi134.stdout: legacy client fscid: -1 2024-05-03T16:35:17.994 INFO:journalctl@ceph.mon.b.smithi134.stdout: 2024-05-03T16:35:17.994 INFO:journalctl@ceph.mon.b.smithi134.stdout: No filesystems configured 2024-05-03T16:35:17.994 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-03T16:35:17.994 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-03T16:35:17.994 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-03T16:35:17.994 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-03T16:35:17.994 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-03T16:35:17.994 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-03T16:35:17.995 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-03T16:35:17.995 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T16:35:17.995 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T16:35:17.995 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T16:35:17.995 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:17.995 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: Deploying cephadm binary to smithi134 2024-05-03T16:35:17.995 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:17.995 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:17.995 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.995 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:35:17.995 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: Added host smithi134 2024-05-03T16:35:17.995 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.995 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:17.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:17.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T16:35:17.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:17.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:17.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi146", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:35:17.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:35:17.997 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:17.997 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:35:17.997 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: Deploying cephadm binary to smithi146 2024-05-03T16:35:17.997 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: Updating smithi134:/etc/ceph/ceph.conf 2024-05-03T16:35:17.997 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:17.997 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: Updating smithi134:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T16:35:17.997 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:17.997 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-05-03T16:35:17.997 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.997 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:17.997 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: Added host smithi146 2024-05-03T16:35:17.997 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: Updating smithi134:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T16:35:17.997 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.997 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.998 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.998 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:35:17.998 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:17.998 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.998 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.998 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T16:35:17.998 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:17.998 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.998 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:17.998 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3776218218' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-03T16:35:17.998 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3776218218' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-03T16:35:17.998 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T16:35:17.998 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:17.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:17.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi146", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:35:17.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:17.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:35:17.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: Updating smithi146:/etc/ceph/ceph.conf 2024-05-03T16:35:17.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: Updating smithi146:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T16:35:17.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi081:172.21.15.81=a;smithi134:172.21.15.134=b;smithi146:172.21.15.146=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:35:17.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: Saving service mon spec with placement smithi081:172.21.15.81=a;smithi134:172.21.15.134=b;smithi146:172.21.15.146=c;count:3 2024-05-03T16:35:17.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:17.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: Updating smithi146:/etc/ceph/ceph.client.admin.keyring 2024-05-03T16:35:17.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:18.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: Updating smithi146:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T16:35:18.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:18.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:18.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:18.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T16:35:18.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:18.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: Deploying daemon mon.c on smithi146 2024-05-03T16:35:18.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:18.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='client.? 172.21.15.146:0/3682779893' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T16:35:18.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:18.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:18.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:18.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T16:35:18.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: mon.a calling monitor election 2024-05-03T16:35:18.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:18.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:18.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:18.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:18.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: mon.c calling monitor election 2024-05-03T16:35:18.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:18.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:18.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:18.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:18.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-03T16:35:18.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: monmap epoch 2 2024-05-03T16:35:18.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: fsid 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:35:18.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: last_changed 2024-05-03T16:35:07.010578+0000 2024-05-03T16:35:18.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: created 2024-05-03T16:32:44.597150+0000 2024-05-03T16:35:18.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: min_mon_release 19 (squid) 2024-05-03T16:35:18.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: election_strategy: 1 2024-05-03T16:35:18.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-05-03T16:35:18.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: 1: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.c 2024-05-03T16:35:18.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: fsmap 2024-05-03T16:35:18.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T16:35:18.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: mgrmap e13: x(active, since 67s) 2024-05-03T16:35:18.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: overall HEALTH_OK 2024-05-03T16:35:18.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:18.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:18.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:18.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T16:35:18.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:18.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: Deploying daemon mon.b on smithi134 2024-05-03T16:35:18.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:18.003 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:18.003 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: from='client.? 172.21.15.146:0/2947610283' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T16:35:18.003 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:18.003 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:18.003 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:17 smithi134 ceph-mon[31708]: mon.b@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2024-05-03T16:35:22.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T16:35:22.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: mon.a calling monitor election 2024-05-03T16:35:22.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: mon.c calling monitor election 2024-05-03T16:35:22.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:22.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:22.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:22.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:22.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:22.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: mon.b calling monitor election 2024-05-03T16:35:22.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:22.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:22.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:22.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:22.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-03T16:35:22.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: monmap epoch 3 2024-05-03T16:35:22.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: fsid 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:35:22.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: last_changed 2024-05-03T16:35:17.628162+0000 2024-05-03T16:35:22.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: created 2024-05-03T16:32:44.597150+0000 2024-05-03T16:35:22.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: min_mon_release 19 (squid) 2024-05-03T16:35:22.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: election_strategy: 1 2024-05-03T16:35:22.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-05-03T16:35:22.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: 1: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.c 2024-05-03T16:35:22.993 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: 2: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-05-03T16:35:22.993 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: fsmap 2024-05-03T16:35:22.993 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T16:35:22.993 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: mgrmap e13: x(active, since 78s) 2024-05-03T16:35:22.993 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: overall HEALTH_OK 2024-05-03T16:35:22.993 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:22.993 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:23.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T16:35:23.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: mon.a calling monitor election 2024-05-03T16:35:23.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: mon.c calling monitor election 2024-05-03T16:35:23.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:23.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:23.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:23.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:23.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:23.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: mon.b calling monitor election 2024-05-03T16:35:23.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:23.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:23.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:23.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:23.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-03T16:35:23.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: monmap epoch 3 2024-05-03T16:35:23.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: fsid 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:35:23.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: last_changed 2024-05-03T16:35:17.628162+0000 2024-05-03T16:35:23.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: created 2024-05-03T16:32:44.597150+0000 2024-05-03T16:35:23.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: min_mon_release 19 (squid) 2024-05-03T16:35:23.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: election_strategy: 1 2024-05-03T16:35:23.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-05-03T16:35:23.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: 1: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.c 2024-05-03T16:35:23.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: 2: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-05-03T16:35:23.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: fsmap 2024-05-03T16:35:23.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T16:35:23.066 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: mgrmap e13: x(active, since 78s) 2024-05-03T16:35:23.066 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: overall HEALTH_OK 2024-05-03T16:35:23.066 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:23.066 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:23.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T16:35:23.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: mon.a calling monitor election 2024-05-03T16:35:23.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: mon.c calling monitor election 2024-05-03T16:35:23.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:23.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:35:23.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:23.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:23.219 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:23.219 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: mon.b calling monitor election 2024-05-03T16:35:23.219 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:23.219 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:23.219 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:23.219 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:23.219 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-03T16:35:23.219 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: monmap epoch 3 2024-05-03T16:35:23.219 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: fsid 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:35:23.219 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: last_changed 2024-05-03T16:35:17.628162+0000 2024-05-03T16:35:23.219 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: created 2024-05-03T16:32:44.597150+0000 2024-05-03T16:35:23.219 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: min_mon_release 19 (squid) 2024-05-03T16:35:23.219 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: election_strategy: 1 2024-05-03T16:35:23.219 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-05-03T16:35:23.220 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: 1: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.c 2024-05-03T16:35:23.220 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: 2: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-05-03T16:35:23.220 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: fsmap 2024-05-03T16:35:23.220 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T16:35:23.220 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: mgrmap e13: x(active, since 78s) 2024-05-03T16:35:23.220 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: overall HEALTH_OK 2024-05-03T16:35:23.220 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:23.220 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:23.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.659+0000 7f29b5000700 1 -- 172.21.15.146:0/3090129643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2994005cc0 msgr2=0x7f2994008150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:23.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.659+0000 7f29b5000700 1 --2- 172.21.15.146:0/3090129643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2994005cc0 0x7f2994008150 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f29b0076cd0 tx=0x7f29a000ff20 comp rx=0 tx=0).stop 2024-05-03T16:35:23.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.659+0000 7f29b5000700 1 -- 172.21.15.146:0/3090129643 shutdown_connections 2024-05-03T16:35:23.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.659+0000 7f29b5000700 1 --2- 172.21.15.146:0/3090129643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2994005cc0 0x7f2994008150 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:23.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.659+0000 7f29b5000700 1 -- 172.21.15.146:0/3090129643 >> 172.21.15.146:0/3090129643 conn(0x7f29b00fe910 msgr2=0x7f29b0100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:35:23.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.660+0000 7f29b5000700 1 -- 172.21.15.146:0/3090129643 shutdown_connections 2024-05-03T16:35:23.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.660+0000 7f29b5000700 1 -- 172.21.15.146:0/3090129643 wait complete. 2024-05-03T16:35:23.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.662+0000 7f29b5000700 1 Processor -- start 2024-05-03T16:35:23.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.662+0000 7f29b5000700 1 -- start start 2024-05-03T16:35:23.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.663+0000 7f29b5000700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2994005cc0 0x7f29b019efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:23.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.663+0000 7f29b5000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b019f510 0x7f29b01a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.663+0000 7f29b5000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29b01a3de0 0x7f29b01a4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.663+0000 7f29b5000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29b01111b0 con 0x7f29b01a3de0 2024-05-03T16:35:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.663+0000 7f29b5000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0111030 con 0x7f29b019f510 2024-05-03T16:35:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.663+0000 7f29b5000700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0111330 con 0x7f2994005cc0 2024-05-03T16:35:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.663+0000 7f29af400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2994005cc0 0x7f29b019efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:35:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.664+0000 7f29af400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2994005cc0 0x7f29b019efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59926/0 (socket says 172.21.15.146:59926) 2024-05-03T16:35:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.664+0000 7f29af400700 1 -- 172.21.15.146:0/2650425925 learned_addr learned my addr 172.21.15.146:0/2650425925 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-05-03T16:35:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.664+0000 7f29afe00700 1 --2- 172.21.15.146:0/2650425925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29b01a3de0 0x7f29b01a4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:35:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.664+0000 7f29af400700 1 -- 172.21.15.146:0/2650425925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b019f510 msgr2=0x7f29b01a38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.664+0000 7f29af400700 1 --2- 172.21.15.146:0/2650425925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b019f510 0x7f29b01a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.664+0000 7f29af400700 1 -- 172.21.15.146:0/2650425925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29b01a3de0 msgr2=0x7f29b01a4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.664+0000 7f29af400700 1 --2- 172.21.15.146:0/2650425925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29b01a3de0 0x7f29b01a4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.664+0000 7f29af400700 1 -- 172.21.15.146:0/2650425925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b01abb50 con 0x7f2994005cc0 2024-05-03T16:35:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.664+0000 7f29af400700 1 --2- 172.21.15.146:0/2650425925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2994005cc0 0x7f29b019efd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f29a0005100 tx=0x7f29a0014ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:35:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.665+0000 7f29a7e00700 1 -- 172.21.15.146:0/2650425925 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a002b070 con 0x7f2994005cc0 2024-05-03T16:35:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.665+0000 7f29b5000700 1 -- 172.21.15.146:0/2650425925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b01abd20 con 0x7f2994005cc0 2024-05-03T16:35:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.665+0000 7f29a7e00700 1 -- 172.21.15.146:0/2650425925 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29a00055f0 con 0x7f2994005cc0 2024-05-03T16:35:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.665+0000 7f29a7e00700 1 -- 172.21.15.146:0/2650425925 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a00146b0 con 0x7f2994005cc0 2024-05-03T16:35:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.665+0000 7f29b5000700 1 -- 172.21.15.146:0/2650425925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b01ac1b0 con 0x7f2994005cc0 2024-05-03T16:35:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.666+0000 7f29a7e00700 1 -- 172.21.15.146:0/2650425925 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f29a002e070 con 0x7f2994005cc0 2024-05-03T16:35:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.667+0000 7f29b5000700 1 -- 172.21.15.146:0/2650425925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b0064b00 con 0x7f2994005cc0 2024-05-03T16:35:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.667+0000 7f29a7e00700 1 --2- 172.21.15.146:0/2650425925 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f299003e9a0 0x7f2990040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:23.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.667+0000 7f29a7e00700 1 -- 172.21.15.146:0/2650425925 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f29a0055570 con 0x7f2994005cc0 2024-05-03T16:35:23.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.667+0000 7f29aea00700 1 --2- 172.21.15.146:0/2650425925 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f299003e9a0 0x7f2990040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:35:23.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.668+0000 7f29aea00700 1 --2- 172.21.15.146:0/2650425925 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f299003e9a0 0x7f2990040e60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f299c0098e0 tx=0x7f299c006dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:35:23.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:23.679+0000 7f29a7e00700 1 -- 172.21.15.146:0/2650425925 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f29a00057a0 con 0x7f2994005cc0 2024-05-03T16:35:23.916 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:23 smithi134 ceph-mon[31708]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:23.916 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:23 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:23.916 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:23 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:23.917 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:23 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:35:23.917 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:23 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:23.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:23 smithi081 ceph-mon[28640]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:23.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:23 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:23.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:23 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:23.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:23 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:35:23.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:23 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:24.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:24.006+0000 7f29b5000700 1 -- 172.21.15.146:0/2650425925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f29b01a0330 con 0x7f2994005cc0 2024-05-03T16:35:24.008 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:23 smithi146 ceph-mon[32357]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:24.008 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:23 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:24.008 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:23 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:24.008 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:23 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:35:24.008 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:23 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:35:24.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:24.006+0000 7f29a7e00700 1 -- 172.21.15.146:0/2650425925 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1285 (secure 0 0 0) 0x7f29b01a0330 con 0x7f2994005cc0 2024-05-03T16:35:24.009 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-05-03T16:35:24.009 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":3,"fsid":"8988869e-096a-11ef-bc97-c7b262605968","modified":"2024-05-03T16:35:17.628162Z","created":"2024-05-03T16:32:44.597150Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:3300","nonce":0},{"type":"v1","addr":"172.21.15.146:6789","nonce":0}]},"addr":"172.21.15.146:6789/0","public_addr":"172.21.15.146:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-03T16:35:24.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:24.009+0000 7f29b5000700 1 -- 172.21.15.146:0/2650425925 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f299003e9a0 msgr2=0x7f2990040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:24.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:24.009+0000 7f29b5000700 1 --2- 172.21.15.146:0/2650425925 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f299003e9a0 0x7f2990040e60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f299c0098e0 tx=0x7f299c006dd0 comp rx=0 tx=0).stop 2024-05-03T16:35:24.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:24.009+0000 7f29b5000700 1 -- 172.21.15.146:0/2650425925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2994005cc0 msgr2=0x7f29b019efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:24.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:24.009+0000 7f29b5000700 1 --2- 172.21.15.146:0/2650425925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2994005cc0 0x7f29b019efd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f29a0005100 tx=0x7f29a0014ff0 comp rx=0 tx=0).stop 2024-05-03T16:35:24.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:24.009+0000 7f29b5000700 1 -- 172.21.15.146:0/2650425925 shutdown_connections 2024-05-03T16:35:24.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:24.009+0000 7f29b5000700 1 --2- 172.21.15.146:0/2650425925 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f299003e9a0 0x7f2990040e60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:24.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:24.009+0000 7f29b5000700 1 --2- 172.21.15.146:0/2650425925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2994005cc0 0x7f29b019efd0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:24.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:24.009+0000 7f29b5000700 1 --2- 172.21.15.146:0/2650425925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29b01a3de0 0x7f29b01a4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:24.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:24.009+0000 7f29b5000700 1 --2- 172.21.15.146:0/2650425925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b019f510 0x7f29b01a38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:24.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:24.009+0000 7f29b5000700 1 -- 172.21.15.146:0/2650425925 >> 172.21.15.146:0/2650425925 conn(0x7f29b00fe910 msgr2=0x7f29b0102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:35:24.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:24.010+0000 7f29b5000700 1 -- 172.21.15.146:0/2650425925 shutdown_connections 2024-05-03T16:35:24.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:24.010+0000 7f29b5000700 1 -- 172.21.15.146:0/2650425925 wait complete. 2024-05-03T16:35:24.013 INFO:teuthology.orchestra.run.smithi146.stderr:dumped monmap epoch 3 2024-05-03T16:35:24.791 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-03T16:35:24.792 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph config generate-minimal-conf 2024-05-03T16:35:24.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:24 smithi081 ceph-mon[28640]: from='client.? 172.21.15.146:0/2650425925' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T16:35:24.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:24 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:25.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:24 smithi146 ceph-mon[32357]: from='client.? 172.21.15.146:0/2650425925' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T16:35:25.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:24 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:25.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:24 smithi134 ceph-mon[31708]: from='client.? 172.21.15.146:0/2650425925' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T16:35:25.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:24 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:35:25.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:25 smithi081 ceph-mon[28640]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:25.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:25 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:25.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:25 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:25.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:25 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:25.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:25 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:25.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:25 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:25.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:25 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:35:26.020 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:25 smithi146 ceph-mon[32357]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:26.020 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:25 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:26.020 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:25 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:26.020 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:25 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:26.020 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:25 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:26.020 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:25 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:26.021 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:25 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:35:26.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:25 smithi134 ceph-mon[31708]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:26.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:25 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:26.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:25 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:26.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:25 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:26.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:25 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:26.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:25 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:26.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:25 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:35:26.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:26 smithi081 ceph-mon[28640]: Updating smithi081:/etc/ceph/ceph.conf 2024-05-03T16:35:26.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:26 smithi081 ceph-mon[28640]: Updating smithi134:/etc/ceph/ceph.conf 2024-05-03T16:35:26.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:26 smithi081 ceph-mon[28640]: Updating smithi146:/etc/ceph/ceph.conf 2024-05-03T16:35:27.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:26 smithi146 ceph-mon[32357]: Updating smithi081:/etc/ceph/ceph.conf 2024-05-03T16:35:27.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:26 smithi146 ceph-mon[32357]: Updating smithi134:/etc/ceph/ceph.conf 2024-05-03T16:35:27.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:26 smithi146 ceph-mon[32357]: Updating smithi146:/etc/ceph/ceph.conf 2024-05-03T16:35:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.210+0000 7f0dd9e00700 1 -- 172.21.15.81:0/2673582969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd4103110 msgr2=0x7f0dd41034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.210+0000 7f0dd9e00700 1 --2- 172.21.15.81:0/2673582969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd4103110 0x7f0dd41034f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4009910 tx=0x7f0dc4009c20 comp rx=0 tx=0).stop 2024-05-03T16:35:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.210+0000 7f0dd9e00700 1 -- 172.21.15.81:0/2673582969 shutdown_connections 2024-05-03T16:35:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.210+0000 7f0dd9e00700 1 --2- 172.21.15.81:0/2673582969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd4103110 0x7f0dd41034f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.210+0000 7f0dd9e00700 1 -- 172.21.15.81:0/2673582969 >> 172.21.15.81:0/2673582969 conn(0x7f0dd40fe9e0 msgr2=0x7f0dd4100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:35:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.210+0000 7f0dd9e00700 1 -- 172.21.15.81:0/2673582969 shutdown_connections 2024-05-03T16:35:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.210+0000 7f0dd9e00700 1 -- 172.21.15.81:0/2673582969 wait complete. 2024-05-03T16:35:27.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.212+0000 7f0dd9e00700 1 Processor -- start 2024-05-03T16:35:27.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.212+0000 7f0dd9e00700 1 -- start start 2024-05-03T16:35:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.213+0000 7f0dd9e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dd4103110 0x7f0dd40757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.213+0000 7f0dd9e00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dd4075ce0 0x7f0dd4076160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.213+0000 7f0dd9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd41a4d10 0x7f0dd41a7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.213+0000 7f0dd9e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd410d240 con 0x7f0dd41a4d10 2024-05-03T16:35:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.213+0000 7f0dd9e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd410d0c0 con 0x7f0dd4103110 2024-05-03T16:35:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.213+0000 7f0dd9e00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd410d3c0 con 0x7f0dd4075ce0 2024-05-03T16:35:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.213+0000 7f0dd3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd41a4d10 0x7f0dd41a7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:35:27.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.213+0000 7f0dd2a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dd4103110 0x7f0dd40757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:35:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.213+0000 7f0dd3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd41a4d10 0x7f0dd41a7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41818/0 (socket says 172.21.15.81:41818) 2024-05-03T16:35:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.213+0000 7f0dd3400700 1 -- 172.21.15.81:0/371013453 learned_addr learned my addr 172.21.15.81:0/371013453 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:35:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.213+0000 7f0dd2000700 1 --2- 172.21.15.81:0/371013453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dd4075ce0 0x7f0dd4076160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:35:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.214+0000 7f0dd2a00700 1 -- 172.21.15.81:0/371013453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dd4103110 msgr2=0x7f0dd40757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-03T16:35:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.214+0000 7f0dd2a00700 1 -- 172.21.15.81:0/371013453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dd4103110 msgr2=0x7f0dd40757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-03T16:35:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.214+0000 7f0dd2a00700 1 --2- 172.21.15.81:0/371013453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dd4103110 0x7f0dd40757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-03T16:35:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.214+0000 7f0dd2a00700 1 --2- 172.21.15.81:0/371013453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dd4103110 0x7f0dd40757a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-03T16:35:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.214+0000 7f0dd3400700 1 -- 172.21.15.81:0/371013453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dd4075ce0 msgr2=0x7f0dd4076160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.214+0000 7f0dd3400700 1 --2- 172.21.15.81:0/371013453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dd4075ce0 0x7f0dd4076160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.214+0000 7f0dd3400700 1 -- 172.21.15.81:0/371013453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dd4103110 msgr2=0x7f0dd40757a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-03T16:35:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.214+0000 7f0dd3400700 1 --2- 172.21.15.81:0/371013453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dd4103110 0x7f0dd40757a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:27.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.214+0000 7f0dd3400700 1 -- 172.21.15.81:0/371013453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd41a77d0 con 0x7f0dd41a4d10 2024-05-03T16:35:27.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.214+0000 7f0dd2000700 1 --2- 172.21.15.81:0/371013453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dd4075ce0 0x7f0dd4076160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:35:27.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.214+0000 7f0dd3400700 1 --2- 172.21.15.81:0/371013453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd41a4d10 0x7f0dd41a7100 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00ba50 tx=0x7f0dcc00be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:35:27.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.214+0000 7f0dd8a00700 1 -- 172.21.15.81:0/371013453 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc019070 con 0x7f0dd41a4d10 2024-05-03T16:35:27.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.215+0000 7f0dd8a00700 1 -- 172.21.15.81:0/371013453 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0dcc014440 con 0x7f0dd41a4d10 2024-05-03T16:35:27.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.215+0000 7f0dd8a00700 1 -- 172.21.15.81:0/371013453 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc0075b0 con 0x7f0dd41a4d10 2024-05-03T16:35:27.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.215+0000 7f0dd9e00700 1 -- 172.21.15.81:0/371013453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dd41a7ac0 con 0x7f0dd41a4d10 2024-05-03T16:35:27.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:26 smithi134 ceph-mon[31708]: Updating smithi081:/etc/ceph/ceph.conf 2024-05-03T16:35:27.219 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:26 smithi134 ceph-mon[31708]: Updating smithi134:/etc/ceph/ceph.conf 2024-05-03T16:35:27.219 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:26 smithi134 ceph-mon[31708]: Updating smithi146:/etc/ceph/ceph.conf 2024-05-03T16:35:27.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.215+0000 7f0dd9e00700 1 -- 172.21.15.81:0/371013453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dd41a8000 con 0x7f0dd41a4d10 2024-05-03T16:35:27.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.216+0000 7f0dd9e00700 1 -- 172.21.15.81:0/371013453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dd4064b00 con 0x7f0dd41a4d10 2024-05-03T16:35:27.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.216+0000 7f0dd8a00700 1 -- 172.21.15.81:0/371013453 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f0dcc01c070 con 0x7f0dd41a4d10 2024-05-03T16:35:27.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.217+0000 7f0dd8a00700 1 --2- 172.21.15.81:0/371013453 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0db803e9a0 0x7f0db8040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:27.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.217+0000 7f0dd8a00700 1 -- 172.21.15.81:0/371013453 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0dcc051ed0 con 0x7f0dd41a4d10 2024-05-03T16:35:27.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.217+0000 7f0dd2a00700 1 --2- 172.21.15.81:0/371013453 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0db803e9a0 0x7f0db8040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:35:27.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.218+0000 7f0dd2a00700 1 --2- 172.21.15.81:0/371013453 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0db803e9a0 0x7f0db8040e60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4006010 tx=0x7f0dc401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:35:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.223+0000 7f0dd8a00700 1 -- 172.21.15.81:0/371013453 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0dcc013d90 con 0x7f0dd41a4d10 2024-05-03T16:35:27.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.467+0000 7f0dd9e00700 1 -- 172.21.15.81:0/371013453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f0dd41a8330 con 0x7f0dd41a4d10 2024-05-03T16:35:27.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.468+0000 7f0dd8a00700 1 -- 172.21.15.81:0/371013453 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f0dcc0145f0 con 0x7f0dd41a4d10 2024-05-03T16:35:27.471 INFO:teuthology.orchestra.run.smithi081.stdout:# minimal ceph.conf for 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:35:27.471 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-05-03T16:35:27.471 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:35:27.471 INFO:teuthology.orchestra.run.smithi081.stdout: mon_host = [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] 2024-05-03T16:35:27.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.470+0000 7f0dd9e00700 1 -- 172.21.15.81:0/371013453 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0db803e9a0 msgr2=0x7f0db8040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:27.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.470+0000 7f0dd9e00700 1 --2- 172.21.15.81:0/371013453 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0db803e9a0 0x7f0db8040e60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4006010 tx=0x7f0dc401a040 comp rx=0 tx=0).stop 2024-05-03T16:35:27.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.470+0000 7f0dd9e00700 1 -- 172.21.15.81:0/371013453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd41a4d10 msgr2=0x7f0dd41a7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:27.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.470+0000 7f0dd9e00700 1 --2- 172.21.15.81:0/371013453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd41a4d10 0x7f0dd41a7100 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00ba50 tx=0x7f0dcc00be10 comp rx=0 tx=0).stop 2024-05-03T16:35:27.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.470+0000 7f0dd9e00700 1 -- 172.21.15.81:0/371013453 shutdown_connections 2024-05-03T16:35:27.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.471+0000 7f0dd9e00700 1 --2- 172.21.15.81:0/371013453 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0db803e9a0 0x7f0db8040e60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:27.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.471+0000 7f0dd9e00700 1 --2- 172.21.15.81:0/371013453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd41a4d10 0x7f0dd41a7100 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:27.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.471+0000 7f0dd9e00700 1 --2- 172.21.15.81:0/371013453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dd4103110 0x7f0dd40757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:27.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.471+0000 7f0dd9e00700 1 --2- 172.21.15.81:0/371013453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dd4075ce0 0x7f0dd4076160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:27.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.471+0000 7f0dd9e00700 1 -- 172.21.15.81:0/371013453 >> 172.21.15.81:0/371013453 conn(0x7f0dd40fe9e0 msgr2=0x7f0dd4104ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:35:27.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.471+0000 7f0dd9e00700 1 -- 172.21.15.81:0/371013453 shutdown_connections 2024-05-03T16:35:27.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:27.471+0000 7f0dd9e00700 1 -- 172.21.15.81:0/371013453 wait complete. 2024-05-03T16:35:27.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:27 smithi081 ceph-mon[28640]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:27.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:27 smithi081 ceph-mon[28640]: Updating smithi081:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T16:35:27.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:27 smithi081 ceph-mon[28640]: Updating smithi134:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T16:35:27.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:27 smithi081 ceph-mon[28640]: Updating smithi146:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T16:35:27.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:27 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:27.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:27 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:27.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:27 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:27.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:27 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:27.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:27 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:27.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:27 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:27.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:27 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:27.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:27 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/371013453' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:28.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:27 smithi146 ceph-mon[32357]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:28.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:27 smithi146 ceph-mon[32357]: Updating smithi081:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T16:35:28.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:27 smithi146 ceph-mon[32357]: Updating smithi134:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T16:35:28.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:27 smithi146 ceph-mon[32357]: Updating smithi146:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T16:35:28.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:27 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:27 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:27 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:27 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:27 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:27 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:27 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:27 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/371013453' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:28.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:27 smithi134 ceph-mon[31708]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:28.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:27 smithi134 ceph-mon[31708]: Updating smithi081:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T16:35:28.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:27 smithi134 ceph-mon[31708]: Updating smithi134:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T16:35:28.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:27 smithi134 ceph-mon[31708]: Updating smithi146:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T16:35:28.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:27 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:27 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:27 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:27 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:27 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:27 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:27 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:27 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/371013453' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:28.276 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-03T16:35:28.276 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T16:35:28.276 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.conf 2024-05-03T16:35:28.350 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T16:35:28.350 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-03T16:35:28.456 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-03T16:35:28.456 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.conf 2024-05-03T16:35:28.549 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-03T16:35:28.549 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-03T16:35:28.677 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-05-03T16:35:28.677 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.conf 2024-05-03T16:35:28.765 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-05-03T16:35:28.766 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-03T16:35:28.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:28 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.853 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:28 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.853 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:28 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.853 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:28 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.853 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:28 smithi081 ceph-mon[28640]: Reconfiguring mon.a (unknown last config time)... 2024-05-03T16:35:28.853 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:28 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T16:35:28.853 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:28 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T16:35:28.853 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:28 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:28.853 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:28 smithi081 ceph-mon[28640]: Reconfiguring daemon mon.a on smithi081 2024-05-03T16:35:28.893 INFO:tasks.cephadm:Adding mgr.x on smithi081 2024-05-03T16:35:28.893 INFO:tasks.cephadm:Adding mgr.y on smithi134 2024-05-03T16:35:28.893 INFO:tasks.cephadm:Adding mgr.z on smithi146 2024-05-03T16:35:28.893 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch apply mgr '3;smithi081=x;smithi134=y;smithi146=z' 2024-05-03T16:35:28.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:28 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:28 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:28 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:28 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:28.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:28 smithi134 ceph-mon[31708]: Reconfiguring mon.a (unknown last config time)... 2024-05-03T16:35:28.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:28 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T16:35:28.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:28 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T16:35:28.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:28 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:28.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:28 smithi134 ceph-mon[31708]: Reconfiguring daemon mon.a on smithi081 2024-05-03T16:35:29.010 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:28 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:29.010 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:28 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:29.010 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:28 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:29.010 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:28 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:29.010 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:28 smithi146 ceph-mon[32357]: Reconfiguring mon.a (unknown last config time)... 2024-05-03T16:35:29.010 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:28 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T16:35:29.010 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:28 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T16:35:29.010 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:28 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:29.010 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:28 smithi146 ceph-mon[32357]: Reconfiguring daemon mon.a on smithi081 2024-05-03T16:35:29.355 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T16:35:29.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:29 smithi081 ceph-mon[28640]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:29.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:29.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:30.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:29 smithi146 ceph-mon[32357]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:30.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:30.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:30.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:29 smithi134 ceph-mon[31708]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:30.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:30 smithi146 ceph-mon[32357]: Reconfiguring mon.b (monmap changed)... 2024-05-03T16:35:30.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:30 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T16:35:30.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:30 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T16:35:30.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:30 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:30.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:30 smithi146 ceph-mon[32357]: Reconfiguring daemon mon.b on smithi134 2024-05-03T16:35:30.934 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:30 smithi134 ceph-mon[31708]: Reconfiguring mon.b (monmap changed)... 2024-05-03T16:35:30.935 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:30 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T16:35:30.935 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:30 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T16:35:30.935 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:30 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:30.935 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:30 smithi134 ceph-mon[31708]: Reconfiguring daemon mon.b on smithi134 2024-05-03T16:35:31.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:30 smithi081 ceph-mon[28640]: Reconfiguring mon.b (monmap changed)... 2024-05-03T16:35:31.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:30 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T16:35:31.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:30 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T16:35:31.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:30 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:31.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:30 smithi081 ceph-mon[28640]: Reconfiguring daemon mon.b on smithi134 2024-05-03T16:35:31.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.365+0000 7fd35a800700 1 -- 172.21.15.146:0/2764423726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd354103040 msgr2=0x7fd354103460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:31.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.365+0000 7fd35a800700 1 --2- 172.21.15.146:0/2764423726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd354103040 0x7fd354103460 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd344009910 tx=0x7fd344009c20 comp rx=0 tx=0).stop 2024-05-03T16:35:31.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.365+0000 7fd35a800700 1 -- 172.21.15.146:0/2764423726 shutdown_connections 2024-05-03T16:35:31.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.365+0000 7fd35a800700 1 --2- 172.21.15.146:0/2764423726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd354103040 0x7fd354103460 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:31.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.365+0000 7fd35a800700 1 -- 172.21.15.146:0/2764423726 >> 172.21.15.146:0/2764423726 conn(0x7fd3540fe5e0 msgr2=0x7fd354100a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:35:31.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.366+0000 7fd35a800700 1 -- 172.21.15.146:0/2764423726 shutdown_connections 2024-05-03T16:35:31.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.366+0000 7fd35a800700 1 -- 172.21.15.146:0/2764423726 wait complete. 2024-05-03T16:35:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.367+0000 7fd35a800700 1 Processor -- start 2024-05-03T16:35:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.367+0000 7fd35a800700 1 -- start start 2024-05-03T16:35:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.367+0000 7fd35a800700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd354103040 0x7fd354198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.367+0000 7fd35a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd354198bb0 0x7fd35419dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.368+0000 7fd35a800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd354199030 0x7fd3541a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.368+0000 7fd35a800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd354108e30 con 0x7fd354198bb0 2024-05-03T16:35:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.368+0000 7fd35a800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd354108cb0 con 0x7fd354199030 2024-05-03T16:35:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.368+0000 7fd35a800700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd354108fb0 con 0x7fd354103040 2024-05-03T16:35:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.368+0000 7fd353400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd354103040 0x7fd354198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:35:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.368+0000 7fd353400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd354103040 0x7fd354198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43870/0 (socket says 172.21.15.146:43870) 2024-05-03T16:35:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.368+0000 7fd353400700 1 -- 172.21.15.146:0/1838601864 learned_addr learned my addr 172.21.15.146:0/1838601864 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-05-03T16:35:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.368+0000 7fd352a00700 1 --2- 172.21.15.146:0/1838601864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd354198bb0 0x7fd35419dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:35:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.368+0000 7fd353e00700 1 --2- 172.21.15.146:0/1838601864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd354199030 0x7fd3541a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:35:31.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.368+0000 7fd353400700 1 -- 172.21.15.146:0/1838601864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd354199030 msgr2=0x7fd3541a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:31.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.368+0000 7fd353400700 1 --2- 172.21.15.146:0/1838601864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd354199030 0x7fd3541a01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:31.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.368+0000 7fd353400700 1 -- 172.21.15.146:0/1838601864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd354198bb0 msgr2=0x7fd35419dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:31.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.368+0000 7fd353400700 1 --2- 172.21.15.146:0/1838601864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd354198bb0 0x7fd35419dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:31.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.368+0000 7fd353400700 1 -- 172.21.15.146:0/1838601864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3541a0a80 con 0x7fd354103040 2024-05-03T16:35:31.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.368+0000 7fd352a00700 1 --2- 172.21.15.146:0/1838601864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd354198bb0 0x7fd35419dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:35:31.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.369+0000 7fd353400700 1 --2- 172.21.15.146:0/1838601864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd354103040 0x7fd354198670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd344005920 tx=0x7fd344005030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:35:31.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.369+0000 7fd34be00700 1 -- 172.21.15.146:0/1838601864 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd344027070 con 0x7fd354103040 2024-05-03T16:35:31.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.369+0000 7fd34be00700 1 -- 172.21.15.146:0/1838601864 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd34400bdf0 con 0x7fd354103040 2024-05-03T16:35:31.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.369+0000 7fd34be00700 1 -- 172.21.15.146:0/1838601864 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd344022e40 con 0x7fd354103040 2024-05-03T16:35:31.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.369+0000 7fd35a800700 1 -- 172.21.15.146:0/1838601864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3541a0d10 con 0x7fd354103040 2024-05-03T16:35:31.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.369+0000 7fd35a800700 1 -- 172.21.15.146:0/1838601864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3541a1210 con 0x7fd354103040 2024-05-03T16:35:31.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.371+0000 7fd35a800700 1 -- 172.21.15.146:0/1838601864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd354064b00 con 0x7fd354103040 2024-05-03T16:35:31.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.371+0000 7fd34be00700 1 -- 172.21.15.146:0/1838601864 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fd34402a070 con 0x7fd354103040 2024-05-03T16:35:31.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.371+0000 7fd34be00700 1 --2- 172.21.15.146:0/1838601864 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd33803e9a0 0x7fd338040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:31.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.372+0000 7fd34be00700 1 -- 172.21.15.146:0/1838601864 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd344053a50 con 0x7fd354103040 2024-05-03T16:35:31.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.372+0000 7fd352a00700 1 --2- 172.21.15.146:0/1838601864 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd33803e9a0 0x7fd338040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:35:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.373+0000 7fd352a00700 1 --2- 172.21.15.146:0/1838601864 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd33803e9a0 0x7fd338040e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009910 tx=0x7fd33c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:35:31.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.379+0000 7fd34be00700 1 -- 172.21.15.146:0/1838601864 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd344013070 con 0x7fd354103040 2024-05-03T16:35:31.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.628+0000 7fd35a800700 1 -- 172.21.15.146:0/1838601864 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi081=x;smithi134=y;smithi146=z", "target": ["mon-mgr", ""]}) -- 0x7fd3540638e0 con 0x7fd33803e9a0 2024-05-03T16:35:31.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.643+0000 7fd34be00700 1 -- 172.21.15.146:0/1838601864 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fd3540638e0 con 0x7fd33803e9a0 2024-05-03T16:35:31.645 INFO:teuthology.orchestra.run.smithi146.stdout:Scheduled mgr update... 2024-05-03T16:35:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.646+0000 7fd35a800700 1 -- 172.21.15.146:0/1838601864 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd33803e9a0 msgr2=0x7fd338040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.646+0000 7fd35a800700 1 --2- 172.21.15.146:0/1838601864 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd33803e9a0 0x7fd338040e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009910 tx=0x7fd33c008040 comp rx=0 tx=0).stop 2024-05-03T16:35:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.646+0000 7fd35a800700 1 -- 172.21.15.146:0/1838601864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd354103040 msgr2=0x7fd354198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.646+0000 7fd35a800700 1 --2- 172.21.15.146:0/1838601864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd354103040 0x7fd354198670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd344005920 tx=0x7fd344005030 comp rx=0 tx=0).stop 2024-05-03T16:35:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.646+0000 7fd35a800700 1 -- 172.21.15.146:0/1838601864 shutdown_connections 2024-05-03T16:35:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.646+0000 7fd35a800700 1 --2- 172.21.15.146:0/1838601864 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd33803e9a0 0x7fd338040e60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.646+0000 7fd35a800700 1 --2- 172.21.15.146:0/1838601864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd354103040 0x7fd354198670 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.646+0000 7fd35a800700 1 --2- 172.21.15.146:0/1838601864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd354199030 0x7fd3541a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.646+0000 7fd35a800700 1 --2- 172.21.15.146:0/1838601864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd354198bb0 0x7fd35419dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.646+0000 7fd35a800700 1 -- 172.21.15.146:0/1838601864 >> 172.21.15.146:0/1838601864 conn(0x7fd3540fe5e0 msgr2=0x7fd3540ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:35:31.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.646+0000 7fd35a800700 1 -- 172.21.15.146:0/1838601864 shutdown_connections 2024-05-03T16:35:31.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:35:31.646+0000 7fd35a800700 1 -- 172.21.15.146:0/1838601864 wait complete. 2024-05-03T16:35:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:31 smithi134 ceph-mon[31708]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T16:35:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T16:35:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:31.999 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:31 smithi146 ceph-mon[32357]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:31.999 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:31.999 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:31.999 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:31.999 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T16:35:31.999 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T16:35:31.999 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:32.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:31 smithi081 ceph-mon[28640]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:32.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:32.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:32.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:32.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T16:35:32.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T16:35:32.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:32.363 DEBUG:teuthology.orchestra.run.smithi134:mgr.y> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mgr.y.service 2024-05-03T16:35:32.371 DEBUG:teuthology.orchestra.run.smithi146:mgr.z> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mgr.z.service 2024-05-03T16:35:32.376 INFO:tasks.cephadm:Deploying OSDs... 2024-05-03T16:35:32.376 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T16:35:32.376 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-05-03T16:35:32.435 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-03T16:35:32.435 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-05-03T16:35:32.490 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-03T16:35:32.490 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T16:35:32.490 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-05-03T16:35:32.490 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T16:35:32.490 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T16:35:32.490 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-05-03 16:34:17.242162488 +0000 2024-05-03T16:35:32.490 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-05-03 16:28:11.826211552 +0000 2024-05-03T16:35:32.491 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-05-03 16:28:11.826211552 +0000 2024-05-03T16:35:32.491 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-05-03 16:28:11.826211552 +0000 2024-05-03T16:35:32.491 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-03T16:35:32.570 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-05-03T16:35:32.570 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-05-03T16:35:32.570 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000430714 s, 1.2 MB/s 2024-05-03T16:35:32.574 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-03T16:35:32.632 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-05-03T16:35:32.678 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-03T16:35:32.678 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T16:35:32.678 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-05-03T16:35:32.678 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T16:35:32.678 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T16:35:32.678 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-05-03 16:34:17.311161209 +0000 2024-05-03T16:35:32.678 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-05-03 16:28:12.434200279 +0000 2024-05-03T16:35:32.679 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-05-03 16:28:12.434200279 +0000 2024-05-03T16:35:32.679 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-05-03 16:28:12.434200279 +0000 2024-05-03T16:35:32.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-03T16:35:32.803 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-05-03T16:35:32.803 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-05-03T16:35:32.803 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000475932 s, 1.1 MB/s 2024-05-03T16:35:32.808 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-03T16:35:32.865 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-05-03T16:35:32.916 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-03T16:35:32.916 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T16:35:32.916 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-05-03T16:35:32.916 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T16:35:32.916 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T16:35:32.916 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-05-03 16:34:17.371160096 +0000 2024-05-03T16:35:32.916 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-05-03 16:28:13.004189710 +0000 2024-05-03T16:35:32.916 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-05-03 16:28:13.004189710 +0000 2024-05-03T16:35:32.916 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-05-03 16:28:13.004189710 +0000 2024-05-03T16:35:32.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-03T16:35:32.932 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:32 smithi146 ceph-mon[32357]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi081=x;smithi134=y;smithi146=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:35:32.932 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:32 smithi146 ceph-mon[32357]: Saving service mgr spec with placement smithi081=x;smithi134=y;smithi146=z;count:3 2024-05-03T16:35:32.932 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:32 smithi146 ceph-mon[32357]: Reconfiguring mon.c (monmap changed)... 2024-05-03T16:35:32.932 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:32 smithi146 ceph-mon[32357]: Reconfiguring daemon mon.c on smithi146 2024-05-03T16:35:32.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:32 smithi081 ceph-mon[28640]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi081=x;smithi134=y;smithi146=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:35:32.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:32 smithi081 ceph-mon[28640]: Saving service mgr spec with placement smithi081=x;smithi134=y;smithi146=z;count:3 2024-05-03T16:35:32.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:32 smithi081 ceph-mon[28640]: Reconfiguring mon.c (monmap changed)... 2024-05-03T16:35:32.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:32 smithi081 ceph-mon[28640]: Reconfiguring daemon mon.c on smithi146 2024-05-03T16:35:32.997 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-05-03T16:35:32.997 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-05-03T16:35:32.997 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000365019 s, 1.4 MB/s 2024-05-03T16:35:33.001 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-03T16:35:33.059 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-05-03T16:35:33.107 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-03T16:35:33.107 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T16:35:33.108 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-05-03T16:35:33.108 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T16:35:33.108 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T16:35:33.108 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-05-03 16:34:17.431158983 +0000 2024-05-03T16:35:33.108 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-05-03 16:28:13.593178790 +0000 2024-05-03T16:35:33.108 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-05-03 16:28:13.593178790 +0000 2024-05-03T16:35:33.108 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-05-03 16:28:13.593178790 +0000 2024-05-03T16:35:33.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-03T16:35:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-05-03T16:35:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-05-03T16:35:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000371716 s, 1.4 MB/s 2024-05-03T16:35:33.186 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-03T16:35:33.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:32 smithi134 ceph-mon[31708]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi081=x;smithi134=y;smithi146=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:35:33.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:32 smithi134 ceph-mon[31708]: Saving service mgr spec with placement smithi081=x;smithi134=y;smithi146=z;count:3 2024-05-03T16:35:33.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:32 smithi134 ceph-mon[31708]: Reconfiguring mon.c (monmap changed)... 2024-05-03T16:35:33.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:32 smithi134 ceph-mon[31708]: Reconfiguring daemon mon.c on smithi146 2024-05-03T16:35:33.242 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-03T16:35:33.242 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-05-03T16:35:33.301 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-03T16:35:33.302 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-05-03T16:35:33.356 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-03T16:35:33.356 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T16:35:33.356 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-05-03T16:35:33.357 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T16:35:33.357 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T16:35:33.357 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-05-03 16:35:16.706421514 +0000 2024-05-03T16:35:33.357 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-05-03 16:28:11.066340215 +0000 2024-05-03T16:35:33.357 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-05-03 16:28:11.066340215 +0000 2024-05-03T16:35:33.357 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-05-03 16:28:11.066340215 +0000 2024-05-03T16:35:33.357 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-03T16:35:33.436 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-05-03T16:35:33.436 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-05-03T16:35:33.436 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000379146 s, 1.4 MB/s 2024-05-03T16:35:33.439 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-03T16:35:33.492 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-05-03T16:35:33.540 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-03T16:35:33.540 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T16:35:33.540 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-05-03T16:35:33.541 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T16:35:33.541 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T16:35:33.541 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-05-03 16:35:16.707421491 +0000 2024-05-03T16:35:33.541 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-05-03 16:28:11.673326235 +0000 2024-05-03T16:35:33.541 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-05-03 16:28:11.673326235 +0000 2024-05-03T16:35:33.542 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-05-03 16:28:11.673326235 +0000 2024-05-03T16:35:33.542 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-03T16:35:33.620 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-05-03T16:35:33.620 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-05-03T16:35:33.620 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.00039291 s, 1.3 MB/s 2024-05-03T16:35:33.624 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-03T16:35:33.677 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-05-03T16:35:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-03T16:35:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T16:35:33.727 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-05-03T16:35:33.727 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T16:35:33.727 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T16:35:33.727 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-05-03 16:35:16.707421491 +0000 2024-05-03T16:35:33.727 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-05-03 16:28:12.264312623 +0000 2024-05-03T16:35:33.727 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-05-03 16:28:12.264312623 +0000 2024-05-03T16:35:33.727 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-05-03 16:28:12.264312623 +0000 2024-05-03T16:35:33.728 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-03T16:35:33.802 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-05-03T16:35:33.802 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-05-03T16:35:33.803 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000461197 s, 1.1 MB/s 2024-05-03T16:35:33.807 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-03T16:35:33.861 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-05-03T16:35:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-03T16:35:33.907 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T16:35:33.908 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-05-03T16:35:33.908 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T16:35:33.908 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T16:35:33.908 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-05-03 16:35:16.708421468 +0000 2024-05-03T16:35:33.908 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-05-03 16:28:12.861298873 +0000 2024-05-03T16:35:33.908 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-05-03 16:28:12.861298873 +0000 2024-05-03T16:35:33.908 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-05-03 16:28:12.861298873 +0000 2024-05-03T16:35:33.908 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-03T16:35:33.986 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-05-03T16:35:33.986 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-05-03T16:35:33.986 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000360117 s, 1.4 MB/s 2024-05-03T16:35:33.990 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-03T16:35:34.046 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-05-03T16:35:34.047 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/scratch_devs of=/dev/stdout 2024-05-03T16:35:34.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:33 smithi146 ceph-mon[32357]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:34.095 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-03T16:35:34.095 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 2024-05-03T16:35:34.179 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-03T16:35:34.180 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T16:35:34.180 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-05-03T16:35:34.180 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T16:35:34.180 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T16:35:34.180 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-05-03 16:35:05.442722608 +0000 2024-05-03T16:35:34.180 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-05-03 16:28:16.416002946 +0000 2024-05-03T16:35:34.181 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-05-03 16:28:16.416002946 +0000 2024-05-03T16:35:34.181 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-05-03 16:28:16.416002946 +0000 2024-05-03T16:35:34.181 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-03T16:35:34.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:33 smithi134 ceph-mon[31708]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:34.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:33 smithi081 ceph-mon[28640]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:34.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-05-03T16:35:34.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-05-03T16:35:34.291 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.00032483 s, 1.6 MB/s 2024-05-03T16:35:34.294 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-03T16:35:34.337 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 2024-05-03T16:35:34.430 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-03T16:35:34.430 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T16:35:34.430 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-05-03T16:35:34.430 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T16:35:34.430 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T16:35:34.430 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-05-03 16:35:05.443722593 +0000 2024-05-03T16:35:34.430 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-05-03 16:28:17.028993463 +0000 2024-05-03T16:35:34.430 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-05-03 16:28:17.028993463 +0000 2024-05-03T16:35:34.431 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-05-03 16:28:17.028993463 +0000 2024-05-03T16:35:34.431 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-03T16:35:34.499 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-05-03T16:35:34.499 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-05-03T16:35:34.500 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000300277 s, 1.7 MB/s 2024-05-03T16:35:34.503 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-03T16:35:34.548 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 2024-05-03T16:35:34.630 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-03T16:35:34.630 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T16:35:34.630 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-05-03T16:35:34.630 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T16:35:34.630 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T16:35:34.631 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-05-03 16:35:05.444722578 +0000 2024-05-03T16:35:34.631 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-05-03 16:28:17.629984165 +0000 2024-05-03T16:35:34.631 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-05-03 16:28:17.630984150 +0000 2024-05-03T16:35:34.631 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-05-03 16:28:17.629984165 +0000 2024-05-03T16:35:34.631 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-03T16:35:34.732 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-05-03T16:35:34.733 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-05-03T16:35:34.733 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000335619 s, 1.5 MB/s 2024-05-03T16:35:34.736 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-03T16:35:34.776 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 2024-05-03T16:35:34.863 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-03T16:35:34.863 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T16:35:34.863 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-05-03T16:35:34.863 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T16:35:34.863 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T16:35:34.863 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-05-03 16:35:05.445722563 +0000 2024-05-03T16:35:34.864 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-05-03 16:28:18.252974527 +0000 2024-05-03T16:35:34.864 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-05-03 16:28:18.252974527 +0000 2024-05-03T16:35:34.864 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-05-03 16:28:18.252974527 +0000 2024-05-03T16:35:34.864 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-03T16:35:34.978 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:34 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:34.978 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:34 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:34.978 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:34 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:35:34.978 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:34 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:34.978 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:34 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:35:34.979 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:34 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:34.979 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:34 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T16:35:34.979 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:34 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-03T16:35:34.979 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:34 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T16:35:34.979 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:34 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:34.979 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:34 smithi146 ceph-mon[32357]: Deploying daemon mgr.z on smithi146 2024-05-03T16:35:34.987 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-05-03T16:35:34.988 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-05-03T16:35:34.988 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000414529 s, 1.2 MB/s 2024-05-03T16:35:34.992 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-03T16:35:35.045 INFO:tasks.cephadm:Deploying osd.0 on smithi081 with /dev/vg_nvme/lv_4... 2024-05-03T16:35:35.045 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-03T16:35:35.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:34 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:35.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:34 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:35.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:34 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:35:35.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:34 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:35.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:34 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:35:35.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:34 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:35.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:34 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T16:35:35.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:34 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-03T16:35:35.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:34 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T16:35:35.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:34 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:35.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:34 smithi081 ceph-mon[28640]: Deploying daemon mgr.z on smithi146 2024-05-03T16:35:35.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:34 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:35.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:34 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:35.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:34 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:35:35.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:34 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:35.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:34 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:35:35.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:34 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:35.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:34 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T16:35:35.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:34 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-03T16:35:35.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:34 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T16:35:35.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:34 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:35.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:34 smithi134 ceph-mon[31708]: Deploying daemon mgr.z on smithi146 2024-05-03T16:35:35.496 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:35:35.894 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:35 smithi081 ceph-mon[28640]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:36.035 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:35 smithi146 ceph-mon[32357]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:36.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:35 smithi134 ceph-mon[31708]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:37.062 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:36 smithi146 systemd[1]: Starting Ceph mgr.z for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T16:35:37.474 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:37 smithi146 podman[34078]: 2024-05-03 16:35:37.058664994 +0000 UTC m=+0.034919508 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T16:35:37.475 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:37 smithi146 podman[34078]: 2024-05-03 16:35:37.193871493 +0000 UTC m=+0.170126044 container create 17ef6eaac8aa60e13e9c87dd5ed851eb6d885727256683ba58c511968421f6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430) 2024-05-03T16:35:37.475 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:37 smithi146 podman[34078]: 2024-05-03 16:35:37.472479647 +0000 UTC m=+0.448734242 container init 17ef6eaac8aa60e13e9c87dd5ed851eb6d885727256683ba58c511968421f6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-03T16:35:37.725 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:37 smithi146 podman[34078]: 2024-05-03 16:35:37.482391077 +0000 UTC m=+0.458645597 container start 17ef6eaac8aa60e13e9c87dd5ed851eb6d885727256683ba58c511968421f6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=) 2024-05-03T16:35:37.725 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:37 smithi146 ceph-mgr[34097]: -- 172.21.15.146:0/1341461059 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561031f405a0 con 0x561031f14800 2024-05-03T16:35:37.725 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:37 smithi146 bash[34078]: 17ef6eaac8aa60e13e9c87dd5ed851eb6d885727256683ba58c511968421f6c5 2024-05-03T16:35:37.725 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:37 smithi146 systemd[1]: Started Ceph mgr.z for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:35:37.980 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:37 smithi146 ceph-mon[32357]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:37.980 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:37.980 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:37.980 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:37.980 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T16:35:37.980 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-03T16:35:37.980 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T16:35:37.980 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:37.980 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:37 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:37.722+0000 7f28cc0fe200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-03T16:35:37.980 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:37 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:37.977+0000 7f28cc0fe200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-03T16:35:38.169 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:37 smithi081 ceph-mon[28640]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:38.169 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:38.169 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:38.169 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:38.169 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T16:35:38.169 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-03T16:35:38.169 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T16:35:38.169 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:38.169 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-03T16:35:38.170 INFO:teuthology.orchestra.run.smithi081.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-03T16:35:38.170 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10+0 records in 2024-05-03T16:35:38.170 INFO:teuthology.orchestra.run.smithi081.stderr:10+0 records out 2024-05-03T16:35:38.170 INFO:teuthology.orchestra.run.smithi081.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0373112 s, 281 MB/s 2024-05-03T16:35:38.170 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping successful for: 2024-05-03T16:35:38.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:37 smithi134 ceph-mon[31708]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:38.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:38.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:38.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:38.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T16:35:38.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-03T16:35:38.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T16:35:38.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:38.312 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:38 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:38.107+0000 7f28cc0fe200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-03T16:35:38.812 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:38 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:38.502+0000 7f28cc0fe200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-03T16:35:38.813 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:38 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:38.611+0000 7f28cc0fe200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-03T16:35:38.975 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_4 2024-05-03T16:35:39.005 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:38 smithi134 ceph-mon[31708]: Deploying daemon mgr.y on smithi134 2024-05-03T16:35:39.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:38 smithi081 ceph-mon[28640]: Deploying daemon mgr.y on smithi134 2024-05-03T16:35:39.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:38 smithi146 ceph-mon[32357]: Deploying daemon mgr.y on smithi134 2024-05-03T16:35:39.398 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:35:39.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:39 smithi134 ceph-mon[31708]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:40.179 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:39 smithi146 ceph-mon[32357]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:40.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:39 smithi081 ceph-mon[28640]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:40.562 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:40 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:40.176+0000 7f28cc0fe200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-03T16:35:40.562 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:40 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:40.399+0000 7f28cc0fe200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-03T16:35:40.840 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:40 smithi134 systemd[1]: Starting Ceph mgr.y for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T16:35:41.004 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:40 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:40.623+0000 7f28cc0fe200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-03T16:35:41.004 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:41 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:41.001+0000 7f28cc0fe200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-03T16:35:41.134 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:40 smithi134 podman[33079]: 2024-05-03 16:35:40.744378909 +0000 UTC m=+0.034325248 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T16:35:41.134 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:40 smithi134 podman[33079]: 2024-05-03 16:35:40.840878964 +0000 UTC m=+0.130825330 container create 1e2f457195e2e8c2321da6398bba81a25bd6638dbe7f14fd11689399ba995b0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T16:35:41.134 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:41 smithi134 podman[33079]: 2024-05-03 16:35:41.069321438 +0000 UTC m=+0.359267814 container init 1e2f457195e2e8c2321da6398bba81a25bd6638dbe7f14fd11689399ba995b0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T16:35:41.134 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:41 smithi134 podman[33079]: 2024-05-03 16:35:41.081780378 +0000 UTC m=+0.371726726 container start 1e2f457195e2e8c2321da6398bba81a25bd6638dbe7f14fd11689399ba995b0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_CLEAN=True) 2024-05-03T16:35:41.312 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:41 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:41.123+0000 7f28cc0fe200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-03T16:35:41.466 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:41 smithi134 ceph-mgr[33098]: -- 172.21.15.134:0/2718158361 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557892fde5a0 con 0x557892fb3000 2024-05-03T16:35:41.466 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:41 smithi134 bash[33079]: 1e2f457195e2e8c2321da6398bba81a25bd6638dbe7f14fd11689399ba995b0c 2024-05-03T16:35:41.467 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:41 smithi134 systemd[1]: Started Ceph mgr.y for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:35:41.467 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:41 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:41.333+0000 7f6501333200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-03T16:35:41.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.468+0000 7f8748400700 1 -- 172.21.15.81:0/1466862892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8740104700 msgr2=0x7f8740104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:41.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.468+0000 7f8748400700 1 --2- 172.21.15.81:0/1466862892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8740104700 0x7f8740104b60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f872c0099c0 tx=0x7f872c009cd0 comp rx=0 tx=0).stop 2024-05-03T16:35:41.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.468+0000 7f8748400700 1 -- 172.21.15.81:0/1466862892 shutdown_connections 2024-05-03T16:35:41.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.468+0000 7f8748400700 1 --2- 172.21.15.81:0/1466862892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87401050a0 0x7f874010b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:41.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.468+0000 7f8748400700 1 --2- 172.21.15.81:0/1466862892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8740103500 0x7f8740103920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:41.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.468+0000 7f8748400700 1 --2- 172.21.15.81:0/1466862892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8740104700 0x7f8740104b60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:41.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.469+0000 7f8748400700 1 -- 172.21.15.81:0/1466862892 >> 172.21.15.81:0/1466862892 conn(0x7f87400feaa0 msgr2=0x7f8740100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:35:41.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.469+0000 7f8748400700 1 -- 172.21.15.81:0/1466862892 shutdown_connections 2024-05-03T16:35:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.469+0000 7f8748400700 1 -- 172.21.15.81:0/1466862892 wait complete. 2024-05-03T16:35:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.470+0000 7f8748400700 1 Processor -- start 2024-05-03T16:35:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.470+0000 7f8748400700 1 -- start start 2024-05-03T16:35:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.470+0000 7f8748400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8740103500 0x7f87400771f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.470+0000 7f8748400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8740104700 0x7f8740075890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.470+0000 7f8748400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87401050a0 0x7f8740075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.470+0000 7f8748400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f874010ee50 con 0x7f8740104700 2024-05-03T16:35:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.470+0000 7f8748400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f874010ecd0 con 0x7f87401050a0 2024-05-03T16:35:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.470+0000 7f8748400700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f874010efd0 con 0x7f8740103500 2024-05-03T16:35:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.471+0000 7f8745000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8740104700 0x7f8740075890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:35:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.471+0000 7f8745000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8740104700 0x7f8740075890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44260/0 (socket says 172.21.15.81:44260) 2024-05-03T16:35:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.471+0000 7f8745000700 1 -- 172.21.15.81:0/1271237947 learned_addr learned my addr 172.21.15.81:0/1271237947 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:35:41.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.471+0000 7f8745a00700 1 --2- 172.21.15.81:0/1271237947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8740103500 0x7f87400771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:35:41.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.471+0000 7f8745000700 1 -- 172.21.15.81:0/1271237947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8740103500 msgr2=0x7f87400771f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:41.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.471+0000 7f8745000700 1 --2- 172.21.15.81:0/1271237947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8740103500 0x7f87400771f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:41.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.471+0000 7f8745000700 1 -- 172.21.15.81:0/1271237947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87401050a0 msgr2=0x7f8740075dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:35:41.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.471+0000 7f8745000700 1 --2- 172.21.15.81:0/1271237947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87401050a0 0x7f8740075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:35:41.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.471+0000 7f8745000700 1 -- 172.21.15.81:0/1271237947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87400766a0 con 0x7f8740104700 2024-05-03T16:35:41.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.471+0000 7f8745000700 1 --2- 172.21.15.81:0/1271237947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8740104700 0x7f8740075890 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f872c00b580 tx=0x7f872c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:35:41.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.471+0000 7f873e000700 1 -- 172.21.15.81:0/1271237947 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c009e60 con 0x7f8740104700 2024-05-03T16:35:41.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.472+0000 7f873e000700 1 -- 172.21.15.81:0/1271237947 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f872c00f460 con 0x7f8740104700 2024-05-03T16:35:41.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.472+0000 7f8748400700 1 -- 172.21.15.81:0/1271237947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87401a3680 con 0x7f8740104700 2024-05-03T16:35:41.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.472+0000 7f873e000700 1 -- 172.21.15.81:0/1271237947 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c017650 con 0x7f8740104700 2024-05-03T16:35:41.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.472+0000 7f8748400700 1 -- 172.21.15.81:0/1271237947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87401a3b30 con 0x7f8740104700 2024-05-03T16:35:41.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.473+0000 7f8748400700 1 -- 172.21.15.81:0/1271237947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f874006a190 con 0x7f8740104700 2024-05-03T16:35:41.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.473+0000 7f873e000700 1 -- 172.21.15.81:0/1271237947 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f872c00f610 con 0x7f8740104700 2024-05-03T16:35:41.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.473+0000 7f873e000700 1 --2- 172.21.15.81:0/1271237947 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f872803e750 0x7f8728040c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:35:41.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.474+0000 7f873e000700 1 -- 172.21.15.81:0/1271237947 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f872c053920 con 0x7f8740104700 2024-05-03T16:35:41.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.474+0000 7f8745a00700 1 --2- 172.21.15.81:0/1271237947 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f872803e750 0x7f8728040c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:35:41.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.474+0000 7f8745a00700 1 --2- 172.21.15.81:0/1271237947 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f872803e750 0x7f8728040c10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8740104560 tx=0x7f8734009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:35:41.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.480+0000 7f873e000700 1 -- 172.21.15.81:0/1271237947 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f872c013070 con 0x7f8740104700 2024-05-03T16:35:41.637 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:41 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:41.382+0000 7f28cc0fe200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-03T16:35:41.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:41.725+0000 7f8748400700 1 -- 172.21.15.81:0/1271237947 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f87400639a0 con 0x7f872803e750 2024-05-03T16:35:41.907 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:41 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:41.635+0000 7f28cc0fe200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-03T16:35:41.908 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:41 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:41.584+0000 7f6501333200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-03T16:35:41.908 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:41 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:41.716+0000 7f6501333200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-03T16:35:41.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:41 smithi081 ceph-mon[28640]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:41.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:41.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:41.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:41.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:41.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:35:41.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:35:41.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:35:41.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:42.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:41 smithi134 ceph-mon[31708]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:42.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:42.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:42.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:42.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:42.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:35:42.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:35:42.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:35:42.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:42.217 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:42 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:42.131+0000 7f6501333200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-03T16:35:42.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:41 smithi146 ceph-mon[32357]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:42.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:35:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:35:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:35:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:42.716 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:42 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:42.247+0000 7f6501333200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-03T16:35:42.768 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:42 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:42.462+0000 7f28cc0fe200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-03T16:35:43.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:42 smithi146 ceph-mon[32357]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:35:43.062 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:42 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:42.766+0000 7f28cc0fe200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-03T16:35:43.171 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:42 smithi081 ceph-mon[28640]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:35:43.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:42 smithi134 ceph-mon[31708]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:35:43.813 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:43 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:43.336+0000 7f28cc0fe200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-03T16:35:43.813 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:43 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:43.489+0000 7f28cc0fe200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-03T16:35:44.084 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:43 smithi081 ceph-mon[28640]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:44.084 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:43 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:44.084 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:43 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:44.084 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:43 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:44.084 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:43 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:44.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:43 smithi134 ceph-mon[31708]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:44.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:43 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:44.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:43 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:44.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:43 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:44.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:43 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:44.217 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:43 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:43.890+0000 7f6501333200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-03T16:35:44.217 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:44 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:44.126+0000 7f6501333200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-03T16:35:44.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:43 smithi146 ceph-mon[32357]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:44.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:43 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:44.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:43 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:44.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:43 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:44.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:43 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:44.313 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:43 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:43.955+0000 7f28cc0fe200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-03T16:35:44.716 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:44 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:44.346+0000 7f6501333200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-03T16:35:44.812 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:44 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:44.409+0000 7f28cc0fe200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-03T16:35:44.813 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:44 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:44.533+0000 7f28cc0fe200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-03T16:35:45.112 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:44 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:44.730+0000 7f6501333200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-03T16:35:45.112 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:44 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:44.855+0000 7f6501333200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-03T16:35:45.186 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:44 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:44.850+0000 7f28cc0fe200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-03T16:35:45.187 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:45 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:45.031+0000 7f28cc0fe200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-03T16:35:45.366 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:45 smithi134 ceph-mon[31708]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:45.366 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:45 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:45.366 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:45 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:45.366 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:45 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:35:45.366 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:45 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:45.366 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:45 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T16:35:45.366 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:45 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T16:35:45.366 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:45 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:45.367 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:45 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:45.109+0000 7f6501333200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-03T16:35:45.367 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:45 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:45.363+0000 7f6501333200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-03T16:35:45.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:45 smithi081 ceph-mon[28640]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:45.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:45 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:45.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:45 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:45.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:45 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:35:45.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:45 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:45.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:45 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T16:35:45.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:45 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T16:35:45.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:45 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:45.558 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:45 smithi146 ceph-mon[32357]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:45.558 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:45 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:45.558 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:45 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:45.558 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:45 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:35:45.558 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:45 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:45.558 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:45 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T16:35:45.558 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:45 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T16:35:45.558 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:45 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:45.559 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:45 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:45.404+0000 7f28cc0fe200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-03T16:35:45.812 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:45 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:45.555+0000 7f28cc0fe200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-03T16:35:45.813 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:45 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:45.680+0000 7f28cc0fe200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-03T16:35:46.447 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:46 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:46.161+0000 7f6501333200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-03T16:35:46.447 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:46 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:46.444+0000 7f6501333200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-03T16:35:46.447 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:46 smithi134 ceph-mon[31708]: Reconfiguring mgr.x (unknown last config time)... 2024-05-03T16:35:46.448 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:46 smithi134 ceph-mon[31708]: Reconfiguring daemon mgr.x on smithi081 2024-05-03T16:35:46.448 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:46 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2437600971' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "957b05dc-dfb9-4561-8800-b7ec0aba679d"}]: dispatch 2024-05-03T16:35:46.448 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:46 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2437600971' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "957b05dc-dfb9-4561-8800-b7ec0aba679d"}]': finished 2024-05-03T16:35:46.448 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:46 smithi134 ceph-mon[31708]: osdmap e5: 1 total, 0 up, 1 in 2024-05-03T16:35:46.448 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:46 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T16:35:46.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:46 smithi081 ceph-mon[28640]: Reconfiguring mgr.x (unknown last config time)... 2024-05-03T16:35:46.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:46 smithi081 ceph-mon[28640]: Reconfiguring daemon mgr.x on smithi081 2024-05-03T16:35:46.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:46 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2437600971' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "957b05dc-dfb9-4561-8800-b7ec0aba679d"}]: dispatch 2024-05-03T16:35:46.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:46 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2437600971' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "957b05dc-dfb9-4561-8800-b7ec0aba679d"}]': finished 2024-05-03T16:35:46.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:46 smithi081 ceph-mon[28640]: osdmap e5: 1 total, 0 up, 1 in 2024-05-03T16:35:46.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:46 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T16:35:46.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:46 smithi146 ceph-mon[32357]: Reconfiguring mgr.x (unknown last config time)... 2024-05-03T16:35:46.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:46 smithi146 ceph-mon[32357]: Reconfiguring daemon mgr.x on smithi081 2024-05-03T16:35:46.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:46 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2437600971' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "957b05dc-dfb9-4561-8800-b7ec0aba679d"}]: dispatch 2024-05-03T16:35:46.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:46 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2437600971' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "957b05dc-dfb9-4561-8800-b7ec0aba679d"}]': finished 2024-05-03T16:35:46.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:46 smithi146 ceph-mon[32357]: osdmap e5: 1 total, 0 up, 1 in 2024-05-03T16:35:46.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:46 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T16:35:46.563 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:46 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:46.430+0000 7f28cc0fe200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-03T16:35:46.850 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 16:35:46 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z[34093]: 2024-05-03T16:35:46.719+0000 7f28cc0fe200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-03T16:35:47.466 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:46 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:46.997+0000 7f6501333200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-03T16:35:47.467 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:47 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:47.123+0000 7f6501333200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-03T16:35:47.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:47 smithi134 ceph-mon[31708]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:47.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:47 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/1940226011' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:35:47.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:47 smithi134 ceph-mon[31708]: Standby manager daemon z started 2024-05-03T16:35:47.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:47 smithi134 ceph-mon[31708]: from='mgr.? 172.21.15.146:0/3519711386' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-03T16:35:47.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:47 smithi134 ceph-mon[31708]: from='mgr.? 172.21.15.146:0/3519711386' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-03T16:35:47.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:47 smithi134 ceph-mon[31708]: from='mgr.? 172.21.15.146:0/3519711386' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-03T16:35:47.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:47 smithi134 ceph-mon[31708]: from='mgr.? 172.21.15.146:0/3519711386' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-03T16:35:47.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:47 smithi081 ceph-mon[28640]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:47.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:47 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1940226011' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:35:47.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:47 smithi081 ceph-mon[28640]: Standby manager daemon z started 2024-05-03T16:35:47.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:47 smithi081 ceph-mon[28640]: from='mgr.? 172.21.15.146:0/3519711386' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-03T16:35:47.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:47 smithi081 ceph-mon[28640]: from='mgr.? 172.21.15.146:0/3519711386' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-03T16:35:47.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:47 smithi081 ceph-mon[28640]: from='mgr.? 172.21.15.146:0/3519711386' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-03T16:35:47.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:47 smithi081 ceph-mon[28640]: from='mgr.? 172.21.15.146:0/3519711386' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-03T16:35:47.533 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:47 smithi146 ceph-mon[32357]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:47.533 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:47 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/1940226011' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:35:47.533 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:47 smithi146 ceph-mon[32357]: Standby manager daemon z started 2024-05-03T16:35:47.533 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:47 smithi146 ceph-mon[32357]: from='mgr.? 172.21.15.146:0/3519711386' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-03T16:35:47.534 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:47 smithi146 ceph-mon[32357]: from='mgr.? 172.21.15.146:0/3519711386' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-03T16:35:47.534 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:47 smithi146 ceph-mon[32357]: from='mgr.? 172.21.15.146:0/3519711386' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-03T16:35:47.534 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:47 smithi146 ceph-mon[32357]: from='mgr.? 172.21.15.146:0/3519711386' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-03T16:35:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:47.652+0000 7f873e000700 1 -- 172.21.15.81:0/1271237947 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 14) ==== 99937+0+0 (secure 0 0 0) 0x7f872c00f930 con 0x7f8740104700 2024-05-03T16:35:47.966 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:47 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:47.590+0000 7f6501333200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-03T16:35:48.466 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:48 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:48.039+0000 7f6501333200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-03T16:35:48.467 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:48 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:48.160+0000 7f6501333200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-03T16:35:48.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:48 smithi146 ceph-mon[32357]: mgrmap e14: x(active, since 103s), standbys: z 2024-05-03T16:35:48.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:48 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-03T16:35:48.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:48 smithi134 ceph-mon[31708]: mgrmap e14: x(active, since 103s), standbys: z 2024-05-03T16:35:48.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:48 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-03T16:35:48.967 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:48 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:48.478+0000 7f6501333200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-03T16:35:48.967 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:48 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:48.656+0000 7f6501333200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-03T16:35:48.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:48 smithi081 ceph-mon[28640]: mgrmap e14: x(active, since 103s), standbys: z 2024-05-03T16:35:48.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:48 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-03T16:35:49.325 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:49 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:49.050+0000 7f6501333200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-03T16:35:49.325 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:49 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:49.201+0000 7f6501333200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-03T16:35:49.325 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:49 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:49.322+0000 7f6501333200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-03T16:35:49.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:49 smithi134 ceph-mon[31708]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:49.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:49 smithi081 ceph-mon[28640]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:50.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:49 smithi146 ceph-mon[32357]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:50.350 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:50 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:50.066+0000 7f6501333200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-03T16:35:50.350 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 16:35:50 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y[33094]: 2024-05-03T16:35:50.346+0000 7f6501333200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-03T16:35:50.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:35:50.696+0000 7f873e000700 1 -- 172.21.15.81:0/1271237947 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f872c02ac80 con 0x7f8740104700 2024-05-03T16:35:50.885 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:50 smithi081 ceph-mon[28640]: Standby manager daemon y started 2024-05-03T16:35:50.885 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:50 smithi081 ceph-mon[28640]: from='mgr.? 172.21.15.134:0/3975617555' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-03T16:35:50.885 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:50 smithi081 ceph-mon[28640]: from='mgr.? 172.21.15.134:0/3975617555' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-03T16:35:50.885 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:50 smithi081 ceph-mon[28640]: from='mgr.? 172.21.15.134:0/3975617555' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-03T16:35:50.885 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:50 smithi081 ceph-mon[28640]: from='mgr.? 172.21.15.134:0/3975617555' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-03T16:35:50.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:50 smithi134 ceph-mon[31708]: Standby manager daemon y started 2024-05-03T16:35:50.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:50 smithi134 ceph-mon[31708]: from='mgr.? 172.21.15.134:0/3975617555' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-03T16:35:50.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:50 smithi134 ceph-mon[31708]: from='mgr.? 172.21.15.134:0/3975617555' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-03T16:35:50.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:50 smithi134 ceph-mon[31708]: from='mgr.? 172.21.15.134:0/3975617555' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-03T16:35:50.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:50 smithi134 ceph-mon[31708]: from='mgr.? 172.21.15.134:0/3975617555' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-03T16:35:51.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:50 smithi146 ceph-mon[32357]: Standby manager daemon y started 2024-05-03T16:35:51.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:50 smithi146 ceph-mon[32357]: from='mgr.? 172.21.15.134:0/3975617555' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-03T16:35:51.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:50 smithi146 ceph-mon[32357]: from='mgr.? 172.21.15.134:0/3975617555' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-03T16:35:51.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:50 smithi146 ceph-mon[32357]: from='mgr.? 172.21.15.134:0/3975617555' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-03T16:35:51.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:50 smithi146 ceph-mon[32357]: from='mgr.? 172.21.15.134:0/3975617555' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-03T16:35:51.917 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:51 smithi081 ceph-mon[28640]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:51.917 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:51 smithi081 ceph-mon[28640]: mgrmap e15: x(active, since 106s), standbys: z, y 2024-05-03T16:35:51.917 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:51 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-03T16:35:51.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:51 smithi134 ceph-mon[31708]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:51.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:51 smithi134 ceph-mon[31708]: mgrmap e15: x(active, since 106s), standbys: z, y 2024-05-03T16:35:51.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:51 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-03T16:35:52.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:51 smithi146 ceph-mon[32357]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:52.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:51 smithi146 ceph-mon[32357]: mgrmap e15: x(active, since 106s), standbys: z, y 2024-05-03T16:35:52.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:51 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-03T16:35:53.295 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:53 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:53.295 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:53 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:53.295 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:53 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:35:53.295 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:53 smithi081 ceph-mon[28640]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:53.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:53 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:53.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:53 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:53.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:53 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:35:53.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:53 smithi134 ceph-mon[31708]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:53.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:53 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:53.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:53 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:53.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:53 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:35:53.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:53 smithi146 ceph-mon[32357]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:54.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:54 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:54.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:54 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:35:54.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:54 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:54.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:54 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:54.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:54 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:35:54.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:54 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:54.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:54 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:54.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:54 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:35:54.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:54 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:35:55.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:55 smithi134 ceph-mon[31708]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:55.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:55 smithi081 ceph-mon[28640]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:55.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:55 smithi146 ceph-mon[32357]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:56.438 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:56 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-03T16:35:56.438 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:56 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:56.438 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:56 smithi081 ceph-mon[28640]: Deploying daemon osd.0 on smithi081 2024-05-03T16:35:56.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:56 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-03T16:35:56.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:56 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:56.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:56 smithi134 ceph-mon[31708]: Deploying daemon osd.0 on smithi081 2024-05-03T16:35:56.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:56 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-03T16:35:56.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:56 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:35:56.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:56 smithi146 ceph-mon[32357]: Deploying daemon osd.0 on smithi081 2024-05-03T16:35:57.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:57 smithi134 ceph-mon[31708]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:57.396 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:57 smithi081 ceph-mon[28640]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:57.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:57 smithi146 ceph-mon[32357]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:59.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:35:59 smithi134 ceph-mon[31708]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:59.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:35:59 smithi081 ceph-mon[28640]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:35:59.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:35:59 smithi146 ceph-mon[32357]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:36:01.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:01 smithi134 ceph-mon[31708]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:36:01.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:01 smithi081 ceph-mon[28640]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:36:01.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:01 smithi146 ceph-mon[32357]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:36:03.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:03 smithi134 ceph-mon[31708]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:36:03.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:03 smithi081 ceph-mon[28640]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:36:03.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:03 smithi146 ceph-mon[32357]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:36:04.644 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:04.645 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:04.645 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:36:04.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:04 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:04.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:04 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:04.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:04 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:36:04.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:04 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:04.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:04 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:04.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:04 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:36:05.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:05 smithi081 ceph-mon[28640]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:36:05.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:05 smithi146 ceph-mon[32357]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:36:05.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:05 smithi134 ceph-mon[31708]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:36:07.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:07 smithi134 ceph-mon[31708]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:36:07.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:07 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:07.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:07 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:07.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:07 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:07.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:07 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:36:07.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:07 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:07.718 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:07 smithi134 ceph-mon[31708]: from='osd.0 [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-03T16:36:07.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:07 smithi081 ceph-mon[28640]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:36:07.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:07 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:07.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:07 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:07.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:07 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:07.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:07 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:36:07.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:07 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:07.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:07 smithi081 ceph-mon[28640]: from='osd.0 [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-03T16:36:07.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:07 smithi146 ceph-mon[32357]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:36:07.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:07.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:07.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:07.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:36:07.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:07.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:07 smithi146 ceph-mon[32357]: from='osd.0 [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-03T16:36:08.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:36:08.279+0000 7f873e000700 1 -- 172.21.15.81:0/1271237947 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f87400639a0 con 0x7f872803e750 2024-05-03T16:36:08.280 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 0 on host 'smithi081' 2024-05-03T16:36:08.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:36:08.282+0000 7f8748400700 1 -- 172.21.15.81:0/1271237947 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f872803e750 msgr2=0x7f8728040c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:36:08.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:36:08.282+0000 7f8748400700 1 --2- 172.21.15.81:0/1271237947 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f872803e750 0x7f8728040c10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8740104560 tx=0x7f8734009260 comp rx=0 tx=0).stop 2024-05-03T16:36:08.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:36:08.282+0000 7f8748400700 1 -- 172.21.15.81:0/1271237947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8740104700 msgr2=0x7f8740075890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:36:08.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:36:08.282+0000 7f8748400700 1 --2- 172.21.15.81:0/1271237947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8740104700 0x7f8740075890 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f872c00b580 tx=0x7f872c003f10 comp rx=0 tx=0).stop 2024-05-03T16:36:08.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:36:08.282+0000 7f8748400700 1 -- 172.21.15.81:0/1271237947 shutdown_connections 2024-05-03T16:36:08.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:36:08.282+0000 7f8748400700 1 --2- 172.21.15.81:0/1271237947 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f872803e750 0x7f8728040c10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:36:08.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:36:08.282+0000 7f8748400700 1 --2- 172.21.15.81:0/1271237947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8740103500 0x7f87400771f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:36:08.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:36:08.282+0000 7f8748400700 1 --2- 172.21.15.81:0/1271237947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87401050a0 0x7f8740075dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:36:08.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:36:08.282+0000 7f8748400700 1 --2- 172.21.15.81:0/1271237947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8740104700 0x7f8740075890 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:36:08.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:36:08.282+0000 7f8748400700 1 -- 172.21.15.81:0/1271237947 >> 172.21.15.81:0/1271237947 conn(0x7f87400feaa0 msgr2=0x7f8740107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:36:08.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:36:08.282+0000 7f8748400700 1 -- 172.21.15.81:0/1271237947 shutdown_connections 2024-05-03T16:36:08.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:36:08.283+0000 7f8748400700 1 -- 172.21.15.81:0/1271237947 wait complete. 2024-05-03T16:36:08.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:08 smithi146 ceph-mon[32357]: from='osd.0 [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-03T16:36:08.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:08 smithi146 ceph-mon[32357]: osdmap e6: 1 total, 0 up, 1 in 2024-05-03T16:36:08.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:08 smithi146 ceph-mon[32357]: from='osd.0 [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-03T16:36:08.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:08 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T16:36:08.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:08 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:08.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:08 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:36:08.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:08 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:08.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:08 smithi081 ceph-mon[28640]: from='osd.0 [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-03T16:36:08.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:08 smithi081 ceph-mon[28640]: osdmap e6: 1 total, 0 up, 1 in 2024-05-03T16:36:08.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:08 smithi081 ceph-mon[28640]: from='osd.0 [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-03T16:36:08.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:08 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T16:36:08.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:08 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:08.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:08 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:36:08.864 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:08 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:08.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:08 smithi134 ceph-mon[31708]: from='osd.0 [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-03T16:36:08.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:08 smithi134 ceph-mon[31708]: osdmap e6: 1 total, 0 up, 1 in 2024-05-03T16:36:08.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:08 smithi134 ceph-mon[31708]: from='osd.0 [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-03T16:36:08.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:08 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T16:36:08.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:08 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:08.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:08 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:36:08.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:08 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:09.136 DEBUG:teuthology.orchestra.run.smithi081:osd.0> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.0.service 2024-05-03T16:36:09.141 INFO:tasks.cephadm:Deploying osd.1 on smithi134 with /dev/vg_nvme/lv_4... 2024-05-03T16:36:09.141 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-03T16:36:09.568 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T16:36:09.646 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:09 smithi081 ceph-mon[28640]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:36:09.646 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:09 smithi081 ceph-mon[28640]: from='osd.0 [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-03T16:36:09.646 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:09 smithi081 ceph-mon[28640]: osdmap e7: 1 total, 0 up, 1 in 2024-05-03T16:36:09.646 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:09 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T16:36:09.646 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:09 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T16:36:09.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:09 smithi146 ceph-mon[32357]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:36:09.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:09 smithi146 ceph-mon[32357]: from='osd.0 [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-03T16:36:09.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:09 smithi146 ceph-mon[32357]: osdmap e7: 1 total, 0 up, 1 in 2024-05-03T16:36:09.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:09 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T16:36:09.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:09 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T16:36:09.856 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:09 smithi134 ceph-mon[31708]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:36:09.856 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:09 smithi134 ceph-mon[31708]: from='osd.0 [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-03T16:36:09.856 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:09 smithi134 ceph-mon[31708]: osdmap e7: 1 total, 0 up, 1 in 2024-05-03T16:36:09.856 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:09 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T16:36:09.856 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:09 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T16:36:10.760 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:10 smithi134 ceph-mon[31708]: purged_snaps scrub starts 2024-05-03T16:36:10.760 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:10 smithi134 ceph-mon[31708]: purged_snaps scrub ok 2024-05-03T16:36:10.760 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:10 smithi134 ceph-mon[31708]: osd.0 [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055] boot 2024-05-03T16:36:10.760 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:10 smithi134 ceph-mon[31708]: osdmap e8: 1 total, 1 up, 1 in 2024-05-03T16:36:10.760 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:10 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T16:36:10.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:10 smithi146 ceph-mon[32357]: purged_snaps scrub starts 2024-05-03T16:36:10.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:10 smithi146 ceph-mon[32357]: purged_snaps scrub ok 2024-05-03T16:36:10.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:10 smithi146 ceph-mon[32357]: osd.0 [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055] boot 2024-05-03T16:36:10.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:10 smithi146 ceph-mon[32357]: osdmap e8: 1 total, 1 up, 1 in 2024-05-03T16:36:10.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:10 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T16:36:10.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:10 smithi081 ceph-mon[28640]: purged_snaps scrub starts 2024-05-03T16:36:10.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:10 smithi081 ceph-mon[28640]: purged_snaps scrub ok 2024-05-03T16:36:10.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:10 smithi081 ceph-mon[28640]: osd.0 [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055] boot 2024-05-03T16:36:10.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:10 smithi081 ceph-mon[28640]: osdmap e8: 1 total, 1 up, 1 in 2024-05-03T16:36:10.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:10 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T16:36:11.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:11 smithi146 ceph-mon[32357]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:36:11.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:11 smithi146 ceph-mon[32357]: osdmap e9: 1 total, 1 up, 1 in 2024-05-03T16:36:11.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:11 smithi134 ceph-mon[31708]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:36:11.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:11 smithi134 ceph-mon[31708]: osdmap e9: 1 total, 1 up, 1 in 2024-05-03T16:36:11.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:11 smithi081 ceph-mon[28640]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T16:36:11.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:11 smithi081 ceph-mon[28640]: osdmap e9: 1 total, 1 up, 1 in 2024-05-03T16:36:12.410 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-03T16:36:12.410 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-03T16:36:12.410 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-05-03T16:36:12.410 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-05-03T16:36:12.410 INFO:teuthology.orchestra.run.smithi134.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0328994 s, 319 MB/s 2024-05-03T16:36:12.410 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-05-03T16:36:13.214 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_4 2024-05-03T16:36:13.625 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T16:36:13.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:13 smithi081 ceph-mon[28640]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:13.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:13 smithi146 ceph-mon[32357]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:13.928 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:13 smithi134 ceph-mon[31708]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:15.071 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:14 smithi134 ceph-mon[31708]: Detected new or changed devices on smithi081 2024-05-03T16:36:15.071 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:14 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:15.071 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:14 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:15.071 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:14 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:36:15.071 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:14 smithi134 ceph-mon[31708]: Adjusting osd_memory_target on smithi081 to 17089M 2024-05-03T16:36:15.071 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:14 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:15.071 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:14 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:15.071 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:14 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:36:15.071 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:14 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:15.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:14 smithi081 ceph-mon[28640]: Detected new or changed devices on smithi081 2024-05-03T16:36:15.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:14 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:15.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:14 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:15.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:14 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:36:15.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:14 smithi081 ceph-mon[28640]: Adjusting osd_memory_target on smithi081 to 17089M 2024-05-03T16:36:15.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:14 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:15.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:14 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:15.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:14 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:36:15.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:14 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:15.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:14 smithi146 ceph-mon[32357]: Detected new or changed devices on smithi081 2024-05-03T16:36:15.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:14 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:15.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:14 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:15.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:14 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:36:15.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:14 smithi146 ceph-mon[32357]: Adjusting osd_memory_target on smithi081 to 17089M 2024-05-03T16:36:15.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:14 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:15.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:14 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:15.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:14 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:36:15.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:14 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:15.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.584+0000 7f9983200700 1 -- 172.21.15.134:0/3538054613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f997c10b6e0 msgr2=0x7f997c111f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:36:15.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.584+0000 7f9983200700 1 --2- 172.21.15.134:0/3538054613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f997c10b6e0 0x7f997c111f90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f997400b0d0 tx=0x7f997400b3e0 comp rx=0 tx=0).stop 2024-05-03T16:36:15.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.584+0000 7f9983200700 1 -- 172.21.15.134:0/3538054613 shutdown_connections 2024-05-03T16:36:15.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.584+0000 7f9983200700 1 --2- 172.21.15.134:0/3538054613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997c109b40 0x7f997c109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:36:15.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.584+0000 7f9983200700 1 --2- 172.21.15.134:0/3538054613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f997c10b6e0 0x7f997c111f90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:36:15.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.584+0000 7f9983200700 1 --2- 172.21.15.134:0/3538054613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c10ad40 0x7f997c10b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:36:15.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.584+0000 7f9983200700 1 -- 172.21.15.134:0/3538054613 >> 172.21.15.134:0/3538054613 conn(0x7f997c078b10 msgr2=0x7f997c07af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:36:15.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.585+0000 7f9983200700 1 -- 172.21.15.134:0/3538054613 shutdown_connections 2024-05-03T16:36:15.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.585+0000 7f9983200700 1 -- 172.21.15.134:0/3538054613 wait complete. 2024-05-03T16:36:15.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.586+0000 7f9983200700 1 Processor -- start 2024-05-03T16:36:15.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.586+0000 7f9983200700 1 -- start start 2024-05-03T16:36:15.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.587+0000 7f9983200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c109b40 0x7f997c19fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:36:15.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.587+0000 7f9983200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997c10ad40 0x7f997c19ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:36:15.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.587+0000 7f9983200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f997c10b6e0 0x7f997c1a7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:36:15.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.587+0000 7f9983200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f997c1154c0 con 0x7f997c109b40 2024-05-03T16:36:15.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.587+0000 7f9983200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f997c115340 con 0x7f997c10b6e0 2024-05-03T16:36:15.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.587+0000 7f9983200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f997c115640 con 0x7f997c10ad40 2024-05-03T16:36:15.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.587+0000 7f9981200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f997c10b6e0 0x7f997c1a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:36:15.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.587+0000 7f9981200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f997c10b6e0 0x7f997c1a7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52814/0 (socket says 172.21.15.134:52814) 2024-05-03T16:36:15.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.587+0000 7f9981200700 1 -- 172.21.15.134:0/1524291287 learned_addr learned my addr 172.21.15.134:0/1524291287 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-05-03T16:36:15.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.587+0000 7f997be00700 1 --2- 172.21.15.134:0/1524291287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c109b40 0x7f997c19fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:36:15.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.587+0000 7f997b400700 1 --2- 172.21.15.134:0/1524291287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997c10ad40 0x7f997c19ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:36:15.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.587+0000 7f9981200700 1 -- 172.21.15.134:0/1524291287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997c10ad40 msgr2=0x7f997c19ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:36:15.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.587+0000 7f9981200700 1 --2- 172.21.15.134:0/1524291287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997c10ad40 0x7f997c19ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:36:15.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.587+0000 7f9981200700 1 -- 172.21.15.134:0/1524291287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c109b40 msgr2=0x7f997c19fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:36:15.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.587+0000 7f9981200700 1 --2- 172.21.15.134:0/1524291287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c109b40 0x7f997c19fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:36:15.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.587+0000 7f9981200700 1 -- 172.21.15.134:0/1524291287 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f997c1a76d0 con 0x7f997c10b6e0 2024-05-03T16:36:15.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.587+0000 7f997be00700 1 --2- 172.21.15.134:0/1524291287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c109b40 0x7f997c19fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:36:15.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.588+0000 7f9981200700 1 --2- 172.21.15.134:0/1524291287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f997c10b6e0 0x7f997c1a7030 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9974004fd0 tx=0x7f9974009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:36:15.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.588+0000 7f9978c00700 1 -- 172.21.15.134:0/1524291287 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997401f030 con 0x7f997c10b6e0 2024-05-03T16:36:15.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.588+0000 7f9978c00700 1 -- 172.21.15.134:0/1524291287 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9974007a00 con 0x7f997c10b6e0 2024-05-03T16:36:15.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.588+0000 7f9983200700 1 -- 172.21.15.134:0/1524291287 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f997c1a7960 con 0x7f997c10b6e0 2024-05-03T16:36:15.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.588+0000 7f9978c00700 1 -- 172.21.15.134:0/1524291287 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997401b690 con 0x7f997c10b6e0 2024-05-03T16:36:15.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.588+0000 7f9983200700 1 -- 172.21.15.134:0/1524291287 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f997c1a7dc0 con 0x7f997c10b6e0 2024-05-03T16:36:15.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.589+0000 7f9983200700 1 -- 172.21.15.134:0/1524291287 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f997c06a190 con 0x7f997c10b6e0 2024-05-03T16:36:15.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.592+0000 7f9978c00700 1 -- 172.21.15.134:0/1524291287 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f9974022030 con 0x7f997c10b6e0 2024-05-03T16:36:15.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.593+0000 7f9978c00700 1 --2- 172.21.15.134:0/1524291287 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f99600b27f0 0x7f99600b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:36:15.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.593+0000 7f9978c00700 1 -- 172.21.15.134:0/1524291287 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f99740e12c0 con 0x7f997c10b6e0 2024-05-03T16:36:15.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.594+0000 7f997be00700 1 --2- 172.21.15.134:0/1524291287 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f99600b27f0 0x7f99600b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:36:15.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.595+0000 7f997be00700 1 --2- 172.21.15.134:0/1524291287 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f99600b27f0 0x7f99600b4cb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f997c10aba0 tx=0x7f996c00a680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:36:15.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.597+0000 7f9978c00700 1 -- 172.21.15.134:0/1524291287 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f99740aaa40 con 0x7f997c10b6e0 2024-05-03T16:36:15.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:15.836+0000 7f9983200700 1 -- 172.21.15.134:0/1524291287 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f997c0638e0 con 0x7f99600b27f0 2024-05-03T16:36:16.216 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:15 smithi146 ceph-mon[32357]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:16.216 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:15 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:36:16.216 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:15 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:36:16.216 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:15 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:16.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:15 smithi134 ceph-mon[31708]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:16.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:15 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:36:16.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:15 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:36:16.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:15 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:16.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:15 smithi081 ceph-mon[28640]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:16.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:15 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:36:16.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:15 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:36:16.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:15 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:17.060 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:16 smithi134 ceph-mon[31708]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:36:17.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:16 smithi081 ceph-mon[28640]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:36:17.245 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:16 smithi146 ceph-mon[32357]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:36:18.064 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:17 smithi134 ceph-mon[31708]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:18.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:17 smithi081 ceph-mon[28640]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:18.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:17 smithi146 ceph-mon[32357]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:20.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:19 smithi134 ceph-mon[31708]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:20.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:19 smithi134 ceph-mon[31708]: from='client.? 172.21.15.134:0/458376339' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bb199cd-b4d0-4c67-b98f-2106336dd57b"}]: dispatch 2024-05-03T16:36:20.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:19 smithi134 ceph-mon[31708]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bb199cd-b4d0-4c67-b98f-2106336dd57b"}]: dispatch 2024-05-03T16:36:20.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:19 smithi134 ceph-mon[31708]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3bb199cd-b4d0-4c67-b98f-2106336dd57b"}]': finished 2024-05-03T16:36:20.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:19 smithi134 ceph-mon[31708]: osdmap e10: 2 total, 1 up, 2 in 2024-05-03T16:36:20.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:19 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T16:36:20.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:19 smithi081 ceph-mon[28640]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:20.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:19 smithi081 ceph-mon[28640]: from='client.? 172.21.15.134:0/458376339' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bb199cd-b4d0-4c67-b98f-2106336dd57b"}]: dispatch 2024-05-03T16:36:20.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:19 smithi081 ceph-mon[28640]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bb199cd-b4d0-4c67-b98f-2106336dd57b"}]: dispatch 2024-05-03T16:36:20.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:19 smithi081 ceph-mon[28640]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3bb199cd-b4d0-4c67-b98f-2106336dd57b"}]': finished 2024-05-03T16:36:20.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:19 smithi081 ceph-mon[28640]: osdmap e10: 2 total, 1 up, 2 in 2024-05-03T16:36:20.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T16:36:20.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:19 smithi146 ceph-mon[32357]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:20.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:19 smithi146 ceph-mon[32357]: from='client.? 172.21.15.134:0/458376339' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bb199cd-b4d0-4c67-b98f-2106336dd57b"}]: dispatch 2024-05-03T16:36:20.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:19 smithi146 ceph-mon[32357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bb199cd-b4d0-4c67-b98f-2106336dd57b"}]: dispatch 2024-05-03T16:36:20.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:19 smithi146 ceph-mon[32357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3bb199cd-b4d0-4c67-b98f-2106336dd57b"}]': finished 2024-05-03T16:36:20.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:19 smithi146 ceph-mon[32357]: osdmap e10: 2 total, 1 up, 2 in 2024-05-03T16:36:20.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:19 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T16:36:21.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:20 smithi134 ceph-mon[31708]: from='client.? 172.21.15.134:0/1960544980' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:36:21.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:20 smithi081 ceph-mon[28640]: from='client.? 172.21.15.134:0/1960544980' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:36:21.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:20 smithi146 ceph-mon[32357]: from='client.? 172.21.15.134:0/1960544980' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:36:22.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:21 smithi081 ceph-mon[28640]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:22.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:21 smithi146 ceph-mon[32357]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:22.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:21 smithi134 ceph-mon[31708]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:24.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:23 smithi081 ceph-mon[28640]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:24.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:23 smithi146 ceph-mon[32357]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:24.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:23 smithi134 ceph-mon[31708]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:26.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:25 smithi081 ceph-mon[28640]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:26.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:25 smithi146 ceph-mon[32357]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:26.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:25 smithi134 ceph-mon[31708]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:27.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:27 smithi146 ceph-mon[32357]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:27.329 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:27 smithi134 ceph-mon[31708]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:27.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:27 smithi081 ceph-mon[28640]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:29.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:29 smithi134 ceph-mon[31708]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:29.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-03T16:36:29.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:29.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:29 smithi134 ceph-mon[31708]: Deploying daemon osd.1 on smithi134 2024-05-03T16:36:29.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:29 smithi081 ceph-mon[28640]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:29.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-03T16:36:29.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:29.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:29 smithi081 ceph-mon[28640]: Deploying daemon osd.1 on smithi134 2024-05-03T16:36:29.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:29 smithi146 ceph-mon[32357]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:29.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-03T16:36:29.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:29.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:29 smithi146 ceph-mon[32357]: Deploying daemon osd.1 on smithi134 2024-05-03T16:36:31.324 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:31 smithi134 ceph-mon[31708]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:31.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:31 smithi081 ceph-mon[28640]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:31.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:31 smithi146 ceph-mon[32357]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:33.383 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:33 smithi134 ceph-mon[31708]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:33.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:33 smithi081 ceph-mon[28640]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:33.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:33 smithi146 ceph-mon[32357]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:35.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:35 smithi134 ceph-mon[31708]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:35.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:35 smithi081 ceph-mon[28640]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:35.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:35 smithi146 ceph-mon[32357]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:37.706 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:37 smithi134 ceph-mon[31708]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:37.707 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:37.707 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:37.707 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:36:37.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:37 smithi081 ceph-mon[28640]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:37.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:37.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:37.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:36:37.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:37 smithi146 ceph-mon[32357]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:37.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:37.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:37.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:36:39.614 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:39 smithi134 ceph-mon[31708]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:39.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:39 smithi081 ceph-mon[28640]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:39.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:39 smithi146 ceph-mon[32357]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:41.051 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:40 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:41.051 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:40 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:41.051 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:40 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:41.051 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:40 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:36:41.051 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:40 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:41.051 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:40 smithi134 ceph-mon[31708]: from='osd.1 [v2:172.21.15.134:6800/1928503491,v1:172.21.15.134:6801/1928503491]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-03T16:36:41.051 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:40 smithi134 ceph-mon[31708]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-03T16:36:41.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:41.141+0000 7f9978c00700 1 -- 172.21.15.134:0/1524291287 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f997c0638e0 con 0x7f99600b27f0 2024-05-03T16:36:41.144 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 1 on host 'smithi134' 2024-05-03T16:36:41.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:41.145+0000 7f9983200700 1 -- 172.21.15.134:0/1524291287 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f99600b27f0 msgr2=0x7f99600b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:36:41.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:41.145+0000 7f9983200700 1 --2- 172.21.15.134:0/1524291287 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f99600b27f0 0x7f99600b4cb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f997c10aba0 tx=0x7f996c00a680 comp rx=0 tx=0).stop 2024-05-03T16:36:41.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:41.145+0000 7f9983200700 1 -- 172.21.15.134:0/1524291287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f997c10b6e0 msgr2=0x7f997c1a7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:36:41.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:41.145+0000 7f9983200700 1 --2- 172.21.15.134:0/1524291287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f997c10b6e0 0x7f997c1a7030 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9974004fd0 tx=0x7f9974009c30 comp rx=0 tx=0).stop 2024-05-03T16:36:41.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:41.145+0000 7f9983200700 1 -- 172.21.15.134:0/1524291287 shutdown_connections 2024-05-03T16:36:41.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:41.145+0000 7f9983200700 1 --2- 172.21.15.134:0/1524291287 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f99600b27f0 0x7f99600b4cb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:36:41.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:41.145+0000 7f9983200700 1 --2- 172.21.15.134:0/1524291287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f997c10b6e0 0x7f997c1a7030 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:36:41.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:41.145+0000 7f9983200700 1 --2- 172.21.15.134:0/1524291287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c109b40 0x7f997c19fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:36:41.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:41.145+0000 7f9983200700 1 --2- 172.21.15.134:0/1524291287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997c10ad40 0x7f997c19ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:36:41.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:41.145+0000 7f9983200700 1 -- 172.21.15.134:0/1524291287 >> 172.21.15.134:0/1524291287 conn(0x7f997c078b10 msgr2=0x7f997c10e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:36:41.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:41.145+0000 7f9983200700 1 -- 172.21.15.134:0/1524291287 shutdown_connections 2024-05-03T16:36:41.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:36:41.145+0000 7f9983200700 1 -- 172.21.15.134:0/1524291287 wait complete. 2024-05-03T16:36:41.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:40 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:41.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:40 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:41.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:40 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:41.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:40 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:36:41.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:40 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:41.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:40 smithi081 ceph-mon[28640]: from='osd.1 [v2:172.21.15.134:6800/1928503491,v1:172.21.15.134:6801/1928503491]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-03T16:36:41.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:40 smithi081 ceph-mon[28640]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-03T16:36:41.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:40 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:41.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:40 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:41.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:40 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:41.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:40 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:36:41.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:40 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:41.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:40 smithi146 ceph-mon[32357]: from='osd.1 [v2:172.21.15.134:6800/1928503491,v1:172.21.15.134:6801/1928503491]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-03T16:36:41.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:40 smithi146 ceph-mon[32357]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-03T16:36:42.066 DEBUG:teuthology.orchestra.run.smithi134:osd.1> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.1.service 2024-05-03T16:36:42.070 INFO:tasks.cephadm:Deploying osd.2 on smithi146 with /dev/vg_nvme/lv_4... 2024-05-03T16:36:42.071 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-03T16:36:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:41 smithi146 ceph-mon[32357]: pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:41 smithi146 ceph-mon[32357]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-03T16:36:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:41 smithi146 ceph-mon[32357]: osdmap e11: 2 total, 1 up, 2 in 2024-05-03T16:36:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:41 smithi146 ceph-mon[32357]: from='osd.1 [v2:172.21.15.134:6800/1928503491,v1:172.21.15.134:6801/1928503491]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:36:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T16:36:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:41 smithi146 ceph-mon[32357]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:36:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:36:42.330 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:41 smithi134 ceph-mon[31708]: pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:42.330 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:41 smithi134 ceph-mon[31708]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-03T16:36:42.331 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:41 smithi134 ceph-mon[31708]: osdmap e11: 2 total, 1 up, 2 in 2024-05-03T16:36:42.331 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:41 smithi134 ceph-mon[31708]: from='osd.1 [v2:172.21.15.134:6800/1928503491,v1:172.21.15.134:6801/1928503491]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:36:42.331 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T16:36:42.331 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:41 smithi134 ceph-mon[31708]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:36:42.331 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:42.331 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:42.331 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:36:42.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:41 smithi081 ceph-mon[28640]: pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:42.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:41 smithi081 ceph-mon[28640]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-03T16:36:42.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:41 smithi081 ceph-mon[28640]: osdmap e11: 2 total, 1 up, 2 in 2024-05-03T16:36:42.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:41 smithi081 ceph-mon[28640]: from='osd.1 [v2:172.21.15.134:6800/1928503491,v1:172.21.15.134:6801/1928503491]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:36:42.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T16:36:42.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:41 smithi081 ceph-mon[28640]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:36:42.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:42.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:42.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:36:42.505 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T16:36:43.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:43 smithi146 ceph-mon[32357]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-03T16:36:43.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:43 smithi146 ceph-mon[32357]: osdmap e12: 2 total, 1 up, 2 in 2024-05-03T16:36:43.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:43 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T16:36:43.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:43 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T16:36:43.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:43 smithi146 ceph-mon[32357]: pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:43.426 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:43 smithi134 ceph-mon[31708]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-03T16:36:43.426 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:43 smithi134 ceph-mon[31708]: osdmap e12: 2 total, 1 up, 2 in 2024-05-03T16:36:43.426 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:43 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T16:36:43.426 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:43 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T16:36:43.426 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:43 smithi134 ceph-mon[31708]: pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:43.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:43 smithi081 ceph-mon[28640]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-03T16:36:43.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:43 smithi081 ceph-mon[28640]: osdmap e12: 2 total, 1 up, 2 in 2024-05-03T16:36:43.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:43 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T16:36:43.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:43 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T16:36:43.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:43 smithi081 ceph-mon[28640]: pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T16:36:44.132 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:44 smithi146 ceph-mon[32357]: purged_snaps scrub starts 2024-05-03T16:36:44.132 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:44 smithi146 ceph-mon[32357]: purged_snaps scrub ok 2024-05-03T16:36:44.132 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:44 smithi146 ceph-mon[32357]: osd.1 [v2:172.21.15.134:6800/1928503491,v1:172.21.15.134:6801/1928503491] boot 2024-05-03T16:36:44.132 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:44 smithi146 ceph-mon[32357]: osdmap e13: 2 total, 2 up, 2 in 2024-05-03T16:36:44.132 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T16:36:44.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:44 smithi134 ceph-mon[31708]: purged_snaps scrub starts 2024-05-03T16:36:44.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:44 smithi134 ceph-mon[31708]: purged_snaps scrub ok 2024-05-03T16:36:44.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:44 smithi134 ceph-mon[31708]: osd.1 [v2:172.21.15.134:6800/1928503491,v1:172.21.15.134:6801/1928503491] boot 2024-05-03T16:36:44.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:44 smithi134 ceph-mon[31708]: osdmap e13: 2 total, 2 up, 2 in 2024-05-03T16:36:44.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T16:36:44.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:44 smithi081 ceph-mon[28640]: purged_snaps scrub starts 2024-05-03T16:36:44.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:44 smithi081 ceph-mon[28640]: purged_snaps scrub ok 2024-05-03T16:36:44.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:44 smithi081 ceph-mon[28640]: osd.1 [v2:172.21.15.134:6800/1928503491,v1:172.21.15.134:6801/1928503491] boot 2024-05-03T16:36:44.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:44 smithi081 ceph-mon[28640]: osdmap e13: 2 total, 2 up, 2 in 2024-05-03T16:36:44.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T16:36:45.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:45 smithi146 ceph-mon[32357]: osdmap e14: 2 total, 2 up, 2 in 2024-05-03T16:36:45.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:45 smithi146 ceph-mon[32357]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:45.322 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-03T16:36:45.322 INFO:teuthology.orchestra.run.smithi146.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-03T16:36:45.322 INFO:teuthology.orchestra.run.smithi146.stderr: stderr: 10+0 records in 2024-05-03T16:36:45.322 INFO:teuthology.orchestra.run.smithi146.stderr:10+0 records out 2024-05-03T16:36:45.322 INFO:teuthology.orchestra.run.smithi146.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0335239 s, 313 MB/s 2024-05-03T16:36:45.322 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping successful for: 2024-05-03T16:36:45.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:45 smithi134 ceph-mon[31708]: osdmap e14: 2 total, 2 up, 2 in 2024-05-03T16:36:45.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:45 smithi134 ceph-mon[31708]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:45.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:45 smithi081 ceph-mon[28640]: osdmap e14: 2 total, 2 up, 2 in 2024-05-03T16:36:45.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:45 smithi081 ceph-mon[28640]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:46.083 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi146:vg_nvme/lv_4 2024-05-03T16:36:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T16:36:47.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:47 smithi081 ceph-mon[28640]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:47.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:47 smithi081 ceph-mon[28640]: Detected new or changed devices on smithi134 2024-05-03T16:36:47.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:47.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:47.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:36:47.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:47 smithi081 ceph-mon[28640]: Adjusting osd_memory_target on smithi134 to 17089M 2024-05-03T16:36:47.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:47.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:47.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:36:47.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:48.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:47 smithi146 ceph-mon[32357]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:48.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:47 smithi146 ceph-mon[32357]: Detected new or changed devices on smithi134 2024-05-03T16:36:48.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:47 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:48.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:47 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:48.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:47 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:36:48.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:47 smithi146 ceph-mon[32357]: Adjusting osd_memory_target on smithi134 to 17089M 2024-05-03T16:36:48.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:47 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:48.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:47 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:48.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:47 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:36:48.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:47 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:48.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:47 smithi134 ceph-mon[31708]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:48.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:47 smithi134 ceph-mon[31708]: Detected new or changed devices on smithi134 2024-05-03T16:36:48.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:47 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:48.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:47 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:48.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:47 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:36:48.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:47 smithi134 ceph-mon[31708]: Adjusting osd_memory_target on smithi134 to 17089M 2024-05-03T16:36:48.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:47 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:48.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:47 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:48.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:47 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:36:48.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:47 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:36:48.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.582+0000 7f81ba200700 1 -- 172.21.15.146:0/2367860298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81b4109290 msgr2=0x7f81b410b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:36:48.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.582+0000 7f81ba200700 1 --2- 172.21.15.146:0/2367860298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81b4109290 0x7f81b410b680 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00b0a0 tx=0x7f81ac00b3b0 comp rx=0 tx=0).stop 2024-05-03T16:36:48.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.582+0000 7f81ba200700 1 -- 172.21.15.146:0/2367860298 shutdown_connections 2024-05-03T16:36:48.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.582+0000 7f81ba200700 1 --2- 172.21.15.146:0/2367860298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81b4109290 0x7f81b410b680 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:36:48.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.582+0000 7f81ba200700 1 --2- 172.21.15.146:0/2367860298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b4104030 0x7f81b4106420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:36:48.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.582+0000 7f81ba200700 1 --2- 172.21.15.146:0/2367860298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b4106960 0x7f81b4108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:36:48.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.582+0000 7f81ba200700 1 -- 172.21.15.146:0/2367860298 >> 172.21.15.146:0/2367860298 conn(0x7f81b40fd9a0 msgr2=0x7f81b40ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:36:48.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.582+0000 7f81ba200700 1 -- 172.21.15.146:0/2367860298 shutdown_connections 2024-05-03T16:36:48.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.582+0000 7f81ba200700 1 -- 172.21.15.146:0/2367860298 wait complete. 2024-05-03T16:36:48.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.583+0000 7f81ba200700 1 Processor -- start 2024-05-03T16:36:48.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.584+0000 7f81ba200700 1 -- start start 2024-05-03T16:36:48.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.584+0000 7f81ba200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81b4104030 0x7f81b41995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:36:48.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.584+0000 7f81ba200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b4106960 0x7f81b4199b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:36:48.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.584+0000 7f81ba200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b4109290 0x7f81b41a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:36:48.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.584+0000 7f81ba200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f81b410ee80 con 0x7f81b4106960 2024-05-03T16:36:48.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.584+0000 7f81ba200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f81b410ed00 con 0x7f81b4109290 2024-05-03T16:36:48.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.584+0000 7f81ba200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f81b410f000 con 0x7f81b4104030 2024-05-03T16:36:48.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.585+0000 7f81b2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b4106960 0x7f81b4199b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:36:48.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.585+0000 7f81b3400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81b4104030 0x7f81b41995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:36:48.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.585+0000 7f81b3e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b4109290 0x7f81b41a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:36:48.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.585+0000 7f81b2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b4106960 0x7f81b4199b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.146:35770/0 (socket says 172.21.15.146:35770) 2024-05-03T16:36:48.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.585+0000 7f81b2a00700 1 -- 172.21.15.146:0/4019889130 learned_addr learned my addr 172.21.15.146:0/4019889130 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-05-03T16:36:48.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.585+0000 7f81b3400700 1 -- 172.21.15.146:0/4019889130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b4109290 msgr2=0x7f81b41a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:36:48.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.585+0000 7f81b3400700 1 --2- 172.21.15.146:0/4019889130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b4109290 0x7f81b41a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:36:48.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.585+0000 7f81b3400700 1 -- 172.21.15.146:0/4019889130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b4106960 msgr2=0x7f81b4199b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:36:48.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.585+0000 7f81b3400700 1 --2- 172.21.15.146:0/4019889130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b4106960 0x7f81b4199b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:36:48.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.585+0000 7f81b3400700 1 -- 172.21.15.146:0/4019889130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b41a1220 con 0x7f81b4104030 2024-05-03T16:36:48.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.586+0000 7f81b3400700 1 --2- 172.21.15.146:0/4019889130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81b4104030 0x7f81b41995c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f81a400d980 tx=0x7f81a400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:36:48.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.586+0000 7f81abe00700 1 -- 172.21.15.146:0/4019889130 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a4017070 con 0x7f81b4104030 2024-05-03T16:36:48.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.586+0000 7f81abe00700 1 -- 172.21.15.146:0/4019889130 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81a400fd20 con 0x7f81b4104030 2024-05-03T16:36:48.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.586+0000 7f81abe00700 1 -- 172.21.15.146:0/4019889130 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a400e3b0 con 0x7f81b4104030 2024-05-03T16:36:48.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.586+0000 7f81ba200700 1 -- 172.21.15.146:0/4019889130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b41a1510 con 0x7f81b4104030 2024-05-03T16:36:48.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.586+0000 7f81ba200700 1 -- 172.21.15.146:0/4019889130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b41a1aa0 con 0x7f81b4104030 2024-05-03T16:36:48.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.587+0000 7f81ba200700 1 -- 172.21.15.146:0/4019889130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81b406a190 con 0x7f81b4104030 2024-05-03T16:36:48.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.590+0000 7f81abe00700 1 -- 172.21.15.146:0/4019889130 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f81a401a070 con 0x7f81b4104030 2024-05-03T16:36:48.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.591+0000 7f81abe00700 1 --2- 172.21.15.146:0/4019889130 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f81980b2870 0x7f81980b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:36:48.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.591+0000 7f81abe00700 1 -- 172.21.15.146:0/4019889130 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f81a40e0150 con 0x7f81b4104030 2024-05-03T16:36:48.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.592+0000 7f81b2a00700 1 --2- 172.21.15.146:0/4019889130 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f81980b2870 0x7f81980b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:36:48.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.592+0000 7f81b2a00700 1 --2- 172.21.15.146:0/4019889130 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f81980b2870 0x7f81980b4d30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f81a000bd30 tx=0x7f81a000b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:36:48.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.595+0000 7f81abe00700 1 -- 172.21.15.146:0/4019889130 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f81a40a96a0 con 0x7f81b4104030 2024-05-03T16:36:48.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:36:48.837+0000 7f81ba200700 1 -- 172.21.15.146:0/4019889130 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f81b40638e0 con 0x7f81980b2870 2024-05-03T16:36:50.037 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:49 smithi146 ceph-mon[32357]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:50.037 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:49 smithi146 ceph-mon[32357]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:36:50.037 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:49 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:36:50.038 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:49 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:36:50.038 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:49 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:50.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:49 smithi134 ceph-mon[31708]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:50.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:49 smithi134 ceph-mon[31708]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:36:50.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:49 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:36:50.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:49 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:36:50.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:49 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:50.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:49 smithi081 ceph-mon[28640]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:50.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:49 smithi081 ceph-mon[28640]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:36:50.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:49 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:36:50.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:49 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:36:50.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:49 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:36:52.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:51 smithi146 ceph-mon[32357]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:52.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:51 smithi134 ceph-mon[31708]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:52.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:51 smithi081 ceph-mon[28640]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:53.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:52 smithi146 ceph-mon[32357]: from='client.? 172.21.15.146:0/2081584170' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79ec9995-50e8-4eaf-935a-39a479925734"}]: dispatch 2024-05-03T16:36:53.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:52 smithi146 ceph-mon[32357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79ec9995-50e8-4eaf-935a-39a479925734"}]: dispatch 2024-05-03T16:36:53.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:52 smithi146 ceph-mon[32357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79ec9995-50e8-4eaf-935a-39a479925734"}]': finished 2024-05-03T16:36:53.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:52 smithi146 ceph-mon[32357]: osdmap e15: 3 total, 2 up, 3 in 2024-05-03T16:36:53.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:52 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T16:36:53.081 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:52 smithi134 ceph-mon[31708]: from='client.? 172.21.15.146:0/2081584170' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79ec9995-50e8-4eaf-935a-39a479925734"}]: dispatch 2024-05-03T16:36:53.081 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:52 smithi134 ceph-mon[31708]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79ec9995-50e8-4eaf-935a-39a479925734"}]: dispatch 2024-05-03T16:36:53.081 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:52 smithi134 ceph-mon[31708]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79ec9995-50e8-4eaf-935a-39a479925734"}]': finished 2024-05-03T16:36:53.081 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:52 smithi134 ceph-mon[31708]: osdmap e15: 3 total, 2 up, 3 in 2024-05-03T16:36:53.081 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:52 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T16:36:53.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:52 smithi081 ceph-mon[28640]: from='client.? 172.21.15.146:0/2081584170' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79ec9995-50e8-4eaf-935a-39a479925734"}]: dispatch 2024-05-03T16:36:53.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:52 smithi081 ceph-mon[28640]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79ec9995-50e8-4eaf-935a-39a479925734"}]: dispatch 2024-05-03T16:36:53.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:52 smithi081 ceph-mon[28640]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79ec9995-50e8-4eaf-935a-39a479925734"}]': finished 2024-05-03T16:36:53.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:52 smithi081 ceph-mon[28640]: osdmap e15: 3 total, 2 up, 3 in 2024-05-03T16:36:53.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:52 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T16:36:54.023 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:53 smithi134 ceph-mon[31708]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:54.023 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:53 smithi134 ceph-mon[31708]: from='client.? 172.21.15.146:0/1183865836' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:36:54.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:53 smithi146 ceph-mon[32357]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:54.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:53 smithi146 ceph-mon[32357]: from='client.? 172.21.15.146:0/1183865836' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:36:54.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:53 smithi081 ceph-mon[28640]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:54.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:53 smithi081 ceph-mon[28640]: from='client.? 172.21.15.146:0/1183865836' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:36:56.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:55 smithi146 ceph-mon[32357]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:56.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:55 smithi134 ceph-mon[31708]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:56.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:55 smithi081 ceph-mon[28640]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:58.043 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:57 smithi081 ceph-mon[28640]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:58.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:57 smithi146 ceph-mon[32357]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:36:58.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:57 smithi134 ceph-mon[31708]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:00.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:36:59 smithi146 ceph-mon[32357]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:00.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:36:59 smithi134 ceph-mon[31708]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:00.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:36:59 smithi081 ceph-mon[28640]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:02.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:01 smithi146 ceph-mon[32357]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:02.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:01 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-03T16:37:02.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:01 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:02.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:01 smithi134 ceph-mon[31708]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:01 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-03T16:37:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:01 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:02.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:01 smithi081 ceph-mon[28640]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:02.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:01 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-03T16:37:02.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:01 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:03.007 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:02 smithi146 ceph-mon[32357]: Deploying daemon osd.2 on smithi146 2024-05-03T16:37:03.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:02 smithi134 ceph-mon[31708]: Deploying daemon osd.2 on smithi146 2024-05-03T16:37:03.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:02 smithi081 ceph-mon[28640]: Deploying daemon osd.2 on smithi146 2024-05-03T16:37:03.987 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:03 smithi146 ceph-mon[32357]: pgmap v94: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:04.160 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:03 smithi134 ceph-mon[31708]: pgmap v94: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:04.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:03 smithi081 ceph-mon[28640]: pgmap v94: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:06.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:05 smithi146 ceph-mon[32357]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:06.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:05 smithi134 ceph-mon[31708]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:06.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:05 smithi081 ceph-mon[28640]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:08.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:07 smithi134 ceph-mon[31708]: pgmap v96: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:08.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:07 smithi081 ceph-mon[28640]: pgmap v96: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:08.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:07 smithi146 ceph-mon[32357]: pgmap v96: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:10.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:09 smithi134 ceph-mon[31708]: pgmap v97: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:10.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:09 smithi081 ceph-mon[28640]: pgmap v97: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:10.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:09 smithi146 ceph-mon[32357]: pgmap v97: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:11.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:11 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:11.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:11 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:11.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:11 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:37:11.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:11 smithi146 ceph-mon[32357]: pgmap v98: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:11.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:11 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:11.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:11 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:11.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:11 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:37:11.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:11 smithi134 ceph-mon[31708]: pgmap v98: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:11.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:11 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:11.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:11 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:11.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:11 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:37:11.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:11 smithi081 ceph-mon[28640]: pgmap v98: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:13.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:13 smithi146 ceph-mon[32357]: pgmap v99: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:13.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:13 smithi134 ceph-mon[31708]: pgmap v99: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:13.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:13 smithi081 ceph-mon[28640]: pgmap v99: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:14.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:14 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:14.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:14 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:14.814 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:14 smithi146 ceph-mon[32357]: from='osd.2 [v2:172.21.15.146:6800/1233108455,v1:172.21.15.146:6801/1233108455]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-03T16:37:14.814 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:14 smithi146 ceph-mon[32357]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-03T16:37:14.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:14 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:14.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:14 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:14.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:14 smithi134 ceph-mon[31708]: from='osd.2 [v2:172.21.15.146:6800/1233108455,v1:172.21.15.146:6801/1233108455]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-03T16:37:14.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:14 smithi134 ceph-mon[31708]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-03T16:37:14.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:37:14.966+0000 7f81abe00700 1 -- 172.21.15.146:0/4019889130 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f81b40638e0 con 0x7f81980b2870 2024-05-03T16:37:14.970 INFO:teuthology.orchestra.run.smithi146.stdout:Created osd(s) 2 on host 'smithi146' 2024-05-03T16:37:14.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:37:14.970+0000 7f81ba200700 1 -- 172.21.15.146:0/4019889130 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f81980b2870 msgr2=0x7f81980b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:37:14.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:37:14.970+0000 7f81ba200700 1 --2- 172.21.15.146:0/4019889130 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f81980b2870 0x7f81980b4d30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f81a000bd30 tx=0x7f81a000b480 comp rx=0 tx=0).stop 2024-05-03T16:37:14.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:37:14.970+0000 7f81ba200700 1 -- 172.21.15.146:0/4019889130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81b4104030 msgr2=0x7f81b41995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:37:14.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:37:14.970+0000 7f81ba200700 1 --2- 172.21.15.146:0/4019889130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81b4104030 0x7f81b41995c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f81a400d980 tx=0x7f81a400dc90 comp rx=0 tx=0).stop 2024-05-03T16:37:14.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:37:14.970+0000 7f81ba200700 1 -- 172.21.15.146:0/4019889130 shutdown_connections 2024-05-03T16:37:14.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:37:14.970+0000 7f81ba200700 1 --2- 172.21.15.146:0/4019889130 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f81980b2870 0x7f81980b4d30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:37:14.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:37:14.970+0000 7f81ba200700 1 --2- 172.21.15.146:0/4019889130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81b4104030 0x7f81b41995c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:37:14.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:37:14.970+0000 7f81ba200700 1 --2- 172.21.15.146:0/4019889130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b4109290 0x7f81b41a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:37:14.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:37:14.970+0000 7f81ba200700 1 --2- 172.21.15.146:0/4019889130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b4106960 0x7f81b4199b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:37:14.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:37:14.970+0000 7f81ba200700 1 -- 172.21.15.146:0/4019889130 >> 172.21.15.146:0/4019889130 conn(0x7f81b40fd9a0 msgr2=0x7f81b4105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:37:14.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:37:14.971+0000 7f81ba200700 1 -- 172.21.15.146:0/4019889130 shutdown_connections 2024-05-03T16:37:14.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:37:14.971+0000 7f81ba200700 1 -- 172.21.15.146:0/4019889130 wait complete. 2024-05-03T16:37:14.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:14 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:14.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:14 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:14.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:14 smithi081 ceph-mon[28640]: from='osd.2 [v2:172.21.15.146:6800/1233108455,v1:172.21.15.146:6801/1233108455]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-03T16:37:14.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:14 smithi081 ceph-mon[28640]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-03T16:37:15.697 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:15 smithi146 ceph-mon[32357]: pgmap v100: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:15.697 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:15 smithi146 ceph-mon[32357]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-03T16:37:15.697 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:15 smithi146 ceph-mon[32357]: from='osd.2 [v2:172.21.15.146:6800/1233108455,v1:172.21.15.146:6801/1233108455]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:37:15.697 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:15 smithi146 ceph-mon[32357]: osdmap e16: 3 total, 2 up, 3 in 2024-05-03T16:37:15.697 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:15 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T16:37:15.697 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:15 smithi146 ceph-mon[32357]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:37:15.697 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:15 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:15.697 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:15 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:15.758 DEBUG:teuthology.orchestra.run.smithi146:osd.2> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.2.service 2024-05-03T16:37:15.763 INFO:tasks.cephadm:Deploying osd.3 on smithi081 with /dev/vg_nvme/lv_3... 2024-05-03T16:37:15.763 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-03T16:37:15.843 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:15 smithi081 ceph-mon[28640]: pgmap v100: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:15.843 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:15 smithi081 ceph-mon[28640]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-03T16:37:15.843 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:15 smithi081 ceph-mon[28640]: from='osd.2 [v2:172.21.15.146:6800/1233108455,v1:172.21.15.146:6801/1233108455]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:37:15.843 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:15 smithi081 ceph-mon[28640]: osdmap e16: 3 total, 2 up, 3 in 2024-05-03T16:37:15.843 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:15 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T16:37:15.843 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:15 smithi081 ceph-mon[28640]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:37:15.843 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:15 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:15.843 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:15 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:15.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:15 smithi134 ceph-mon[31708]: pgmap v100: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:15.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:15 smithi134 ceph-mon[31708]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-03T16:37:15.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:15 smithi134 ceph-mon[31708]: from='osd.2 [v2:172.21.15.146:6800/1233108455,v1:172.21.15.146:6801/1233108455]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:37:15.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:15 smithi134 ceph-mon[31708]: osdmap e16: 3 total, 2 up, 3 in 2024-05-03T16:37:15.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:15 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T16:37:15.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:15 smithi134 ceph-mon[31708]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:37:15.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:15 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:15.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:15 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:16.201 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:37:16.563 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 16:37:16 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-2[37362]: 2024-05-03T16:37:16.408+0000 7f125fe00700 -1 osd.2 0 waiting for initial osdmap 2024-05-03T16:37:16.564 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 16:37:16 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-2[37362]: 2024-05-03T16:37:16.424+0000 7f1255c00700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T16:37:16.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:16 smithi134 ceph-mon[31708]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-05-03T16:37:16.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:16 smithi134 ceph-mon[31708]: osdmap e17: 3 total, 2 up, 3 in 2024-05-03T16:37:16.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:16 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T16:37:16.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:16 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T16:37:16.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:16 smithi134 ceph-mon[31708]: from='osd.2 ' entity='osd.2' 2024-05-03T16:37:16.975 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:16 smithi146 ceph-mon[32357]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-05-03T16:37:16.975 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:16 smithi146 ceph-mon[32357]: osdmap e17: 3 total, 2 up, 3 in 2024-05-03T16:37:16.975 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:16 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T16:37:16.975 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:16 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T16:37:16.975 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:16 smithi146 ceph-mon[32357]: from='osd.2 ' entity='osd.2' 2024-05-03T16:37:16.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:16 smithi081 ceph-mon[28640]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-05-03T16:37:16.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:16 smithi081 ceph-mon[28640]: osdmap e17: 3 total, 2 up, 3 in 2024-05-03T16:37:16.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:16 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T16:37:16.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:16 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T16:37:16.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:16 smithi081 ceph-mon[28640]: from='osd.2 ' entity='osd.2' 2024-05-03T16:37:17.837 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:17 smithi081 ceph-mon[28640]: purged_snaps scrub starts 2024-05-03T16:37:17.837 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:17 smithi081 ceph-mon[28640]: purged_snaps scrub ok 2024-05-03T16:37:17.837 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:17 smithi081 ceph-mon[28640]: pgmap v103: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:17.837 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T16:37:17.837 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:17 smithi081 ceph-mon[28640]: osd.2 [v2:172.21.15.146:6800/1233108455,v1:172.21.15.146:6801/1233108455] boot 2024-05-03T16:37:17.837 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:17 smithi081 ceph-mon[28640]: osdmap e18: 3 total, 3 up, 3 in 2024-05-03T16:37:17.837 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T16:37:17.944 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:17 smithi146 ceph-mon[32357]: purged_snaps scrub starts 2024-05-03T16:37:17.944 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:17 smithi146 ceph-mon[32357]: purged_snaps scrub ok 2024-05-03T16:37:17.945 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:17 smithi146 ceph-mon[32357]: pgmap v103: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:17.945 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T16:37:17.945 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:17 smithi146 ceph-mon[32357]: osd.2 [v2:172.21.15.146:6800/1233108455,v1:172.21.15.146:6801/1233108455] boot 2024-05-03T16:37:17.945 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:17 smithi146 ceph-mon[32357]: osdmap e18: 3 total, 3 up, 3 in 2024-05-03T16:37:17.945 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T16:37:17.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:17 smithi134 ceph-mon[31708]: purged_snaps scrub starts 2024-05-03T16:37:17.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:17 smithi134 ceph-mon[31708]: purged_snaps scrub ok 2024-05-03T16:37:17.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:17 smithi134 ceph-mon[31708]: pgmap v103: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T16:37:17.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T16:37:17.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:17 smithi134 ceph-mon[31708]: osd.2 [v2:172.21.15.146:6800/1233108455,v1:172.21.15.146:6801/1233108455] boot 2024-05-03T16:37:17.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:17 smithi134 ceph-mon[31708]: osdmap e18: 3 total, 3 up, 3 in 2024-05-03T16:37:17.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T16:37:18.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:18 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-03T16:37:18.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:18 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-03T16:37:18.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:18 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-03T16:37:19.060 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-03T16:37:19.061 INFO:teuthology.orchestra.run.smithi081.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-03T16:37:19.061 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10+0 records in 2024-05-03T16:37:19.061 INFO:teuthology.orchestra.run.smithi081.stderr:10+0 records out 2024-05-03T16:37:19.061 INFO:teuthology.orchestra.run.smithi081.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0344265 s, 305 MB/s 2024-05-03T16:37:19.061 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping successful for: 2024-05-03T16:37:19.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:19 smithi081 ceph-mon[28640]: pgmap v105: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:19.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-03T16:37:19.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:19 smithi081 ceph-mon[28640]: osdmap e19: 3 total, 3 up, 3 in 2024-05-03T16:37:19.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-03T16:37:19.929 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_3 2024-05-03T16:37:19.950 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:19 smithi146 ceph-mon[32357]: pgmap v105: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:19.950 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:19 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-03T16:37:19.950 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:19 smithi146 ceph-mon[32357]: osdmap e19: 3 total, 3 up, 3 in 2024-05-03T16:37:19.951 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:19 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-03T16:37:19.962 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:19 smithi134 ceph-mon[31708]: pgmap v105: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:19.962 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:19 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-03T16:37:19.962 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:19 smithi134 ceph-mon[31708]: osdmap e19: 3 total, 3 up, 3 in 2024-05-03T16:37:19.962 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:19 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-03T16:37:20.202 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 16:37:20 smithi146 sudo[40989]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-03T16:37:20.202 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 16:37:20 smithi146 sudo[40989]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T16:37:20.202 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 16:37:20 smithi146 sudo[40989]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T16:37:20.202 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 16:37:20 smithi146 sudo[40989]: pam_unix(sudo:session): session closed for user root 2024-05-03T16:37:20.202 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 16:37:20 smithi146 sudo[40992]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-03T16:37:20.202 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 16:37:20 smithi146 sudo[40992]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T16:37:20.202 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 16:37:20 smithi146 sudo[40992]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T16:37:20.202 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 16:37:20 smithi146 sudo[40992]: pam_unix(sudo:session): session closed for user root 2024-05-03T16:37:20.217 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 16:37:19 smithi134 sudo[40146]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-03T16:37:20.217 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 16:37:19 smithi134 sudo[40146]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T16:37:20.217 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 16:37:19 smithi134 sudo[40146]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T16:37:20.218 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 16:37:19 smithi134 sudo[40146]: pam_unix(sudo:session): session closed for user root 2024-05-03T16:37:20.218 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 16:37:20 smithi134 sudo[40149]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-03T16:37:20.218 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 16:37:20 smithi134 sudo[40149]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T16:37:20.218 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 16:37:20 smithi134 sudo[40149]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T16:37:20.218 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 16:37:20 smithi134 sudo[40149]: pam_unix(sudo:session): session closed for user root 2024-05-03T16:37:20.240 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 16:37:19 smithi081 sudo[45191]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-03T16:37:20.240 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 16:37:19 smithi081 sudo[45191]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T16:37:20.240 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 16:37:19 smithi081 sudo[45191]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T16:37:20.240 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 16:37:19 smithi081 sudo[45191]: pam_unix(sudo:session): session closed for user root 2024-05-03T16:37:20.241 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 16:37:19 smithi081 sudo[45194]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-03T16:37:20.241 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 16:37:19 smithi081 sudo[45194]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T16:37:20.241 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 16:37:19 smithi081 sudo[45194]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T16:37:20.241 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 16:37:19 smithi081 sudo[45194]: pam_unix(sudo:session): session closed for user root 2024-05-03T16:37:20.357 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:37:20.561 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 sudo[45237]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-03T16:37:20.561 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 sudo[45237]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T16:37:20.561 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 sudo[45237]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T16:37:20.561 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 sudo[45237]: pam_unix(sudo:session): session closed for user root 2024-05-03T16:37:20.562 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 sudo[45251]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-03T16:37:20.562 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 sudo[45251]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T16:37:20.562 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 sudo[45251]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T16:37:20.562 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 sudo[45251]: pam_unix(sudo:session): session closed for user root 2024-05-03T16:37:20.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 sudo[40997]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-03T16:37:20.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 sudo[40997]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T16:37:20.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 sudo[40997]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T16:37:20.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 sudo[40997]: pam_unix(sudo:session): session closed for user root 2024-05-03T16:37:20.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 sudo[41000]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-03T16:37:20.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 sudo[41000]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T16:37:20.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 sudo[41000]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T16:37:20.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 sudo[41000]: pam_unix(sudo:session): session closed for user root 2024-05-03T16:37:20.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-03T16:37:20.910 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: osdmap e20: 3 total, 3 up, 3 in 2024-05-03T16:37:20.910 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:20.910 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:20.910 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:20.910 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T16:37:20.910 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T16:37:20.910 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T16:37:20.910 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:37:20.910 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:37:20.910 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T16:37:20.910 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T16:37:20.911 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:37:20.911 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:37:20.911 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T16:37:20.911 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T16:37:20.911 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T16:37:20.911 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:37:20.911 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:37:20.911 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:20 smithi081 ceph-mon[28640]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T16:37:20.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 sudo[40152]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-03T16:37:20.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 sudo[40152]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T16:37:20.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 sudo[40152]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T16:37:20.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 sudo[40152]: pam_unix(sudo:session): session closed for user root 2024-05-03T16:37:20.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 sudo[40155]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-03T16:37:20.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 sudo[40155]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T16:37:20.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 sudo[40155]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T16:37:20.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 sudo[40155]: pam_unix(sudo:session): session closed for user root 2024-05-03T16:37:20.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-03T16:37:20.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: osdmap e20: 3 total, 3 up, 3 in 2024-05-03T16:37:20.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:20.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:20.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:20.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T16:37:20.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T16:37:20.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T16:37:20.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:37:20.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:37:20.969 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T16:37:20.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T16:37:20.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:37:20.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:37:20.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T16:37:20.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T16:37:20.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T16:37:20.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:37:20.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:37:20.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:20 smithi134 ceph-mon[31708]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T16:37:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-03T16:37:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: osdmap e20: 3 total, 3 up, 3 in 2024-05-03T16:37:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:21.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T16:37:21.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T16:37:21.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T16:37:21.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:37:21.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:37:21.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T16:37:21.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T16:37:21.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:37:21.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:37:21.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T16:37:21.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T16:37:21.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T16:37:21.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T16:37:21.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T16:37:21.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:20 smithi146 ceph-mon[32357]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T16:37:21.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:21 smithi134 ceph-mon[31708]: pgmap v108: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:21.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:21 smithi134 ceph-mon[31708]: osdmap e21: 3 total, 3 up, 3 in 2024-05-03T16:37:21.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:21 smithi134 ceph-mon[31708]: Detected new or changed devices on smithi146 2024-05-03T16:37:21.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:21.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:21.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:37:21.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:21 smithi134 ceph-mon[31708]: Adjusting osd_memory_target on smithi146 to 17089M 2024-05-03T16:37:21.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:21.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:21.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:37:21.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:21.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:21 smithi134 ceph-mon[31708]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-05-03T16:37:21.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:37:21.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:21.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:37:21.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:21.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:21 smithi081 ceph-mon[28640]: pgmap v108: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:21.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:21 smithi081 ceph-mon[28640]: osdmap e21: 3 total, 3 up, 3 in 2024-05-03T16:37:21.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:21 smithi081 ceph-mon[28640]: Detected new or changed devices on smithi146 2024-05-03T16:37:21.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:21.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:21.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:37:21.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:21 smithi081 ceph-mon[28640]: Adjusting osd_memory_target on smithi146 to 17089M 2024-05-03T16:37:21.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:21.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:21.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:37:21.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:21.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:21 smithi081 ceph-mon[28640]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-05-03T16:37:21.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:37:21.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:21.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:37:21.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:22.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:21 smithi146 ceph-mon[32357]: pgmap v108: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:22.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:21 smithi146 ceph-mon[32357]: osdmap e21: 3 total, 3 up, 3 in 2024-05-03T16:37:22.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:21 smithi146 ceph-mon[32357]: Detected new or changed devices on smithi146 2024-05-03T16:37:22.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:22.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:22.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:37:22.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:21 smithi146 ceph-mon[32357]: Adjusting osd_memory_target on smithi146 to 17089M 2024-05-03T16:37:22.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:22.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:22.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:37:22.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:22.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:21 smithi146 ceph-mon[32357]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-05-03T16:37:22.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:37:22.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:22.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:37:22.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.634+0000 7f2dea200700 1 -- 172.21.15.81:0/362596887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2de4109a30 msgr2=0x7f2de4109e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:37:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.634+0000 7f2dea200700 1 --2- 172.21.15.81:0/362596887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2de4109a30 0x7f2de4109e50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80099c0 tx=0x7f2dd8009cd0 comp rx=0 tx=0).stop 2024-05-03T16:37:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.634+0000 7f2dea200700 1 -- 172.21.15.81:0/362596887 shutdown_connections 2024-05-03T16:37:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.634+0000 7f2dea200700 1 --2- 172.21.15.81:0/362596887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de410b5d0 0x7f2de4111e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:37:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.634+0000 7f2dea200700 1 --2- 172.21.15.81:0/362596887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2de4109a30 0x7f2de4109e50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:37:22.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.634+0000 7f2dea200700 1 --2- 172.21.15.81:0/362596887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2de410ac30 0x7f2de410b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:37:22.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.634+0000 7f2dea200700 1 -- 172.21.15.81:0/362596887 >> 172.21.15.81:0/362596887 conn(0x7f2de4078a00 msgr2=0x7f2de407ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:37:22.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.635+0000 7f2dea200700 1 -- 172.21.15.81:0/362596887 shutdown_connections 2024-05-03T16:37:22.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.635+0000 7f2dea200700 1 -- 172.21.15.81:0/362596887 wait complete. 2024-05-03T16:37:22.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.636+0000 7f2dea200700 1 Processor -- start 2024-05-03T16:37:22.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.636+0000 7f2dea200700 1 -- start start 2024-05-03T16:37:22.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.636+0000 7f2dea200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2de4109a30 0x7f2de419fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:37:22.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.636+0000 7f2dea200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de410ac30 0x7f2de419ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:37:22.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.636+0000 7f2dea200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2de410b5d0 0x7f2de41a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:37:22.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.636+0000 7f2dea200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2de41153c0 con 0x7f2de410b5d0 2024-05-03T16:37:22.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.636+0000 7f2dea200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2de4115240 con 0x7f2de4109a30 2024-05-03T16:37:22.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.636+0000 7f2dea200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2de4115540 con 0x7f2de410ac30 2024-05-03T16:37:22.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.636+0000 7f2de9800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2de410b5d0 0x7f2de41a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:37:22.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.636+0000 7f2de9800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2de410b5d0 0x7f2de41a7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42850/0 (socket says 172.21.15.81:42850) 2024-05-03T16:37:22.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.636+0000 7f2de9800700 1 -- 172.21.15.81:0/1874636701 learned_addr learned my addr 172.21.15.81:0/1874636701 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:37:22.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.637+0000 7f2de3e00700 1 --2- 172.21.15.81:0/1874636701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de410ac30 0x7f2de419ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:37:22.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.637+0000 7f2de8e00700 1 --2- 172.21.15.81:0/1874636701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2de4109a30 0x7f2de419fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:37:22.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.637+0000 7f2de9800700 1 -- 172.21.15.81:0/1874636701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de410ac30 msgr2=0x7f2de419ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:37:22.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.637+0000 7f2de9800700 1 --2- 172.21.15.81:0/1874636701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de410ac30 0x7f2de419ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:37:22.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.637+0000 7f2de9800700 1 -- 172.21.15.81:0/1874636701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2de4109a30 msgr2=0x7f2de419fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:37:22.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.637+0000 7f2de9800700 1 --2- 172.21.15.81:0/1874636701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2de4109a30 0x7f2de419fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:37:22.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.637+0000 7f2de9800700 1 -- 172.21.15.81:0/1874636701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de41a76c0 con 0x7f2de410b5d0 2024-05-03T16:37:22.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.637+0000 7f2de9800700 1 --2- 172.21.15.81:0/1874636701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2de410b5d0 0x7f2de41a7020 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00add0 tx=0x7f2ddc00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:37:22.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.637+0000 7f2de1600700 1 -- 172.21.15.81:0/1874636701 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc017020 con 0x7f2de410b5d0 2024-05-03T16:37:22.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.637+0000 7f2de1600700 1 -- 172.21.15.81:0/1874636701 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ddc00cdd0 con 0x7f2de410b5d0 2024-05-03T16:37:22.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.637+0000 7f2dea200700 1 -- 172.21.15.81:0/1874636701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de41a79b0 con 0x7f2de410b5d0 2024-05-03T16:37:22.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.638+0000 7f2de1600700 1 -- 172.21.15.81:0/1874636701 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc005330 con 0x7f2de410b5d0 2024-05-03T16:37:22.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.638+0000 7f2dea200700 1 -- 172.21.15.81:0/1874636701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de41a7f40 con 0x7f2de410b5d0 2024-05-03T16:37:22.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.639+0000 7f2dea200700 1 -- 172.21.15.81:0/1874636701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de406a190 con 0x7f2de410b5d0 2024-05-03T16:37:22.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.641+0000 7f2de1600700 1 -- 172.21.15.81:0/1874636701 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f2ddc004ad0 con 0x7f2de410b5d0 2024-05-03T16:37:22.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.643+0000 7f2de1600700 1 --2- 172.21.15.81:0/1874636701 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f2dcc0b2980 0x7f2dcc0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:37:22.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.643+0000 7f2de1600700 1 -- 172.21.15.81:0/1874636701 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3237+0+0 (secure 0 0 0) 0x7f2ddc0e05e0 con 0x7f2de410b5d0 2024-05-03T16:37:22.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.643+0000 7f2de8e00700 1 --2- 172.21.15.81:0/1874636701 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f2dcc0b2980 0x7f2dcc0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:37:22.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.644+0000 7f2de8e00700 1 --2- 172.21.15.81:0/1874636701 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f2dcc0b2980 0x7f2dcc0b4e40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009990 tx=0x7f2dd801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:37:22.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.648+0000 7f2de1600700 1 -- 172.21.15.81:0/1874636701 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f2ddc021020 con 0x7f2de410b5d0 2024-05-03T16:37:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:22.886+0000 7f2dea200700 1 -- 172.21.15.81:0/1874636701 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2de40638e0 con 0x7f2dcc0b2980 2024-05-03T16:37:23.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:23 smithi081 ceph-mon[28640]: pgmap v110: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:23.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:23 smithi081 ceph-mon[28640]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:37:23.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:23 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:37:23.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:23 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:37:23.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:23 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:23.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:23 smithi134 ceph-mon[31708]: pgmap v110: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:23.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:23 smithi134 ceph-mon[31708]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:37:23.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:23 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:37:23.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:23 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:37:23.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:23 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:24.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:23 smithi146 ceph-mon[32357]: pgmap v110: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:24.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:23 smithi146 ceph-mon[32357]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:37:24.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:23 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:37:24.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:23 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:37:24.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:23 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:25.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:25 smithi134 ceph-mon[31708]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:25.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:25 smithi081 ceph-mon[28640]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:26.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:25 smithi146 ceph-mon[32357]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:27 smithi134 ceph-mon[31708]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:27 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2395249661' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d38f4e7-73c3-4e70-9f87-d44da28db452"}]: dispatch 2024-05-03T16:37:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:27 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2395249661' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2d38f4e7-73c3-4e70-9f87-d44da28db452"}]': finished 2024-05-03T16:37:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:27 smithi134 ceph-mon[31708]: osdmap e22: 4 total, 3 up, 4 in 2024-05-03T16:37:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:27 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:27.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:27 smithi081 ceph-mon[28640]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:27.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:27 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2395249661' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d38f4e7-73c3-4e70-9f87-d44da28db452"}]: dispatch 2024-05-03T16:37:27.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:27 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2395249661' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2d38f4e7-73c3-4e70-9f87-d44da28db452"}]': finished 2024-05-03T16:37:27.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:27 smithi081 ceph-mon[28640]: osdmap e22: 4 total, 3 up, 4 in 2024-05-03T16:37:27.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:27 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:28.041 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:27 smithi146 ceph-mon[32357]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:28.041 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:27 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2395249661' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d38f4e7-73c3-4e70-9f87-d44da28db452"}]: dispatch 2024-05-03T16:37:28.041 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:27 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2395249661' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2d38f4e7-73c3-4e70-9f87-d44da28db452"}]': finished 2024-05-03T16:37:28.041 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:27 smithi146 ceph-mon[32357]: osdmap e22: 4 total, 3 up, 4 in 2024-05-03T16:37:28.041 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:27 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:28.927 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:28 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/28900354' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:37:28.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:28 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/28900354' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:37:29.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:28 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/28900354' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:37:29.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:29 smithi134 ceph-mon[31708]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:29.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:29 smithi081 ceph-mon[28640]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:30.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:29 smithi146 ceph-mon[32357]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:31.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:31 smithi081 ceph-mon[28640]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:31 smithi134 ceph-mon[31708]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:32.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:31 smithi146 ceph-mon[32357]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:33.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:33 smithi134 ceph-mon[31708]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:33.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:33 smithi081 ceph-mon[28640]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:34.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:33 smithi146 ceph-mon[32357]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:35.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:35 smithi134 ceph-mon[31708]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:35.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:35 smithi081 ceph-mon[28640]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:36.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:35 smithi146 ceph-mon[32357]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:36.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:36 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-03T16:37:36.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:36 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:36.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:36 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-03T16:37:36.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:36 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:37.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:36 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-03T16:37:37.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:36 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:37.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:37 smithi134 ceph-mon[31708]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:37.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:37 smithi134 ceph-mon[31708]: Deploying daemon osd.3 on smithi081 2024-05-03T16:37:37.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:37 smithi081 ceph-mon[28640]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:37.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:37 smithi081 ceph-mon[28640]: Deploying daemon osd.3 on smithi081 2024-05-03T16:37:38.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:37 smithi146 ceph-mon[32357]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:38.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:37 smithi146 ceph-mon[32357]: Deploying daemon osd.3 on smithi081 2024-05-03T16:37:39.918 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:39 smithi081 ceph-mon[28640]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:40.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:39 smithi146 ceph-mon[32357]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:40.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:39 smithi134 ceph-mon[31708]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:41.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:41 smithi081 ceph-mon[28640]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:42.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:41 smithi146 ceph-mon[32357]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:42.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:41 smithi134 ceph-mon[31708]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:43.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:43 smithi081 ceph-mon[28640]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:44.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:43 smithi146 ceph-mon[32357]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:44.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:43 smithi134 ceph-mon[31708]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:45.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:45 smithi081 ceph-mon[28640]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:45.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:45 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:45.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:45 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:45.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:45 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:37:46.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:45 smithi146 ceph-mon[32357]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:46.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:45 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:46.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:45 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:46.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:45 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:37:46.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:45 smithi134 ceph-mon[31708]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:46.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:45 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:46.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:45 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:46.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:45 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:37:48.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:47 smithi146 ceph-mon[32357]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:48.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:47 smithi134 ceph-mon[31708]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:48.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:47 smithi081 ceph-mon[28640]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:49.732 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:49 smithi081 ceph-mon[28640]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:49.733 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:49 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:49.733 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:49 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:49.733 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:49 smithi081 ceph-mon[28640]: from='osd.3 [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-03T16:37:49.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:49 smithi146 ceph-mon[32357]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:49.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:49 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:49.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:49 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:49.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:49 smithi146 ceph-mon[32357]: from='osd.3 [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-03T16:37:49.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:49.835+0000 7f2de1600700 1 -- 172.21.15.81:0/1874636701 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2de40638e0 con 0x7f2dcc0b2980 2024-05-03T16:37:49.838 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 3 on host 'smithi081' 2024-05-03T16:37:49.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:49.840+0000 7f2dea200700 1 -- 172.21.15.81:0/1874636701 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f2dcc0b2980 msgr2=0x7f2dcc0b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:37:49.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:49.840+0000 7f2dea200700 1 --2- 172.21.15.81:0/1874636701 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f2dcc0b2980 0x7f2dcc0b4e40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009990 tx=0x7f2dd801a040 comp rx=0 tx=0).stop 2024-05-03T16:37:49.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:49.840+0000 7f2dea200700 1 -- 172.21.15.81:0/1874636701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2de410b5d0 msgr2=0x7f2de41a7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:37:49.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:49.840+0000 7f2dea200700 1 --2- 172.21.15.81:0/1874636701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2de410b5d0 0x7f2de41a7020 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00add0 tx=0x7f2ddc00c330 comp rx=0 tx=0).stop 2024-05-03T16:37:49.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:49.840+0000 7f2dea200700 1 -- 172.21.15.81:0/1874636701 shutdown_connections 2024-05-03T16:37:49.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:49.840+0000 7f2dea200700 1 --2- 172.21.15.81:0/1874636701 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f2dcc0b2980 0x7f2dcc0b4e40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:37:49.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:49.840+0000 7f2dea200700 1 --2- 172.21.15.81:0/1874636701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2de410b5d0 0x7f2de41a7020 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:37:49.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:49.840+0000 7f2dea200700 1 --2- 172.21.15.81:0/1874636701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2de4109a30 0x7f2de419fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:37:49.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:49.840+0000 7f2dea200700 1 --2- 172.21.15.81:0/1874636701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de410ac30 0x7f2de419ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:37:49.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:49.840+0000 7f2dea200700 1 -- 172.21.15.81:0/1874636701 >> 172.21.15.81:0/1874636701 conn(0x7f2de4078a00 msgr2=0x7f2de410dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:37:49.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:49.840+0000 7f2dea200700 1 -- 172.21.15.81:0/1874636701 shutdown_connections 2024-05-03T16:37:49.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:37:49.840+0000 7f2dea200700 1 -- 172.21.15.81:0/1874636701 wait complete. 2024-05-03T16:37:49.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:49 smithi134 ceph-mon[31708]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:49.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:49 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:49.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:49 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:49.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:49 smithi134 ceph-mon[31708]: from='osd.3 [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-03T16:37:50.650 DEBUG:teuthology.orchestra.run.smithi081:osd.3> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.3.service 2024-05-03T16:37:50.655 INFO:tasks.cephadm:Deploying osd.4 on smithi134 with /dev/vg_nvme/lv_3... 2024-05-03T16:37:50.655 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-03T16:37:50.883 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:50 smithi081 ceph-mon[28640]: from='osd.3 [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-03T16:37:50.883 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:50 smithi081 ceph-mon[28640]: osdmap e23: 4 total, 3 up, 4 in 2024-05-03T16:37:50.883 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:50 smithi081 ceph-mon[28640]: from='osd.3 [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-03T16:37:50.883 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:50 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:50.883 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:50 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:50.883 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:50 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:50.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:50 smithi134 ceph-mon[31708]: from='osd.3 [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-03T16:37:50.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:50 smithi134 ceph-mon[31708]: osdmap e23: 4 total, 3 up, 4 in 2024-05-03T16:37:50.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:50 smithi134 ceph-mon[31708]: from='osd.3 [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-03T16:37:50.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:50 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:50.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:50 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:50.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:50 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:51.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:50 smithi146 ceph-mon[32357]: from='osd.3 [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-03T16:37:51.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:50 smithi146 ceph-mon[32357]: osdmap e23: 4 total, 3 up, 4 in 2024-05-03T16:37:51.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:50 smithi146 ceph-mon[32357]: from='osd.3 [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-03T16:37:51.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:50 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:51.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:50 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:51.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:50 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:51.096 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T16:37:51.911 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:51 smithi081 ceph-mon[28640]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:51.911 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:51 smithi081 ceph-mon[28640]: from='osd.3 [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-03T16:37:51.911 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:51 smithi081 ceph-mon[28640]: osdmap e24: 4 total, 3 up, 4 in 2024-05-03T16:37:51.911 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:51 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:51.911 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:51 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:51.912 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 16:37:51 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3[47677]: 2024-05-03T16:37:51.645+0000 7f68a0200700 -1 osd.3 0 waiting for initial osdmap 2024-05-03T16:37:51.912 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 16:37:51 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3[47677]: 2024-05-03T16:37:51.662+0000 7f6896000700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T16:37:51.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:51 smithi134 ceph-mon[31708]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:51.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:51 smithi134 ceph-mon[31708]: from='osd.3 [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-03T16:37:51.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:51 smithi134 ceph-mon[31708]: osdmap e24: 4 total, 3 up, 4 in 2024-05-03T16:37:51.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:51 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:51.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:51 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:52.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:51 smithi146 ceph-mon[32357]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:52.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:51 smithi146 ceph-mon[32357]: from='osd.3 [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-03T16:37:52.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:51 smithi146 ceph-mon[32357]: osdmap e24: 4 total, 3 up, 4 in 2024-05-03T16:37:52.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:51 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:52.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:51 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:52.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:52 smithi081 ceph-mon[28640]: purged_snaps scrub starts 2024-05-03T16:37:52.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:52 smithi081 ceph-mon[28640]: purged_snaps scrub ok 2024-05-03T16:37:52.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:52 smithi081 ceph-mon[28640]: osdmap e25: 4 total, 3 up, 4 in 2024-05-03T16:37:52.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:52 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:52.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:52 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:52.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:52 smithi081 ceph-mon[28640]: from='osd.3 [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465]' entity='osd.3' 2024-05-03T16:37:52.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:52 smithi081 ceph-mon[28640]: osd.3 [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465] boot 2024-05-03T16:37:52.742 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:52 smithi081 ceph-mon[28640]: osdmap e26: 4 total, 4 up, 4 in 2024-05-03T16:37:52.742 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:52 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:52.891 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:52 smithi134 ceph-mon[31708]: purged_snaps scrub starts 2024-05-03T16:37:52.891 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:52 smithi134 ceph-mon[31708]: purged_snaps scrub ok 2024-05-03T16:37:52.891 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:52 smithi134 ceph-mon[31708]: osdmap e25: 4 total, 3 up, 4 in 2024-05-03T16:37:52.891 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:52 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:52.891 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:52 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:52.891 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:52 smithi134 ceph-mon[31708]: from='osd.3 [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465]' entity='osd.3' 2024-05-03T16:37:52.892 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:52 smithi134 ceph-mon[31708]: osd.3 [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465] boot 2024-05-03T16:37:52.892 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:52 smithi134 ceph-mon[31708]: osdmap e26: 4 total, 4 up, 4 in 2024-05-03T16:37:52.892 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:52 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:53.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:52 smithi146 ceph-mon[32357]: purged_snaps scrub starts 2024-05-03T16:37:53.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:52 smithi146 ceph-mon[32357]: purged_snaps scrub ok 2024-05-03T16:37:53.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:52 smithi146 ceph-mon[32357]: osdmap e25: 4 total, 3 up, 4 in 2024-05-03T16:37:53.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:52 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:53.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:52 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:53.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:52 smithi146 ceph-mon[32357]: from='osd.3 [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465]' entity='osd.3' 2024-05-03T16:37:53.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:52 smithi146 ceph-mon[32357]: osd.3 [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465] boot 2024-05-03T16:37:53.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:52 smithi146 ceph-mon[32357]: osdmap e26: 4 total, 4 up, 4 in 2024-05-03T16:37:53.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:52 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T16:37:53.848 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:53 smithi134 ceph-mon[31708]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:53.849 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:53 smithi134 ceph-mon[31708]: osdmap e27: 4 total, 4 up, 4 in 2024-05-03T16:37:53.909 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-03T16:37:53.909 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-03T16:37:53.909 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-05-03T16:37:53.909 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-05-03T16:37:53.909 INFO:teuthology.orchestra.run.smithi134.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0340832 s, 308 MB/s 2024-05-03T16:37:53.910 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-05-03T16:37:53.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:53 smithi081 ceph-mon[28640]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:53.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:53 smithi081 ceph-mon[28640]: osdmap e27: 4 total, 4 up, 4 in 2024-05-03T16:37:54.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:53 smithi146 ceph-mon[32357]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T16:37:54.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:53 smithi146 ceph-mon[32357]: osdmap e27: 4 total, 4 up, 4 in 2024-05-03T16:37:54.710 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_3 2024-05-03T16:37:55.129 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T16:37:55.671 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:55 smithi134 ceph-mon[31708]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:37:55.671 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:55 smithi134 ceph-mon[31708]: osdmap e28: 4 total, 4 up, 4 in 2024-05-03T16:37:55.671 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:55.671 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:55.671 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:37:55.671 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:37:55.671 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:55.671 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:55.671 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:37:55.671 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:55.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:55 smithi081 ceph-mon[28640]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:37:55.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:55 smithi081 ceph-mon[28640]: osdmap e28: 4 total, 4 up, 4 in 2024-05-03T16:37:55.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:55.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:55.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:37:55.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:37:55.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:55.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:55.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:37:55.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:55 smithi146 ceph-mon[32357]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:37:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:55 smithi146 ceph-mon[32357]: osdmap e28: 4 total, 4 up, 4 in 2024-05-03T16:37:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:37:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:37:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:37:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:56.938 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:56 smithi134 ceph-mon[31708]: Detected new or changed devices on smithi081 2024-05-03T16:37:56.939 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:56 smithi134 ceph-mon[31708]: Adjusting osd_memory_target on smithi081 to 8544M 2024-05-03T16:37:56.939 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:56 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:37:56.939 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:56 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:56.939 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:56 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:37:56.939 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:56 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:56.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:56 smithi081 ceph-mon[28640]: Detected new or changed devices on smithi081 2024-05-03T16:37:56.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:56 smithi081 ceph-mon[28640]: Adjusting osd_memory_target on smithi081 to 8544M 2024-05-03T16:37:56.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:56 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:37:56.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:56 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:56.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:56 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:37:56.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:56 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:57.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:56 smithi146 ceph-mon[32357]: Detected new or changed devices on smithi081 2024-05-03T16:37:57.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:56 smithi146 ceph-mon[32357]: Adjusting osd_memory_target on smithi081 to 8544M 2024-05-03T16:37:57.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:56 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:37:57.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:56 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:57.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:56 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:37:57.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:56 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:37:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.109+0000 7f5f7d400700 1 -- 172.21.15.134:0/1570979467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f78103eb0 msgr2=0x7f5f781062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:37:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.109+0000 7f5f7d400700 1 --2- 172.21.15.134:0/1570979467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f78103eb0 0x7f5f781062a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009990 tx=0x7f5f68009ca0 comp rx=0 tx=0).stop 2024-05-03T16:37:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.109+0000 7f5f7d400700 1 -- 172.21.15.134:0/1570979467 shutdown_connections 2024-05-03T16:37:57.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.109+0000 7f5f7d400700 1 --2- 172.21.15.134:0/1570979467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f78109110 0x7f5f7810b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:37:57.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.109+0000 7f5f7d400700 1 --2- 172.21.15.134:0/1570979467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f78103eb0 0x7f5f781062a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:37:57.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.109+0000 7f5f7d400700 1 --2- 172.21.15.134:0/1570979467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f781067e0 0x7f5f78108bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:37:57.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.109+0000 7f5f7d400700 1 -- 172.21.15.134:0/1570979467 >> 172.21.15.134:0/1570979467 conn(0x7f5f780fd8c0 msgr2=0x7f5f780ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:37:57.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.109+0000 7f5f7d400700 1 -- 172.21.15.134:0/1570979467 shutdown_connections 2024-05-03T16:37:57.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.109+0000 7f5f7d400700 1 -- 172.21.15.134:0/1570979467 wait complete. 2024-05-03T16:37:57.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.110+0000 7f5f7d400700 1 Processor -- start 2024-05-03T16:37:57.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.111+0000 7f5f7d400700 1 -- start start 2024-05-03T16:37:57.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.111+0000 7f5f7d400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f78103eb0 0x7f5f7819b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:37:57.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.111+0000 7f5f7d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f781067e0 0x7f5f7819bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:37:57.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.111+0000 7f5f7d400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f78109110 0x7f5f781a2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:37:57.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.111+0000 7f5f7d400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7810ede0 con 0x7f5f781067e0 2024-05-03T16:37:57.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.111+0000 7f5f7d400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7810ec60 con 0x7f5f78109110 2024-05-03T16:37:57.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.111+0000 7f5f7d400700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7810ef60 con 0x7f5f78103eb0 2024-05-03T16:37:57.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.111+0000 7f5f7ca00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f78109110 0x7f5f781a2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:37:57.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.112+0000 7f5f7ca00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f78109110 0x7f5f781a2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48622/0 (socket says 172.21.15.134:48622) 2024-05-03T16:37:57.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.112+0000 7f5f7ca00700 1 -- 172.21.15.134:0/1173148765 learned_addr learned my addr 172.21.15.134:0/1173148765 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-05-03T16:37:57.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.112+0000 7f5f77e00700 1 --2- 172.21.15.134:0/1173148765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f78103eb0 0x7f5f7819b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:37:57.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.112+0000 7f5f77400700 1 --2- 172.21.15.134:0/1173148765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f781067e0 0x7f5f7819bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:37:57.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.112+0000 7f5f7ca00700 1 -- 172.21.15.134:0/1173148765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f78103eb0 msgr2=0x7f5f7819b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:37:57.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.112+0000 7f5f7ca00700 1 --2- 172.21.15.134:0/1173148765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f78103eb0 0x7f5f7819b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:37:57.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.112+0000 7f5f7ca00700 1 -- 172.21.15.134:0/1173148765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f781067e0 msgr2=0x7f5f7819bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:37:57.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.112+0000 7f5f7ca00700 1 --2- 172.21.15.134:0/1173148765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f781067e0 0x7f5f7819bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:37:57.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.112+0000 7f5f7ca00700 1 -- 172.21.15.134:0/1173148765 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f781a32e0 con 0x7f5f78109110 2024-05-03T16:37:57.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.112+0000 7f5f7ca00700 1 --2- 172.21.15.134:0/1173148765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f78109110 0x7f5f781a2c40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5f700094f0 tx=0x7f5f7000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:37:57.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.113+0000 7f5f74c00700 1 -- 172.21.15.134:0/1173148765 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7000ddd0 con 0x7f5f78109110 2024-05-03T16:37:57.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.113+0000 7f5f74c00700 1 -- 172.21.15.134:0/1173148765 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5f70009e20 con 0x7f5f78109110 2024-05-03T16:37:57.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.113+0000 7f5f74c00700 1 -- 172.21.15.134:0/1173148765 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70015400 con 0x7f5f78109110 2024-05-03T16:37:57.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.113+0000 7f5f7d400700 1 -- 172.21.15.134:0/1173148765 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f781a35d0 con 0x7f5f78109110 2024-05-03T16:37:57.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.113+0000 7f5f7d400700 1 -- 172.21.15.134:0/1173148765 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f781a3ac0 con 0x7f5f78109110 2024-05-03T16:37:57.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.114+0000 7f5f7d400700 1 -- 172.21.15.134:0/1173148765 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f7806a190 con 0x7f5f78109110 2024-05-03T16:37:57.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.116+0000 7f5f74c00700 1 -- 172.21.15.134:0/1173148765 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f5f70005020 con 0x7f5f78109110 2024-05-03T16:37:57.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.118+0000 7f5f74c00700 1 --2- 172.21.15.134:0/1173148765 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5f5c0b2900 0x7f5f5c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:37:57.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.118+0000 7f5f74c00700 1 -- 172.21.15.134:0/1173148765 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3669+0+0 (secure 0 0 0) 0x7f5f700e0a50 con 0x7f5f78109110 2024-05-03T16:37:57.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.118+0000 7f5f77e00700 1 --2- 172.21.15.134:0/1173148765 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5f5c0b2900 0x7f5f5c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:37:57.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.119+0000 7f5f77e00700 1 --2- 172.21.15.134:0/1173148765 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5f5c0b2900 0x7f5f5c0b4dc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5f6800b5c0 tx=0x7f5f68005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:37:57.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.122+0000 7f5f74c00700 1 -- 172.21.15.134:0/1173148765 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f5f70010070 con 0x7f5f78109110 2024-05-03T16:37:57.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:37:57.364+0000 7f5f7d400700 1 -- 172.21.15.134:0/1173148765 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f5f780638e0 con 0x7f5f5c0b2900 2024-05-03T16:37:58.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:57 smithi134 ceph-mon[31708]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:37:58.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:57 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:37:58.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:57 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:37:58.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:57 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:58.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:57 smithi081 ceph-mon[28640]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:37:58.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:57 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:37:58.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:57 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:37:58.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:57 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:58.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:57 smithi146 ceph-mon[32357]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:37:58.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:57 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:37:58.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:57 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:37:58.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:57 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:37:58.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:58 smithi134 ceph-mon[31708]: from='client.34211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:37:59.142 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:58 smithi081 ceph-mon[28640]: from='client.34211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:37:59.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:58 smithi146 ceph-mon[32357]: from='client.34211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:38:00.051 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:37:59 smithi134 ceph-mon[31708]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-03T16:38:00.161 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:37:59 smithi081 ceph-mon[28640]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-03T16:38:00.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:37:59 smithi146 ceph-mon[32357]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-03T16:38:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:01 smithi134 ceph-mon[31708]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-05-03T16:38:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:01 smithi134 ceph-mon[31708]: from='client.? 172.21.15.134:0/3423038016' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3837a136-a25b-4cb9-aa82-084b477c67d4"}]: dispatch 2024-05-03T16:38:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:01 smithi134 ceph-mon[31708]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3837a136-a25b-4cb9-aa82-084b477c67d4"}]: dispatch 2024-05-03T16:38:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:01 smithi134 ceph-mon[31708]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3837a136-a25b-4cb9-aa82-084b477c67d4"}]': finished 2024-05-03T16:38:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:01 smithi134 ceph-mon[31708]: osdmap e29: 5 total, 4 up, 5 in 2024-05-03T16:38:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:01 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T16:38:02.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:01 smithi081 ceph-mon[28640]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-05-03T16:38:02.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:01 smithi081 ceph-mon[28640]: from='client.? 172.21.15.134:0/3423038016' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3837a136-a25b-4cb9-aa82-084b477c67d4"}]: dispatch 2024-05-03T16:38:02.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:01 smithi081 ceph-mon[28640]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3837a136-a25b-4cb9-aa82-084b477c67d4"}]: dispatch 2024-05-03T16:38:02.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:01 smithi081 ceph-mon[28640]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3837a136-a25b-4cb9-aa82-084b477c67d4"}]': finished 2024-05-03T16:38:02.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:01 smithi081 ceph-mon[28640]: osdmap e29: 5 total, 4 up, 5 in 2024-05-03T16:38:02.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:01 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T16:38:02.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:01 smithi146 ceph-mon[32357]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-05-03T16:38:02.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:01 smithi146 ceph-mon[32357]: from='client.? 172.21.15.134:0/3423038016' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3837a136-a25b-4cb9-aa82-084b477c67d4"}]: dispatch 2024-05-03T16:38:02.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:01 smithi146 ceph-mon[32357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3837a136-a25b-4cb9-aa82-084b477c67d4"}]: dispatch 2024-05-03T16:38:02.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:01 smithi146 ceph-mon[32357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3837a136-a25b-4cb9-aa82-084b477c67d4"}]': finished 2024-05-03T16:38:02.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:01 smithi146 ceph-mon[32357]: osdmap e29: 5 total, 4 up, 5 in 2024-05-03T16:38:02.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:01 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T16:38:03.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:02 smithi134 ceph-mon[31708]: from='client.? 172.21.15.134:0/1708187516' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:38:03.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:02 smithi081 ceph-mon[28640]: from='client.? 172.21.15.134:0/1708187516' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:38:03.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:02 smithi146 ceph-mon[32357]: from='client.? 172.21.15.134:0/1708187516' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:38:04.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:03 smithi134 ceph-mon[31708]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T16:38:04.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:03 smithi081 ceph-mon[28640]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T16:38:04.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:03 smithi146 ceph-mon[32357]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T16:38:06.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:05 smithi134 ceph-mon[31708]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-03T16:38:06.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:05 smithi081 ceph-mon[28640]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-03T16:38:06.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:05 smithi146 ceph-mon[32357]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-03T16:38:08.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:07 smithi134 ceph-mon[31708]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T16:38:08.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:07 smithi081 ceph-mon[28640]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T16:38:08.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:07 smithi146 ceph-mon[32357]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T16:38:09.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:09 smithi134 ceph-mon[31708]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:10.210 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:09 smithi081 ceph-mon[28640]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:10.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:09 smithi146 ceph-mon[32357]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:11.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:10 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-03T16:38:11.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:10 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:38:11.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:10 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-03T16:38:11.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:10 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:38:11.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:10 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-03T16:38:11.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:10 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:38:12.130 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:11 smithi134 ceph-mon[31708]: Deploying daemon osd.4 on smithi134 2024-05-03T16:38:12.130 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:11 smithi134 ceph-mon[31708]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:11 smithi081 ceph-mon[28640]: Deploying daemon osd.4 on smithi134 2024-05-03T16:38:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:11 smithi081 ceph-mon[28640]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:12.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:11 smithi146 ceph-mon[32357]: Deploying daemon osd.4 on smithi134 2024-05-03T16:38:12.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:11 smithi146 ceph-mon[32357]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:14.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:13 smithi134 ceph-mon[31708]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:14.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:13 smithi081 ceph-mon[28640]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:14.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:13 smithi146 ceph-mon[32357]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:16.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:15 smithi134 ceph-mon[31708]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:16.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:15 smithi081 ceph-mon[28640]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:16.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:15 smithi146 ceph-mon[32357]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:18.042 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:17 smithi134 ceph-mon[31708]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:18.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:17 smithi081 ceph-mon[28640]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:18.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:17 smithi146 ceph-mon[32357]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:19.556 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:19 smithi134 ceph-mon[31708]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:19.556 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:19 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:19.556 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:19 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:19.556 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:19 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:38:19.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:19 smithi146 ceph-mon[32357]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:19.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:19 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:19.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:19 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:19.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:19 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:38:19.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:19 smithi081 ceph-mon[28640]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:19.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:19.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:19.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:38:21.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:21 smithi146 ceph-mon[32357]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:21.597 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:21 smithi134 ceph-mon[31708]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:21.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:21 smithi081 ceph-mon[28640]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:23.152 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:23.152 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:23.153 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:22 smithi134 ceph-mon[31708]: from='osd.4 [v2:172.21.15.134:6808/1498616220,v1:172.21.15.134:6809/1498616220]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-03T16:38:23.153 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:22 smithi134 ceph-mon[31708]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-03T16:38:23.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:23.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:23.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:22 smithi081 ceph-mon[28640]: from='osd.4 [v2:172.21.15.134:6808/1498616220,v1:172.21.15.134:6809/1498616220]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-03T16:38:23.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:22 smithi081 ceph-mon[28640]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-03T16:38:23.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:38:23.277+0000 7f5f74c00700 1 -- 172.21.15.134:0/1173148765 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5f780638e0 con 0x7f5f5c0b2900 2024-05-03T16:38:23.279 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 4 on host 'smithi134' 2024-05-03T16:38:23.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:38:23.281+0000 7f5f7d400700 1 -- 172.21.15.134:0/1173148765 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5f5c0b2900 msgr2=0x7f5f5c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:38:23.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:38:23.281+0000 7f5f7d400700 1 --2- 172.21.15.134:0/1173148765 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5f5c0b2900 0x7f5f5c0b4dc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5f6800b5c0 tx=0x7f5f68005fb0 comp rx=0 tx=0).stop 2024-05-03T16:38:23.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:38:23.281+0000 7f5f7d400700 1 -- 172.21.15.134:0/1173148765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f78109110 msgr2=0x7f5f781a2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:38:23.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:38:23.281+0000 7f5f7d400700 1 --2- 172.21.15.134:0/1173148765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f78109110 0x7f5f781a2c40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5f700094f0 tx=0x7f5f7000d3b0 comp rx=0 tx=0).stop 2024-05-03T16:38:23.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:38:23.281+0000 7f5f7d400700 1 -- 172.21.15.134:0/1173148765 shutdown_connections 2024-05-03T16:38:23.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:38:23.281+0000 7f5f7d400700 1 --2- 172.21.15.134:0/1173148765 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5f5c0b2900 0x7f5f5c0b4dc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:38:23.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:38:23.281+0000 7f5f7d400700 1 --2- 172.21.15.134:0/1173148765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f78103eb0 0x7f5f7819b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:38:23.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:38:23.281+0000 7f5f7d400700 1 --2- 172.21.15.134:0/1173148765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f78109110 0x7f5f781a2c40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:38:23.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:38:23.281+0000 7f5f7d400700 1 --2- 172.21.15.134:0/1173148765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f781067e0 0x7f5f7819bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:38:23.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:38:23.281+0000 7f5f7d400700 1 -- 172.21.15.134:0/1173148765 >> 172.21.15.134:0/1173148765 conn(0x7f5f780fd8c0 msgr2=0x7f5f78103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:38:23.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:38:23.281+0000 7f5f7d400700 1 -- 172.21.15.134:0/1173148765 shutdown_connections 2024-05-03T16:38:23.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:38:23.281+0000 7f5f7d400700 1 -- 172.21.15.134:0/1173148765 wait complete. 2024-05-03T16:38:23.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:23.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:23.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:22 smithi146 ceph-mon[32357]: from='osd.4 [v2:172.21.15.134:6808/1498616220,v1:172.21.15.134:6809/1498616220]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-03T16:38:23.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:22 smithi146 ceph-mon[32357]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-03T16:38:23.969 DEBUG:teuthology.orchestra.run.smithi134:osd.4> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.4.service 2024-05-03T16:38:23.974 INFO:tasks.cephadm:Deploying osd.5 on smithi146 with /dev/vg_nvme/lv_3... 2024-05-03T16:38:23.974 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-03T16:38:24.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:23 smithi134 ceph-mon[31708]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:24.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:23 smithi134 ceph-mon[31708]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-03T16:38:24.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:23 smithi134 ceph-mon[31708]: osdmap e30: 5 total, 4 up, 5 in 2024-05-03T16:38:24.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:23 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T16:38:24.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:23 smithi134 ceph-mon[31708]: from='osd.4 [v2:172.21.15.134:6808/1498616220,v1:172.21.15.134:6809/1498616220]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:38:24.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:23 smithi134 ceph-mon[31708]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:38:24.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:23 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:38:24.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:23 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:38:24.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:23 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:24.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:23 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:24.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:23 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:24.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:23 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:38:24.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:23 smithi081 ceph-mon[28640]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:24.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:23 smithi081 ceph-mon[28640]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-03T16:38:24.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:23 smithi081 ceph-mon[28640]: osdmap e30: 5 total, 4 up, 5 in 2024-05-03T16:38:24.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:23 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T16:38:24.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:23 smithi081 ceph-mon[28640]: from='osd.4 [v2:172.21.15.134:6808/1498616220,v1:172.21.15.134:6809/1498616220]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:38:24.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:23 smithi081 ceph-mon[28640]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:38:24.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:23 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:38:24.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:23 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:38:24.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:23 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:24.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:23 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:24.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:23 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:24.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:23 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:38:24.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:23 smithi146 ceph-mon[32357]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:24.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:23 smithi146 ceph-mon[32357]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-03T16:38:24.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:23 smithi146 ceph-mon[32357]: osdmap e30: 5 total, 4 up, 5 in 2024-05-03T16:38:24.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:23 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T16:38:24.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:23 smithi146 ceph-mon[32357]: from='osd.4 [v2:172.21.15.134:6808/1498616220,v1:172.21.15.134:6809/1498616220]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:38:24.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:23 smithi146 ceph-mon[32357]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:38:24.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:23 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:38:24.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:23 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:38:24.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:23 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:24.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:23 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:24.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:23 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:24.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:23 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:38:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T16:38:25.178 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:24 smithi134 ceph-mon[31708]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-03T16:38:25.178 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:24 smithi134 ceph-mon[31708]: osdmap e31: 5 total, 4 up, 5 in 2024-05-03T16:38:25.178 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:24 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T16:38:25.178 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:24 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T16:38:25.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:24 smithi081 ceph-mon[28640]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-03T16:38:25.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:24 smithi081 ceph-mon[28640]: osdmap e31: 5 total, 4 up, 5 in 2024-05-03T16:38:25.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:24 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T16:38:25.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:24 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T16:38:25.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:24 smithi146 ceph-mon[32357]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-03T16:38:25.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:24 smithi146 ceph-mon[32357]: osdmap e31: 5 total, 4 up, 5 in 2024-05-03T16:38:25.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:24 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T16:38:25.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:24 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T16:38:26.042 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:25 smithi134 ceph-mon[31708]: purged_snaps scrub starts 2024-05-03T16:38:26.042 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:25 smithi134 ceph-mon[31708]: purged_snaps scrub ok 2024-05-03T16:38:26.042 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:25 smithi134 ceph-mon[31708]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:26.043 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:25 smithi134 ceph-mon[31708]: osd.4 [v2:172.21.15.134:6808/1498616220,v1:172.21.15.134:6809/1498616220] boot 2024-05-03T16:38:26.043 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:25 smithi134 ceph-mon[31708]: osdmap e32: 5 total, 5 up, 5 in 2024-05-03T16:38:26.043 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:25 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T16:38:26.230 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:25 smithi146 ceph-mon[32357]: purged_snaps scrub starts 2024-05-03T16:38:26.230 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:25 smithi146 ceph-mon[32357]: purged_snaps scrub ok 2024-05-03T16:38:26.230 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:25 smithi146 ceph-mon[32357]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:26.230 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:25 smithi146 ceph-mon[32357]: osd.4 [v2:172.21.15.134:6808/1498616220,v1:172.21.15.134:6809/1498616220] boot 2024-05-03T16:38:26.230 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:25 smithi146 ceph-mon[32357]: osdmap e32: 5 total, 5 up, 5 in 2024-05-03T16:38:26.230 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:25 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T16:38:26.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:25 smithi081 ceph-mon[28640]: purged_snaps scrub starts 2024-05-03T16:38:26.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:25 smithi081 ceph-mon[28640]: purged_snaps scrub ok 2024-05-03T16:38:26.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:25 smithi081 ceph-mon[28640]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T16:38:26.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:25 smithi081 ceph-mon[28640]: osd.4 [v2:172.21.15.134:6808/1498616220,v1:172.21.15.134:6809/1498616220] boot 2024-05-03T16:38:26.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:25 smithi081 ceph-mon[28640]: osdmap e32: 5 total, 5 up, 5 in 2024-05-03T16:38:26.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:25 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T16:38:27.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:26 smithi146 ceph-mon[32357]: osdmap e33: 5 total, 5 up, 5 in 2024-05-03T16:38:27.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:26 smithi134 ceph-mon[31708]: osdmap e33: 5 total, 5 up, 5 in 2024-05-03T16:38:27.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:26 smithi081 ceph-mon[28640]: osdmap e33: 5 total, 5 up, 5 in 2024-05-03T16:38:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-03T16:38:27.552 INFO:teuthology.orchestra.run.smithi146.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-03T16:38:27.552 INFO:teuthology.orchestra.run.smithi146.stderr: stderr: 10+0 records in 2024-05-03T16:38:27.552 INFO:teuthology.orchestra.run.smithi146.stderr:10+0 records out 2024-05-03T16:38:27.552 INFO:teuthology.orchestra.run.smithi146.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.036337 s, 289 MB/s 2024-05-03T16:38:27.552 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping successful for: 2024-05-03T16:38:28.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:27 smithi134 ceph-mon[31708]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:28.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:27 smithi081 ceph-mon[28640]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:28.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:27 smithi146 ceph-mon[32357]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:28.435 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi146:vg_nvme/lv_3 2024-05-03T16:38:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T16:38:29.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:29 smithi081 ceph-mon[28640]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:29.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:29 smithi081 ceph-mon[28640]: Detected new or changed devices on smithi134 2024-05-03T16:38:29.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:29.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:29.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:38:29.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:38:29.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:29 smithi081 ceph-mon[28640]: Adjusting osd_memory_target on smithi134 to 8544M 2024-05-03T16:38:29.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:29.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:38:29.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:38:29.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:30.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:29 smithi146 ceph-mon[32357]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:30.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:29 smithi146 ceph-mon[32357]: Detected new or changed devices on smithi134 2024-05-03T16:38:30.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:30.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:30.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:38:30.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:38:30.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:29 smithi146 ceph-mon[32357]: Adjusting osd_memory_target on smithi134 to 8544M 2024-05-03T16:38:30.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:30.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:38:30.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:38:30.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:29 smithi134 ceph-mon[31708]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:29 smithi134 ceph-mon[31708]: Detected new or changed devices on smithi134 2024-05-03T16:38:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:38:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:38:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:29 smithi134 ceph-mon[31708]: Adjusting osd_memory_target on smithi134 to 8544M 2024-05-03T16:38:30.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:30.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:38:30.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:38:30.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:31.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.082+0000 7f41e9600700 1 -- 172.21.15.146:0/645275448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41e4104fc0 msgr2=0x7f41e410b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:38:31.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.082+0000 7f41e9600700 1 --2- 172.21.15.146:0/645275448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41e4104fc0 0x7f41e410b870 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00b0a0 tx=0x7f41dc00b3b0 comp rx=0 tx=0).stop 2024-05-03T16:38:31.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.082+0000 7f41e9600700 1 -- 172.21.15.146:0/645275448 shutdown_connections 2024-05-03T16:38:31.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.082+0000 7f41e9600700 1 --2- 172.21.15.146:0/645275448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41e4104fc0 0x7f41e410b870 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:38:31.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.082+0000 7f41e9600700 1 --2- 172.21.15.146:0/645275448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e4103420 0x7f41e4103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:38:31.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.082+0000 7f41e9600700 1 --2- 172.21.15.146:0/645275448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41e4104620 0x7f41e4104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:38:31.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.082+0000 7f41e9600700 1 -- 172.21.15.146:0/645275448 >> 172.21.15.146:0/645275448 conn(0x7f41e40fe9e0 msgr2=0x7f41e4100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:38:31.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.082+0000 7f41e9600700 1 -- 172.21.15.146:0/645275448 shutdown_connections 2024-05-03T16:38:31.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.082+0000 7f41e9600700 1 -- 172.21.15.146:0/645275448 wait complete. 2024-05-03T16:38:31.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.083+0000 7f41e9600700 1 Processor -- start 2024-05-03T16:38:31.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.083+0000 7f41e9600700 1 -- start start 2024-05-03T16:38:31.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.083+0000 7f41e9600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e4103420 0x7f41e419b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:38:31.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.083+0000 7f41e9600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41e4104620 0x7f41e419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:38:31.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.084+0000 7f41e9600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41e4104fc0 0x7f41e41a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:38:31.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.084+0000 7f41e9600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f41e410eda0 con 0x7f41e4104fc0 2024-05-03T16:38:31.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.084+0000 7f41e9600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f41e410ec20 con 0x7f41e4103420 2024-05-03T16:38:31.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.084+0000 7f41e9600700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f41e410ef20 con 0x7f41e4104620 2024-05-03T16:38:31.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.084+0000 7f41e3400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41e4104620 0x7f41e419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:38:31.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.084+0000 7f41e3400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41e4104620 0x7f41e419bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55742/0 (socket says 172.21.15.146:55742) 2024-05-03T16:38:31.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.084+0000 7f41e3400700 1 -- 172.21.15.146:0/2222600666 learned_addr learned my addr 172.21.15.146:0/2222600666 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-05-03T16:38:31.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.084+0000 7f41e3e00700 1 --2- 172.21.15.146:0/2222600666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e4103420 0x7f41e419b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:38:31.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.084+0000 7f41e8c00700 1 --2- 172.21.15.146:0/2222600666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41e4104fc0 0x7f41e41a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:38:31.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.084+0000 7f41e3400700 1 -- 172.21.15.146:0/2222600666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e4103420 msgr2=0x7f41e419b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:38:31.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.084+0000 7f41e3400700 1 --2- 172.21.15.146:0/2222600666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e4103420 0x7f41e419b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:38:31.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.084+0000 7f41e3400700 1 -- 172.21.15.146:0/2222600666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41e4104fc0 msgr2=0x7f41e41a2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:38:31.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.084+0000 7f41e3400700 1 --2- 172.21.15.146:0/2222600666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41e4104fc0 0x7f41e41a2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:38:31.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.084+0000 7f41e3400700 1 -- 172.21.15.146:0/2222600666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e41a31f0 con 0x7f41e4104620 2024-05-03T16:38:31.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.085+0000 7f41e3400700 1 --2- 172.21.15.146:0/2222600666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41e4104620 0x7f41e419bad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f41d000c9e0 tx=0x7f41d000cda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:38:31.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.085+0000 7f41e0c00700 1 -- 172.21.15.146:0/2222600666 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0007ac0 con 0x7f41e4104620 2024-05-03T16:38:31.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.085+0000 7f41e0c00700 1 -- 172.21.15.146:0/2222600666 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f41d0007c60 con 0x7f41e4104620 2024-05-03T16:38:31.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.085+0000 7f41e9600700 1 -- 172.21.15.146:0/2222600666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e41a34e0 con 0x7f41e4104620 2024-05-03T16:38:31.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.085+0000 7f41e0c00700 1 -- 172.21.15.146:0/2222600666 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0018660 con 0x7f41e4104620 2024-05-03T16:38:31.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.085+0000 7f41e9600700 1 -- 172.21.15.146:0/2222600666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e41a3a20 con 0x7f41e4104620 2024-05-03T16:38:31.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.086+0000 7f41e9600700 1 -- 172.21.15.146:0/2222600666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e406a190 con 0x7f41e4104620 2024-05-03T16:38:31.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.089+0000 7f41e0c00700 1 -- 172.21.15.146:0/2222600666 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f41d000f450 con 0x7f41e4104620 2024-05-03T16:38:31.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.090+0000 7f41e0c00700 1 --2- 172.21.15.146:0/2222600666 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f41c80b2880 0x7f41c80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:38:31.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.090+0000 7f41e0c00700 1 -- 172.21.15.146:0/2222600666 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4101+0+0 (secure 0 0 0) 0x7f41d00e1420 con 0x7f41e4104620 2024-05-03T16:38:31.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.091+0000 7f41e3e00700 1 --2- 172.21.15.146:0/2222600666 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f41c80b2880 0x7f41c80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:38:31.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.092+0000 7f41e3e00700 1 --2- 172.21.15.146:0/2222600666 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f41c80b2880 0x7f41c80b4d40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f41e4104480 tx=0x7f41d4005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:38:31.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.093+0000 7f41e0c00700 1 -- 172.21.15.146:0/2222600666 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f41d0054d70 con 0x7f41e4104620 2024-05-03T16:38:31.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:31.335+0000 7f41e9600700 1 -- 172.21.15.146:0/2222600666 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f41e41a3ce0 con 0x7f41c80b2880 2024-05-03T16:38:31.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:31 smithi081 ceph-mon[28640]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:31.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:38:31.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:38:31.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:38:32.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:31 smithi146 ceph-mon[32357]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:32.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:38:32.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:38:32.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:38:32.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:31 smithi134 ceph-mon[31708]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:32.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:38:32.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:38:32.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:38:32.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:32 smithi081 ceph-mon[28640]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:38:33.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:32 smithi146 ceph-mon[32357]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:38:33.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:32 smithi134 ceph-mon[31708]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:38:33.804 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:33 smithi146 ceph-mon[32357]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:34.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:33 smithi134 ceph-mon[31708]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:34.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:33 smithi081 ceph-mon[28640]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:36.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:35 smithi146 ceph-mon[32357]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:36.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:35 smithi146 ceph-mon[32357]: from='client.? 172.21.15.146:0/856754809' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e783d2e-c181-41a9-97de-f17705a201bd"}]: dispatch 2024-05-03T16:38:36.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:35 smithi146 ceph-mon[32357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e783d2e-c181-41a9-97de-f17705a201bd"}]: dispatch 2024-05-03T16:38:36.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:35 smithi146 ceph-mon[32357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e783d2e-c181-41a9-97de-f17705a201bd"}]': finished 2024-05-03T16:38:36.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:35 smithi146 ceph-mon[32357]: osdmap e34: 6 total, 5 up, 6 in 2024-05-03T16:38:36.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:35 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T16:38:36.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:35 smithi134 ceph-mon[31708]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:36.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:35 smithi134 ceph-mon[31708]: from='client.? 172.21.15.146:0/856754809' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e783d2e-c181-41a9-97de-f17705a201bd"}]: dispatch 2024-05-03T16:38:36.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:35 smithi134 ceph-mon[31708]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e783d2e-c181-41a9-97de-f17705a201bd"}]: dispatch 2024-05-03T16:38:36.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:35 smithi134 ceph-mon[31708]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e783d2e-c181-41a9-97de-f17705a201bd"}]': finished 2024-05-03T16:38:36.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:35 smithi134 ceph-mon[31708]: osdmap e34: 6 total, 5 up, 6 in 2024-05-03T16:38:36.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:35 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T16:38:36.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:35 smithi081 ceph-mon[28640]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:36.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:35 smithi081 ceph-mon[28640]: from='client.? 172.21.15.146:0/856754809' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e783d2e-c181-41a9-97de-f17705a201bd"}]: dispatch 2024-05-03T16:38:36.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:35 smithi081 ceph-mon[28640]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e783d2e-c181-41a9-97de-f17705a201bd"}]: dispatch 2024-05-03T16:38:36.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:35 smithi081 ceph-mon[28640]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e783d2e-c181-41a9-97de-f17705a201bd"}]': finished 2024-05-03T16:38:36.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:35 smithi081 ceph-mon[28640]: osdmap e34: 6 total, 5 up, 6 in 2024-05-03T16:38:36.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:35 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T16:38:37.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:36 smithi146 ceph-mon[32357]: from='client.? 172.21.15.146:0/2560038179' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:38:37.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:36 smithi134 ceph-mon[31708]: from='client.? 172.21.15.146:0/2560038179' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:38:37.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:36 smithi081 ceph-mon[28640]: from='client.? 172.21.15.146:0/2560038179' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:38:38.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:37 smithi146 ceph-mon[32357]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:38.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:37 smithi134 ceph-mon[31708]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:38.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:37 smithi081 ceph-mon[28640]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:39.981 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:39 smithi146 ceph-mon[32357]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:40.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:39 smithi134 ceph-mon[31708]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:40.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:39 smithi081 ceph-mon[28640]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:42.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:41 smithi146 ceph-mon[32357]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:42.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:41 smithi134 ceph-mon[31708]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:42.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:41 smithi081 ceph-mon[28640]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:44.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:43 smithi146 ceph-mon[32357]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:44.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:43 smithi134 ceph-mon[31708]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:44.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:43 smithi081 ceph-mon[28640]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:45.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-03T16:38:45.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:38:45.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-03T16:38:45.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:38:45.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-03T16:38:45.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:38:45.913 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:45 smithi146 ceph-mon[32357]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:45.914 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:45 smithi146 ceph-mon[32357]: Deploying daemon osd.5 on smithi146 2024-05-03T16:38:46.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:45 smithi134 ceph-mon[31708]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:46.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:45 smithi134 ceph-mon[31708]: Deploying daemon osd.5 on smithi146 2024-05-03T16:38:46.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:45 smithi081 ceph-mon[28640]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:46.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:45 smithi081 ceph-mon[28640]: Deploying daemon osd.5 on smithi146 2024-05-03T16:38:48.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:47 smithi146 ceph-mon[32357]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:48.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:47 smithi134 ceph-mon[31708]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:48.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:47 smithi081 ceph-mon[28640]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:50.002 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:49 smithi146 ceph-mon[32357]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:50.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:49 smithi134 ceph-mon[31708]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:50.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:49 smithi081 ceph-mon[28640]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:52.035 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:51 smithi146 ceph-mon[32357]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:52.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:51 smithi134 ceph-mon[31708]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:52.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:51 smithi081 ceph-mon[28640]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:54.088 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:53 smithi146 ceph-mon[32357]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:54.088 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:53 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:38:54.088 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:53 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:54.088 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:53 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:54.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:53 smithi134 ceph-mon[31708]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:54.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:53 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:38:54.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:53 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:54.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:53 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:54.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:53 smithi081 ceph-mon[28640]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:54.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:53 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:38:54.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:53 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:54.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:53 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:56.095 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:55 smithi146 ceph-mon[32357]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:56.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:55 smithi134 ceph-mon[31708]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:56.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:55 smithi081 ceph-mon[28640]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:57.772 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:57 smithi146 ceph-mon[32357]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:57.772 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:57 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:57.772 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:57 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:57.772 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:57 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:38:57.773 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:57 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:38:57.773 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:57 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:57.773 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:57 smithi146 ceph-mon[32357]: from='osd.5 [v2:172.21.15.146:6808/1276988922,v1:172.21.15.146:6809/1276988922]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-03T16:38:57.773 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:57 smithi146 ceph-mon[32357]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-03T16:38:57.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:57.893+0000 7f41e0c00700 1 -- 172.21.15.146:0/2222600666 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f41e41a3ce0 con 0x7f41c80b2880 2024-05-03T16:38:57.897 INFO:teuthology.orchestra.run.smithi146.stdout:Created osd(s) 5 on host 'smithi146' 2024-05-03T16:38:57.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:57.897+0000 7f41e9600700 1 -- 172.21.15.146:0/2222600666 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f41c80b2880 msgr2=0x7f41c80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:38:57.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:57.897+0000 7f41e9600700 1 --2- 172.21.15.146:0/2222600666 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f41c80b2880 0x7f41c80b4d40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f41e4104480 tx=0x7f41d4005cf0 comp rx=0 tx=0).stop 2024-05-03T16:38:57.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:57.897+0000 7f41e9600700 1 -- 172.21.15.146:0/2222600666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41e4104620 msgr2=0x7f41e419bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:38:57.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:57.897+0000 7f41e9600700 1 --2- 172.21.15.146:0/2222600666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41e4104620 0x7f41e419bad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f41d000c9e0 tx=0x7f41d000cda0 comp rx=0 tx=0).stop 2024-05-03T16:38:57.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:57.897+0000 7f41e9600700 1 -- 172.21.15.146:0/2222600666 shutdown_connections 2024-05-03T16:38:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:57.897+0000 7f41e9600700 1 --2- 172.21.15.146:0/2222600666 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f41c80b2880 0x7f41c80b4d40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:38:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:57.897+0000 7f41e9600700 1 --2- 172.21.15.146:0/2222600666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41e4104fc0 0x7f41e41a2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:38:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:57.897+0000 7f41e9600700 1 --2- 172.21.15.146:0/2222600666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e4103420 0x7f41e419b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:38:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:57.897+0000 7f41e9600700 1 --2- 172.21.15.146:0/2222600666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41e4104620 0x7f41e419bad0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:38:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:57.897+0000 7f41e9600700 1 -- 172.21.15.146:0/2222600666 >> 172.21.15.146:0/2222600666 conn(0x7f41e40fe9e0 msgr2=0x7f41e40756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:38:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:57.897+0000 7f41e9600700 1 -- 172.21.15.146:0/2222600666 shutdown_connections 2024-05-03T16:38:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:38:57.897+0000 7f41e9600700 1 -- 172.21.15.146:0/2222600666 wait complete. 2024-05-03T16:38:57.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:57 smithi134 ceph-mon[31708]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:57.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:57 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:57.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:57 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:57.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:57 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:38:57.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:57 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:38:57.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:57 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:57.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:57 smithi134 ceph-mon[31708]: from='osd.5 [v2:172.21.15.146:6808/1276988922,v1:172.21.15.146:6809/1276988922]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-03T16:38:57.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:57 smithi134 ceph-mon[31708]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-03T16:38:57.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:57 smithi081 ceph-mon[28640]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:57.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:57 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:57.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:57 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:57.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:57 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:38:57.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:57 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:38:57.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:57 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:57.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:57 smithi081 ceph-mon[28640]: from='osd.5 [v2:172.21.15.146:6808/1276988922,v1:172.21.15.146:6809/1276988922]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-03T16:38:57.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:57 smithi081 ceph-mon[28640]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-03T16:38:58.769 DEBUG:teuthology.orchestra.run.smithi146:osd.5> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.5.service 2024-05-03T16:38:58.775 INFO:tasks.cephadm:Deploying osd.6 on smithi081 with /dev/vg_nvme/lv_2... 2024-05-03T16:38:58.775 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-03T16:38:59.027 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:58 smithi146 ceph-mon[32357]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-03T16:38:59.027 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:58 smithi146 ceph-mon[32357]: osdmap e35: 6 total, 5 up, 6 in 2024-05-03T16:38:59.027 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:58 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T16:38:59.027 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:58 smithi146 ceph-mon[32357]: from='osd.5 [v2:172.21.15.146:6808/1276988922,v1:172.21.15.146:6809/1276988922]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:38:59.027 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:58 smithi146 ceph-mon[32357]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:38:59.027 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:58 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:59.027 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:58 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:59.027 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:58 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:38:59.213 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:38:59.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:58 smithi134 ceph-mon[31708]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-03T16:38:59.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:58 smithi134 ceph-mon[31708]: osdmap e35: 6 total, 5 up, 6 in 2024-05-03T16:38:59.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:58 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T16:38:59.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:58 smithi134 ceph-mon[31708]: from='osd.5 [v2:172.21.15.146:6808/1276988922,v1:172.21.15.146:6809/1276988922]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:38:59.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:58 smithi134 ceph-mon[31708]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:38:59.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:58 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:59.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:58 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:59.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:58 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:38:59.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:58 smithi081 ceph-mon[28640]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-03T16:38:59.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:58 smithi081 ceph-mon[28640]: osdmap e35: 6 total, 5 up, 6 in 2024-05-03T16:38:59.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:58 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T16:38:59.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:58 smithi081 ceph-mon[28640]: from='osd.5 [v2:172.21.15.146:6808/1276988922,v1:172.21.15.146:6809/1276988922]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:38:59.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:58 smithi081 ceph-mon[28640]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:38:59.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:58 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:59.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:58 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:38:59.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:58 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:38:59.993 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:59 smithi081 ceph-mon[28640]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:38:59.993 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:59 smithi081 ceph-mon[28640]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-05-03T16:38:59.993 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:59 smithi081 ceph-mon[28640]: osdmap e36: 6 total, 5 up, 6 in 2024-05-03T16:38:59.993 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:59 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T16:38:59.993 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:59 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T16:38:59.994 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:38:59 smithi081 ceph-mon[28640]: from='osd.5 ' entity='osd.5' 2024-05-03T16:39:00.011 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:59 smithi146 ceph-mon[32357]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:39:00.012 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:59 smithi146 ceph-mon[32357]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-05-03T16:39:00.012 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:59 smithi146 ceph-mon[32357]: osdmap e36: 6 total, 5 up, 6 in 2024-05-03T16:39:00.012 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:59 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T16:39:00.012 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:59 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T16:39:00.012 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:38:59 smithi146 ceph-mon[32357]: from='osd.5 ' entity='osd.5' 2024-05-03T16:39:00.012 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 16:38:59 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T16:38:59.656+0000 7f71f7000700 -1 osd.5 0 waiting for initial osdmap 2024-05-03T16:39:00.012 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 16:38:59 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T16:38:59.675+0000 7f71ece00700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T16:39:00.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:59 smithi134 ceph-mon[31708]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:39:00.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:59 smithi134 ceph-mon[31708]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-05-03T16:39:00.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:59 smithi134 ceph-mon[31708]: osdmap e36: 6 total, 5 up, 6 in 2024-05-03T16:39:00.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:59 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T16:39:00.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:59 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T16:39:00.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:38:59 smithi134 ceph-mon[31708]: from='osd.5 ' entity='osd.5' 2024-05-03T16:39:00.947 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:00 smithi146 ceph-mon[32357]: purged_snaps scrub starts 2024-05-03T16:39:00.947 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:00 smithi146 ceph-mon[32357]: purged_snaps scrub ok 2024-05-03T16:39:00.947 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:00 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T16:39:00.947 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:00 smithi146 ceph-mon[32357]: osd.5 [v2:172.21.15.146:6808/1276988922,v1:172.21.15.146:6809/1276988922] boot 2024-05-03T16:39:00.947 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:00 smithi146 ceph-mon[32357]: osdmap e37: 6 total, 6 up, 6 in 2024-05-03T16:39:00.947 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:00 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T16:39:01.108 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:00 smithi081 ceph-mon[28640]: purged_snaps scrub starts 2024-05-03T16:39:01.108 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:00 smithi081 ceph-mon[28640]: purged_snaps scrub ok 2024-05-03T16:39:01.108 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:00 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T16:39:01.108 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:00 smithi081 ceph-mon[28640]: osd.5 [v2:172.21.15.146:6808/1276988922,v1:172.21.15.146:6809/1276988922] boot 2024-05-03T16:39:01.108 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:00 smithi081 ceph-mon[28640]: osdmap e37: 6 total, 6 up, 6 in 2024-05-03T16:39:01.108 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:00 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T16:39:01.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:00 smithi134 ceph-mon[31708]: purged_snaps scrub starts 2024-05-03T16:39:01.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:00 smithi134 ceph-mon[31708]: purged_snaps scrub ok 2024-05-03T16:39:01.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:00 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T16:39:01.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:00 smithi134 ceph-mon[31708]: osd.5 [v2:172.21.15.146:6808/1276988922,v1:172.21.15.146:6809/1276988922] boot 2024-05-03T16:39:01.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:00 smithi134 ceph-mon[31708]: osdmap e37: 6 total, 6 up, 6 in 2024-05-03T16:39:01.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:00 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T16:39:02.128 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:01 smithi081 ceph-mon[28640]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:39:02.129 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:01 smithi081 ceph-mon[28640]: osdmap e38: 6 total, 6 up, 6 in 2024-05-03T16:39:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-03T16:39:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-03T16:39:02.129 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10+0 records in 2024-05-03T16:39:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:10+0 records out 2024-05-03T16:39:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0368764 s, 284 MB/s 2024-05-03T16:39:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping successful for: 2024-05-03T16:39:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:01 smithi134 ceph-mon[31708]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:39:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:01 smithi134 ceph-mon[31708]: osdmap e38: 6 total, 6 up, 6 in 2024-05-03T16:39:02.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:01 smithi146 ceph-mon[32357]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-03T16:39:02.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:01 smithi146 ceph-mon[32357]: osdmap e38: 6 total, 6 up, 6 in 2024-05-03T16:39:02.999 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_2 2024-05-03T16:39:03.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:02 smithi134 ceph-mon[31708]: osdmap e39: 6 total, 6 up, 6 in 2024-05-03T16:39:03.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:02 smithi081 ceph-mon[28640]: osdmap e39: 6 total, 6 up, 6 in 2024-05-03T16:39:03.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:02 smithi146 ceph-mon[32357]: osdmap e39: 6 total, 6 up, 6 in 2024-05-03T16:39:03.443 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:39:04.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:03 smithi146 ceph-mon[32357]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:04.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:03 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:04.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:03 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:04.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:03 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:39:04.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:03 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:39:04.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:03 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:04.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:03 smithi134 ceph-mon[31708]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:04.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:03 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:04.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:03 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:04.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:03 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:39:04.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:03 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:39:04.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:03 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:04.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:03 smithi081 ceph-mon[28640]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:04.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:03 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:04.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:03 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:04.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:03 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:39:04.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:03 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:39:04.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:03 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:05.103 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:04 smithi081 ceph-mon[28640]: Detected new or changed devices on smithi146 2024-05-03T16:39:05.103 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:04 smithi081 ceph-mon[28640]: Adjusting osd_memory_target on smithi146 to 8544M 2024-05-03T16:39:05.104 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:05.104 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:39:05.104 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:05.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:04 smithi134 ceph-mon[31708]: Detected new or changed devices on smithi146 2024-05-03T16:39:05.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:04 smithi134 ceph-mon[31708]: Adjusting osd_memory_target on smithi146 to 8544M 2024-05-03T16:39:05.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:04 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:05.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:04 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:39:05.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:04 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:05.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:04 smithi146 ceph-mon[32357]: Detected new or changed devices on smithi146 2024-05-03T16:39:05.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:04 smithi146 ceph-mon[32357]: Adjusting osd_memory_target on smithi146 to 8544M 2024-05-03T16:39:05.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:04 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:05.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:04 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:39:05.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:04 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.540+0000 7fad8b400700 1 -- 172.21.15.81:0/969969102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad841030a0 msgr2=0x7fad84103520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:39:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.540+0000 7fad8b400700 1 --2- 172.21.15.81:0/969969102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad841030a0 0x7fad84103520 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009990 tx=0x7fad7c009ca0 comp rx=0 tx=0).stop 2024-05-03T16:39:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.540+0000 7fad8b400700 1 -- 172.21.15.81:0/969969102 shutdown_connections 2024-05-03T16:39:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.540+0000 7fad8b400700 1 --2- 172.21.15.81:0/969969102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad84101d80 0x7fad841021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:39:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.540+0000 7fad8b400700 1 --2- 172.21.15.81:0/969969102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad841030a0 0x7fad84103520 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:39:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.540+0000 7fad8b400700 1 --2- 172.21.15.81:0/969969102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad841026e0 0x7fad84102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:39:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.540+0000 7fad8b400700 1 -- 172.21.15.81:0/969969102 >> 172.21.15.81:0/969969102 conn(0x7fad840fd9a0 msgr2=0x7fad840ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:39:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.540+0000 7fad8b400700 1 -- 172.21.15.81:0/969969102 shutdown_connections 2024-05-03T16:39:05.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.540+0000 7fad8b400700 1 -- 172.21.15.81:0/969969102 wait complete. 2024-05-03T16:39:05.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.541+0000 7fad8b400700 1 Processor -- start 2024-05-03T16:39:05.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.542+0000 7fad8b400700 1 -- start start 2024-05-03T16:39:05.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.542+0000 7fad8b400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad84101d80 0x7fad8419b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:39:05.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.542+0000 7fad8b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad841026e0 0x7fad8419bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:39:05.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.542+0000 7fad8b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad841030a0 0x7fad841a2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:39:05.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.542+0000 7fad8b400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fad84111080 con 0x7fad841030a0 2024-05-03T16:39:05.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.542+0000 7fad8b400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fad84110f00 con 0x7fad841026e0 2024-05-03T16:39:05.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.542+0000 7fad8b400700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fad84111200 con 0x7fad84101d80 2024-05-03T16:39:05.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.542+0000 7fad89400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad841030a0 0x7fad841a2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:39:05.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.542+0000 7fad89400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad841030a0 0x7fad841a2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48344/0 (socket says 172.21.15.81:48344) 2024-05-03T16:39:05.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.542+0000 7fad89400700 1 -- 172.21.15.81:0/601045951 learned_addr learned my addr 172.21.15.81:0/601045951 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:39:05.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.543+0000 7fad83e00700 1 --2- 172.21.15.81:0/601045951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad841026e0 0x7fad8419bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:39:05.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.543+0000 7fad88a00700 1 --2- 172.21.15.81:0/601045951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad84101d80 0x7fad8419b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:39:05.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.543+0000 7fad89400700 1 -- 172.21.15.81:0/601045951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad84101d80 msgr2=0x7fad8419b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:39:05.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.543+0000 7fad89400700 1 --2- 172.21.15.81:0/601045951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad84101d80 0x7fad8419b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:39:05.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.543+0000 7fad89400700 1 -- 172.21.15.81:0/601045951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad841026e0 msgr2=0x7fad8419bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:39:05.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.543+0000 7fad89400700 1 --2- 172.21.15.81:0/601045951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad841026e0 0x7fad8419bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:39:05.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.543+0000 7fad89400700 1 -- 172.21.15.81:0/601045951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad841a33e0 con 0x7fad841030a0 2024-05-03T16:39:05.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.543+0000 7fad89400700 1 --2- 172.21.15.81:0/601045951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad841030a0 0x7fad841a2d40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fad7c005910 tx=0x7fad7c00bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:39:05.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.543+0000 7fad81600700 1 -- 172.21.15.81:0/601045951 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c027070 con 0x7fad841030a0 2024-05-03T16:39:05.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.543+0000 7fad81600700 1 -- 172.21.15.81:0/601045951 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad7c004060 con 0x7fad841030a0 2024-05-03T16:39:05.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.543+0000 7fad8b400700 1 -- 172.21.15.81:0/601045951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad841a3670 con 0x7fad841030a0 2024-05-03T16:39:05.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.543+0000 7fad81600700 1 -- 172.21.15.81:0/601045951 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c022d30 con 0x7fad841030a0 2024-05-03T16:39:05.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.544+0000 7fad8b400700 1 -- 172.21.15.81:0/601045951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad841a3b20 con 0x7fad841030a0 2024-05-03T16:39:05.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.545+0000 7fad8b400700 1 -- 172.21.15.81:0/601045951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad8406a190 con 0x7fad841030a0 2024-05-03T16:39:05.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.547+0000 7fad81600700 1 -- 172.21.15.81:0/601045951 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fad7c02a070 con 0x7fad841030a0 2024-05-03T16:39:05.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.548+0000 7fad81600700 1 --2- 172.21.15.81:0/601045951 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fad6c0b2900 0x7fad6c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:39:05.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.549+0000 7fad81600700 1 -- 172.21.15.81:0/601045951 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4533+0+0 (secure 0 0 0) 0x7fad7c0e2960 con 0x7fad841030a0 2024-05-03T16:39:05.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.549+0000 7fad88a00700 1 --2- 172.21.15.81:0/601045951 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fad6c0b2900 0x7fad6c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:39:05.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.549+0000 7fad88a00700 1 --2- 172.21.15.81:0/601045951 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fad6c0b2900 0x7fad6c0b4dc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fad780060b0 tx=0x7fad78007790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:39:05.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.551+0000 7fad81600700 1 -- 172.21.15.81:0/601045951 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fad7c031020 con 0x7fad841030a0 2024-05-03T16:39:05.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:05.796+0000 7fad8b400700 1 -- 172.21.15.81:0/601045951 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fad840639a0 con 0x7fad6c0b2900 2024-05-03T16:39:06.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:05 smithi134 ceph-mon[31708]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-05-03T16:39:06.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:05 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:39:06.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:05 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:39:06.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:05 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:06.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:05 smithi081 ceph-mon[28640]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-05-03T16:39:06.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:39:06.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:39:06.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:06.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:05 smithi146 ceph-mon[32357]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-05-03T16:39:06.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:05 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:39:06.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:05 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:39:06.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:05 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:07.068 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:06 smithi081 ceph-mon[28640]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:39:07.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:06 smithi134 ceph-mon[31708]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:39:07.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:06 smithi146 ceph-mon[32357]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:39:08.204 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:07 smithi081 ceph-mon[28640]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-05-03T16:39:08.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:07 smithi134 ceph-mon[31708]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-05-03T16:39:08.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:07 smithi146 ceph-mon[32357]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-05-03T16:39:10.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:09 smithi134 ceph-mon[31708]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T16:39:10.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:09 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3980915432' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6faebdbf-7820-42e5-b07c-15db11f278dd"}]: dispatch 2024-05-03T16:39:10.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:09 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3980915432' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6faebdbf-7820-42e5-b07c-15db11f278dd"}]': finished 2024-05-03T16:39:10.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:09 smithi134 ceph-mon[31708]: osdmap e40: 7 total, 6 up, 7 in 2024-05-03T16:39:10.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:09 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T16:39:10.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:09 smithi081 ceph-mon[28640]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T16:39:10.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:09 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3980915432' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6faebdbf-7820-42e5-b07c-15db11f278dd"}]: dispatch 2024-05-03T16:39:10.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:09 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3980915432' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6faebdbf-7820-42e5-b07c-15db11f278dd"}]': finished 2024-05-03T16:39:10.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:09 smithi081 ceph-mon[28640]: osdmap e40: 7 total, 6 up, 7 in 2024-05-03T16:39:10.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:09 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T16:39:10.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:09 smithi146 ceph-mon[32357]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T16:39:10.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:09 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3980915432' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6faebdbf-7820-42e5-b07c-15db11f278dd"}]: dispatch 2024-05-03T16:39:10.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:09 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3980915432' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6faebdbf-7820-42e5-b07c-15db11f278dd"}]': finished 2024-05-03T16:39:10.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:09 smithi146 ceph-mon[32357]: osdmap e40: 7 total, 6 up, 7 in 2024-05-03T16:39:10.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:09 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T16:39:11.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:10 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2347097944' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:39:11.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:10 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2347097944' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:39:11.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:10 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2347097944' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:39:12.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:11 smithi134 ceph-mon[31708]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-03T16:39:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:11 smithi081 ceph-mon[28640]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-03T16:39:12.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:11 smithi146 ceph-mon[32357]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-03T16:39:14.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:13 smithi134 ceph-mon[31708]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T16:39:14.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:13 smithi081 ceph-mon[28640]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T16:39:14.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:13 smithi146 ceph-mon[32357]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T16:39:16.145 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:15 smithi081 ceph-mon[28640]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:16.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:15 smithi134 ceph-mon[31708]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:16.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:15 smithi146 ceph-mon[32357]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:18.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:17 smithi134 ceph-mon[31708]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:18.230 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:17 smithi081 ceph-mon[28640]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:18.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:17 smithi146 ceph-mon[32357]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:20.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:19 smithi081 ceph-mon[28640]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:20.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-03T16:39:20.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:20.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:19 smithi146 ceph-mon[32357]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:20.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:19 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-03T16:39:20.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:19 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:20.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:19 smithi134 ceph-mon[31708]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:20.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:19 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-03T16:39:20.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:19 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:21.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:20 smithi081 ceph-mon[28640]: Deploying daemon osd.6 on smithi081 2024-05-03T16:39:21.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:20 smithi146 ceph-mon[32357]: Deploying daemon osd.6 on smithi081 2024-05-03T16:39:21.469 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:20 smithi134 ceph-mon[31708]: Deploying daemon osd.6 on smithi081 2024-05-03T16:39:22.232 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:21 smithi081 ceph-mon[28640]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:22.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:21 smithi146 ceph-mon[32357]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:22.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:21 smithi134 ceph-mon[31708]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:24.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:23 smithi081 ceph-mon[28640]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:24.269 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:23 smithi134 ceph-mon[31708]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:24.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:23 smithi146 ceph-mon[32357]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:26.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:25 smithi134 ceph-mon[31708]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:26.283 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:25 smithi081 ceph-mon[28640]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:26.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:25 smithi146 ceph-mon[32357]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:28.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:27 smithi081 ceph-mon[28640]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:28.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:27 smithi146 ceph-mon[32357]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:28.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:27 smithi134 ceph-mon[31708]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:29.333 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:29.333 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:29.333 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:39:29.333 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:29 smithi081 ceph-mon[28640]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:29.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:29.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:29.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:39:29.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:29 smithi134 ceph-mon[31708]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:29.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:29.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:29.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:39:29.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:29 smithi146 ceph-mon[32357]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:31.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:31 smithi081 ceph-mon[28640]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:31.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:31 smithi146 ceph-mon[32357]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:31.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:31 smithi134 ceph-mon[31708]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:32.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:32.949+0000 7fad81600700 1 -- 172.21.15.81:0/601045951 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fad840639a0 con 0x7fad6c0b2900 2024-05-03T16:39:32.951 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 6 on host 'smithi081' 2024-05-03T16:39:32.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:32.953+0000 7fad8b400700 1 -- 172.21.15.81:0/601045951 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fad6c0b2900 msgr2=0x7fad6c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:39:32.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:32.953+0000 7fad8b400700 1 --2- 172.21.15.81:0/601045951 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fad6c0b2900 0x7fad6c0b4dc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fad780060b0 tx=0x7fad78007790 comp rx=0 tx=0).stop 2024-05-03T16:39:32.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:32.953+0000 7fad8b400700 1 -- 172.21.15.81:0/601045951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad841030a0 msgr2=0x7fad841a2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:39:32.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:32.953+0000 7fad8b400700 1 --2- 172.21.15.81:0/601045951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad841030a0 0x7fad841a2d40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fad7c005910 tx=0x7fad7c00bfa0 comp rx=0 tx=0).stop 2024-05-03T16:39:32.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:32.953+0000 7fad8b400700 1 -- 172.21.15.81:0/601045951 shutdown_connections 2024-05-03T16:39:32.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:32.953+0000 7fad8b400700 1 --2- 172.21.15.81:0/601045951 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fad6c0b2900 0x7fad6c0b4dc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:39:32.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:32.953+0000 7fad8b400700 1 --2- 172.21.15.81:0/601045951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad84101d80 0x7fad8419b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:39:32.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:32.953+0000 7fad8b400700 1 --2- 172.21.15.81:0/601045951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad841030a0 0x7fad841a2d40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:39:32.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:32.953+0000 7fad8b400700 1 --2- 172.21.15.81:0/601045951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad841026e0 0x7fad8419bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:39:32.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:32.953+0000 7fad8b400700 1 -- 172.21.15.81:0/601045951 >> 172.21.15.81:0/601045951 conn(0x7fad840fd9a0 msgr2=0x7fad840ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:39:32.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:32.953+0000 7fad8b400700 1 -- 172.21.15.81:0/601045951 shutdown_connections 2024-05-03T16:39:32.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:39:32.953+0000 7fad8b400700 1 -- 172.21.15.81:0/601045951 wait complete. 2024-05-03T16:39:33.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:32 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:33.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:32 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:33.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:32 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:33.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:32 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:39:33.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:32 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:33.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:32 smithi134 ceph-mon[31708]: from='osd.6 [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-03T16:39:33.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:32 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:33.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:32 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:33.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:32 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:33.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:32 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:39:33.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:32 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:33.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:32 smithi081 ceph-mon[28640]: from='osd.6 [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-03T16:39:33.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:32 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:33.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:32 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:33.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:32 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:33.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:32 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:39:33.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:32 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:33.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:32 smithi146 ceph-mon[32357]: from='osd.6 [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-03T16:39:33.899 DEBUG:teuthology.orchestra.run.smithi081:osd.6> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.6.service 2024-05-03T16:39:33.906 INFO:tasks.cephadm:Deploying osd.7 on smithi134 with /dev/vg_nvme/lv_2... 2024-05-03T16:39:33.907 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-03T16:39:34.197 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:33 smithi081 ceph-mon[28640]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:34.197 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:33 smithi081 ceph-mon[28640]: from='osd.6 [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-03T16:39:34.197 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:33 smithi081 ceph-mon[28640]: osdmap e41: 7 total, 6 up, 7 in 2024-05-03T16:39:34.197 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:33 smithi081 ceph-mon[28640]: from='osd.6 [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-03T16:39:34.197 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:33 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T16:39:34.197 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:33 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:34.198 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:33 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:39:34.198 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:33 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:34.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:33 smithi134 ceph-mon[31708]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:34.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:33 smithi134 ceph-mon[31708]: from='osd.6 [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-03T16:39:34.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:33 smithi134 ceph-mon[31708]: osdmap e41: 7 total, 6 up, 7 in 2024-05-03T16:39:34.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:33 smithi134 ceph-mon[31708]: from='osd.6 [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-03T16:39:34.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:33 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T16:39:34.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:33 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:34.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:33 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:39:34.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:33 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:34.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:33 smithi146 ceph-mon[32357]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:34.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:33 smithi146 ceph-mon[32357]: from='osd.6 [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-03T16:39:34.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:33 smithi146 ceph-mon[32357]: osdmap e41: 7 total, 6 up, 7 in 2024-05-03T16:39:34.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:33 smithi146 ceph-mon[32357]: from='osd.6 [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-03T16:39:34.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:33 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T16:39:34.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:33 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:34.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:33 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:39:34.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:33 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:34.339 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T16:39:35.157 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:34 smithi081 ceph-mon[28640]: from='osd.6 [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-03T16:39:35.157 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:34 smithi081 ceph-mon[28640]: osdmap e42: 7 total, 6 up, 7 in 2024-05-03T16:39:35.157 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:34 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T16:39:35.157 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:34 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T16:39:35.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:34 smithi134 ceph-mon[31708]: from='osd.6 [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-03T16:39:35.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:34 smithi134 ceph-mon[31708]: osdmap e42: 7 total, 6 up, 7 in 2024-05-03T16:39:35.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:34 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T16:39:35.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:34 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T16:39:35.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:34 smithi146 ceph-mon[32357]: from='osd.6 [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-03T16:39:35.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:34 smithi146 ceph-mon[32357]: osdmap e42: 7 total, 6 up, 7 in 2024-05-03T16:39:35.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:34 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T16:39:35.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:34 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T16:39:36.179 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:35 smithi081 ceph-mon[28640]: purged_snaps scrub starts 2024-05-03T16:39:36.179 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:35 smithi081 ceph-mon[28640]: purged_snaps scrub ok 2024-05-03T16:39:36.179 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:35 smithi081 ceph-mon[28640]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:36.179 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:35 smithi081 ceph-mon[28640]: osd.6 [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020] boot 2024-05-03T16:39:36.179 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:35 smithi081 ceph-mon[28640]: osdmap e43: 7 total, 7 up, 7 in 2024-05-03T16:39:36.180 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:35 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T16:39:36.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:35 smithi134 ceph-mon[31708]: purged_snaps scrub starts 2024-05-03T16:39:36.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:35 smithi134 ceph-mon[31708]: purged_snaps scrub ok 2024-05-03T16:39:36.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:35 smithi134 ceph-mon[31708]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:36.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:35 smithi134 ceph-mon[31708]: osd.6 [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020] boot 2024-05-03T16:39:36.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:35 smithi134 ceph-mon[31708]: osdmap e43: 7 total, 7 up, 7 in 2024-05-03T16:39:36.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:35 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T16:39:36.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:35 smithi146 ceph-mon[32357]: purged_snaps scrub starts 2024-05-03T16:39:36.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:35 smithi146 ceph-mon[32357]: purged_snaps scrub ok 2024-05-03T16:39:36.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:35 smithi146 ceph-mon[32357]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-03T16:39:36.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:35 smithi146 ceph-mon[32357]: osd.6 [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020] boot 2024-05-03T16:39:36.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:35 smithi146 ceph-mon[32357]: osdmap e43: 7 total, 7 up, 7 in 2024-05-03T16:39:36.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:35 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T16:39:37.142 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-03T16:39:37.142 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-03T16:39:37.142 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-05-03T16:39:37.142 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-05-03T16:39:37.142 INFO:teuthology.orchestra.run.smithi134.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0390707 s, 268 MB/s 2024-05-03T16:39:37.142 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-05-03T16:39:37.186 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:36 smithi134 ceph-mon[31708]: osdmap e44: 7 total, 7 up, 7 in 2024-05-03T16:39:37.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:36 smithi081 ceph-mon[28640]: osdmap e44: 7 total, 7 up, 7 in 2024-05-03T16:39:37.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:36 smithi146 ceph-mon[32357]: osdmap e44: 7 total, 7 up, 7 in 2024-05-03T16:39:38.016 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_2 2024-05-03T16:39:38.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:37 smithi134 ceph-mon[31708]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:38.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:37 smithi081 ceph-mon[28640]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:38.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:37 smithi146 ceph-mon[32357]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:38.446 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T16:39:40.202 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:39 smithi134 ceph-mon[31708]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:40.202 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:39 smithi134 ceph-mon[31708]: Detected new or changed devices on smithi081 2024-05-03T16:39:40.202 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:40.202 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:40.202 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:39:40.202 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:39:40.202 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:39:40.202 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:39 smithi134 ceph-mon[31708]: Adjusting osd_memory_target on smithi081 to 5696M 2024-05-03T16:39:40.203 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:40.203 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:40.203 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:39:40.203 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:40.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:39 smithi081 ceph-mon[28640]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:40.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:39 smithi081 ceph-mon[28640]: Detected new or changed devices on smithi081 2024-05-03T16:39:40.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:40.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:40.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:39:40.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:39:40.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:39:40.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:39 smithi081 ceph-mon[28640]: Adjusting osd_memory_target on smithi081 to 5696M 2024-05-03T16:39:40.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:40.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:40.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:39:40.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:40.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:39 smithi146 ceph-mon[32357]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:40.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:39 smithi146 ceph-mon[32357]: Detected new or changed devices on smithi081 2024-05-03T16:39:40.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:40.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:40.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:39:40.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:39:40.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:39:40.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:39 smithi146 ceph-mon[32357]: Adjusting osd_memory_target on smithi081 to 5696M 2024-05-03T16:39:40.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:40.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:40.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:39:40.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:39:40.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.692+0000 7f29be600700 1 -- 172.21.15.134:0/1858443344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b810ac30 msgr2=0x7f29b810b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:39:40.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.692+0000 7f29be600700 1 --2- 172.21.15.134:0/1858443344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b810ac30 0x7f29b810b090 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f29a40099c0 tx=0x7f29a4009cd0 comp rx=0 tx=0).stop 2024-05-03T16:39:40.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.692+0000 7f29be600700 1 -- 172.21.15.134:0/1858443344 shutdown_connections 2024-05-03T16:39:40.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.692+0000 7f29be600700 1 --2- 172.21.15.134:0/1858443344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29b8109a30 0x7f29b8109e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:39:40.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.692+0000 7f29be600700 1 --2- 172.21.15.134:0/1858443344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29b810b5d0 0x7f29b8111e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:39:40.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.692+0000 7f29be600700 1 --2- 172.21.15.134:0/1858443344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b810ac30 0x7f29b810b090 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:39:40.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.692+0000 7f29be600700 1 -- 172.21.15.134:0/1858443344 >> 172.21.15.134:0/1858443344 conn(0x7f29b8078a00 msgr2=0x7f29b807ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:39:40.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.692+0000 7f29be600700 1 -- 172.21.15.134:0/1858443344 shutdown_connections 2024-05-03T16:39:40.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.692+0000 7f29be600700 1 -- 172.21.15.134:0/1858443344 wait complete. 2024-05-03T16:39:40.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.694+0000 7f29be600700 1 Processor -- start 2024-05-03T16:39:40.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.694+0000 7f29be600700 1 -- start start 2024-05-03T16:39:40.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.694+0000 7f29be600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29b8109a30 0x7f29b819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:39:40.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.694+0000 7f29be600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29b810ac30 0x7f29b81a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:39:40.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.694+0000 7f29be600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b810b5d0 0x7f29b81a7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:39:40.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.694+0000 7f29be600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29b81154c0 con 0x7f29b8109a30 2024-05-03T16:39:40.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.694+0000 7f29be600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8115340 con 0x7f29b810b5d0 2024-05-03T16:39:40.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.694+0000 7f29be600700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8115640 con 0x7f29b810ac30 2024-05-03T16:39:40.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.695+0000 7f29bdc00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b810b5d0 0x7f29b81a7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:39:40.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.695+0000 7f29bdc00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b810b5d0 0x7f29b81a7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57336/0 (socket says 172.21.15.134:57336) 2024-05-03T16:39:40.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.695+0000 7f29bdc00700 1 -- 172.21.15.134:0/409531661 learned_addr learned my addr 172.21.15.134:0/409531661 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-05-03T16:39:40.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.695+0000 7f29b7e00700 1 --2- 172.21.15.134:0/409531661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29b810ac30 0x7f29b81a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:39:40.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.695+0000 7f29bd200700 1 --2- 172.21.15.134:0/409531661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29b8109a30 0x7f29b819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:39:40.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.695+0000 7f29bdc00700 1 -- 172.21.15.134:0/409531661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29b810ac30 msgr2=0x7f29b81a00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:39:40.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.695+0000 7f29bdc00700 1 --2- 172.21.15.134:0/409531661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29b810ac30 0x7f29b81a00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:39:40.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.695+0000 7f29bdc00700 1 -- 172.21.15.134:0/409531661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29b8109a30 msgr2=0x7f29b819fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:39:40.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.695+0000 7f29bdc00700 1 --2- 172.21.15.134:0/409531661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29b8109a30 0x7f29b819fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:39:40.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.695+0000 7f29bdc00700 1 -- 172.21.15.134:0/409531661 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b81a7810 con 0x7f29b810b5d0 2024-05-03T16:39:40.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.695+0000 7f29bdc00700 1 --2- 172.21.15.134:0/409531661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b810b5d0 0x7f29b81a7170 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f29b000b970 tx=0x7f29b000bd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:39:40.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.696+0000 7f29b5600700 1 -- 172.21.15.134:0/409531661 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0019070 con 0x7f29b810b5d0 2024-05-03T16:39:40.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.696+0000 7f29b5600700 1 -- 172.21.15.134:0/409531661 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29b000ce40 con 0x7f29b810b5d0 2024-05-03T16:39:40.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.696+0000 7f29be600700 1 -- 172.21.15.134:0/409531661 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b81a7b00 con 0x7f29b810b5d0 2024-05-03T16:39:40.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.696+0000 7f29b5600700 1 -- 172.21.15.134:0/409531661 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0007370 con 0x7f29b810b5d0 2024-05-03T16:39:40.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.696+0000 7f29be600700 1 -- 172.21.15.134:0/409531661 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b81a8040 con 0x7f29b810b5d0 2024-05-03T16:39:40.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.697+0000 7f29be600700 1 -- 172.21.15.134:0/409531661 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b806a190 con 0x7f29b810b5d0 2024-05-03T16:39:40.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.701+0000 7f29b5600700 1 -- 172.21.15.134:0/409531661 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f29b001c070 con 0x7f29b810b5d0 2024-05-03T16:39:40.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.702+0000 7f29b5600700 1 --2- 172.21.15.134:0/409531661 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f29a00b2900 0x7f29a00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:39:40.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.703+0000 7f29b5600700 1 -- 172.21.15.134:0/409531661 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4965+0+0 (secure 0 0 0) 0x7f29b00e1250 con 0x7f29b810b5d0 2024-05-03T16:39:40.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.703+0000 7f29bd200700 1 --2- 172.21.15.134:0/409531661 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f29a00b2900 0x7f29a00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:39:40.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.704+0000 7f29bd200700 1 --2- 172.21.15.134:0/409531661 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f29a00b2900 0x7f29a00b4dc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f29ac006fd0 tx=0x7f29ac008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:39:40.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.706+0000 7f29b5600700 1 -- 172.21.15.134:0/409531661 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f29b0023070 con 0x7f29b810b5d0 2024-05-03T16:39:40.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:39:40.945+0000 7f29be600700 1 -- 172.21.15.134:0/409531661 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f29b80638e0 con 0x7f29a00b2900 2024-05-03T16:39:42.182 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:41 smithi134 ceph-mon[31708]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:42.183 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:41 smithi134 ceph-mon[31708]: from='client.34268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:39:42.183 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:39:42.183 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:39:42.183 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:42.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:41 smithi081 ceph-mon[28640]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:42.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:41 smithi081 ceph-mon[28640]: from='client.34268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:39:42.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:39:42.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:39:42.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:42.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:41 smithi146 ceph-mon[32357]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:41 smithi146 ceph-mon[32357]: from='client.34268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:39:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:39:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:39:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:44.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:43 smithi134 ceph-mon[31708]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:44.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:43 smithi081 ceph-mon[28640]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:44.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:43 smithi146 ceph-mon[32357]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:45.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:44 smithi134 ceph-mon[31708]: from='client.? 172.21.15.134:0/3978596123' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec4b6b84-6c5f-4d07-a747-06610b2cd345"}]: dispatch 2024-05-03T16:39:45.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:44 smithi134 ceph-mon[31708]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec4b6b84-6c5f-4d07-a747-06610b2cd345"}]: dispatch 2024-05-03T16:39:45.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:44 smithi134 ceph-mon[31708]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ec4b6b84-6c5f-4d07-a747-06610b2cd345"}]': finished 2024-05-03T16:39:45.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:44 smithi134 ceph-mon[31708]: osdmap e45: 8 total, 7 up, 8 in 2024-05-03T16:39:45.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T16:39:45.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:44 smithi081 ceph-mon[28640]: from='client.? 172.21.15.134:0/3978596123' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec4b6b84-6c5f-4d07-a747-06610b2cd345"}]: dispatch 2024-05-03T16:39:45.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:44 smithi081 ceph-mon[28640]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec4b6b84-6c5f-4d07-a747-06610b2cd345"}]: dispatch 2024-05-03T16:39:45.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:44 smithi081 ceph-mon[28640]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ec4b6b84-6c5f-4d07-a747-06610b2cd345"}]': finished 2024-05-03T16:39:45.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:44 smithi081 ceph-mon[28640]: osdmap e45: 8 total, 7 up, 8 in 2024-05-03T16:39:45.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T16:39:45.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:44 smithi146 ceph-mon[32357]: from='client.? 172.21.15.134:0/3978596123' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec4b6b84-6c5f-4d07-a747-06610b2cd345"}]: dispatch 2024-05-03T16:39:45.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:44 smithi146 ceph-mon[32357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec4b6b84-6c5f-4d07-a747-06610b2cd345"}]: dispatch 2024-05-03T16:39:45.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:44 smithi146 ceph-mon[32357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ec4b6b84-6c5f-4d07-a747-06610b2cd345"}]': finished 2024-05-03T16:39:45.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:44 smithi146 ceph-mon[32357]: osdmap e45: 8 total, 7 up, 8 in 2024-05-03T16:39:45.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T16:39:46.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:45 smithi134 ceph-mon[31708]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:46.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:45 smithi134 ceph-mon[31708]: from='client.? 172.21.15.134:0/3079761606' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:39:46.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:45 smithi081 ceph-mon[28640]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:46.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:45 smithi081 ceph-mon[28640]: from='client.? 172.21.15.134:0/3079761606' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:39:46.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:45 smithi146 ceph-mon[32357]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:46.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:45 smithi146 ceph-mon[32357]: from='client.? 172.21.15.134:0/3079761606' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:39:48.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:47 smithi134 ceph-mon[31708]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:48.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:47 smithi081 ceph-mon[28640]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:48.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:47 smithi146 ceph-mon[32357]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:50.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:49 smithi134 ceph-mon[31708]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:50.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:49 smithi081 ceph-mon[28640]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:50.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:49 smithi146 ceph-mon[32357]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:52.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:51 smithi081 ceph-mon[28640]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:52.282 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:51 smithi134 ceph-mon[31708]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:52.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:51 smithi146 ceph-mon[32357]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:54.153 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:53 smithi134 ceph-mon[31708]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:54.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:53 smithi081 ceph-mon[28640]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:54.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:53 smithi146 ceph-mon[32357]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:55.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:54 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-03T16:39:55.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:54 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:55.248 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:54 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-03T16:39:55.248 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:54 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:55.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:54 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-03T16:39:55.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:54 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:39:56.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:55 smithi081 ceph-mon[28640]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:56.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:55 smithi081 ceph-mon[28640]: Deploying daemon osd.7 on smithi134 2024-05-03T16:39:56.310 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:55 smithi134 ceph-mon[31708]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:56.310 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:55 smithi134 ceph-mon[31708]: Deploying daemon osd.7 on smithi134 2024-05-03T16:39:56.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:55 smithi146 ceph-mon[32357]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:56.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:55 smithi146 ceph-mon[32357]: Deploying daemon osd.7 on smithi134 2024-05-03T16:39:58.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:39:57 smithi134 ceph-mon[31708]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:58.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:39:57 smithi146 ceph-mon[32357]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:39:58.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:39:57 smithi081 ceph-mon[28640]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:40:00.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:00 smithi146 ceph-mon[32357]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:40:00.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:00 smithi134 ceph-mon[31708]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:40:00.293 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:00 smithi081 ceph-mon[28640]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:40:01.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:01 smithi134 ceph-mon[31708]: overall HEALTH_OK 2024-05-03T16:40:01.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:01 smithi146 ceph-mon[32357]: overall HEALTH_OK 2024-05-03T16:40:01.325 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:01 smithi081 ceph-mon[28640]: overall HEALTH_OK 2024-05-03T16:40:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:02 smithi134 ceph-mon[31708]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:40:02.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:02 smithi146 ceph-mon[32357]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:40:02.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:02 smithi081 ceph-mon[28640]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:40:03.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:03 smithi134 ceph-mon[31708]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:40:03.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:03 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:03.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:03 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:03.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:03 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:40:03.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:03 smithi081 ceph-mon[28640]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:40:03.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:03 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:03.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:03 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:03.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:03 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:40:03.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:03 smithi146 ceph-mon[32357]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:40:03.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:03 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:03.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:03 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:03.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:03 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:40:05.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:05 smithi134 ceph-mon[31708]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:40:05.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:05 smithi081 ceph-mon[28640]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:40:05.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:05 smithi146 ceph-mon[32357]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:40:06.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:06 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:06.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:06 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:06.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:06 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:06.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:06 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:40:06.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:06 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:06.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:06 smithi134 ceph-mon[31708]: from='osd.7 [v2:172.21.15.134:6816/3241993481,v1:172.21.15.134:6817/3241993481]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-03T16:40:06.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:06 smithi134 ceph-mon[31708]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-03T16:40:06.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:06 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:06.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:06 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:06.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:06 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:06.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:06 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:40:06.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:06 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:06.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:06 smithi081 ceph-mon[28640]: from='osd.7 [v2:172.21.15.134:6816/3241993481,v1:172.21.15.134:6817/3241993481]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-03T16:40:06.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:06 smithi081 ceph-mon[28640]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-03T16:40:07.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:06 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:07.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:06 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:07.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:06 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:07.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:06 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:40:07.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:06 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:07.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:06 smithi146 ceph-mon[32357]: from='osd.7 [v2:172.21.15.134:6816/3241993481,v1:172.21.15.134:6817/3241993481]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-03T16:40:07.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:06 smithi146 ceph-mon[32357]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-03T16:40:07.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:40:07.256+0000 7f29b5600700 1 -- 172.21.15.134:0/409531661 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f29b80638e0 con 0x7f29a00b2900 2024-05-03T16:40:07.259 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 7 on host 'smithi134' 2024-05-03T16:40:07.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:40:07.260+0000 7f29be600700 1 -- 172.21.15.134:0/409531661 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f29a00b2900 msgr2=0x7f29a00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:40:07.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:40:07.260+0000 7f29be600700 1 --2- 172.21.15.134:0/409531661 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f29a00b2900 0x7f29a00b4dc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f29ac006fd0 tx=0x7f29ac008040 comp rx=0 tx=0).stop 2024-05-03T16:40:07.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:40:07.260+0000 7f29be600700 1 -- 172.21.15.134:0/409531661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b810b5d0 msgr2=0x7f29b81a7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:40:07.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:40:07.260+0000 7f29be600700 1 --2- 172.21.15.134:0/409531661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b810b5d0 0x7f29b81a7170 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f29b000b970 tx=0x7f29b000bd30 comp rx=0 tx=0).stop 2024-05-03T16:40:07.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:40:07.260+0000 7f29be600700 1 -- 172.21.15.134:0/409531661 shutdown_connections 2024-05-03T16:40:07.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:40:07.260+0000 7f29be600700 1 --2- 172.21.15.134:0/409531661 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f29a00b2900 0x7f29a00b4dc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:40:07.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:40:07.260+0000 7f29be600700 1 --2- 172.21.15.134:0/409531661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b810b5d0 0x7f29b81a7170 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:40:07.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:40:07.260+0000 7f29be600700 1 --2- 172.21.15.134:0/409531661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29b8109a30 0x7f29b819fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:40:07.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:40:07.260+0000 7f29be600700 1 --2- 172.21.15.134:0/409531661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29b810ac30 0x7f29b81a00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:40:07.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:40:07.260+0000 7f29be600700 1 -- 172.21.15.134:0/409531661 >> 172.21.15.134:0/409531661 conn(0x7f29b8078a00 msgr2=0x7f29b810e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:40:07.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:40:07.260+0000 7f29be600700 1 -- 172.21.15.134:0/409531661 shutdown_connections 2024-05-03T16:40:07.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:40:07.260+0000 7f29be600700 1 -- 172.21.15.134:0/409531661 wait complete. 2024-05-03T16:40:07.963 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:07 smithi134 ceph-mon[31708]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:40:07.963 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:07 smithi134 ceph-mon[31708]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-03T16:40:07.963 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:07 smithi134 ceph-mon[31708]: osdmap e46: 8 total, 7 up, 8 in 2024-05-03T16:40:07.963 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:07 smithi134 ceph-mon[31708]: from='osd.7 [v2:172.21.15.134:6816/3241993481,v1:172.21.15.134:6817/3241993481]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:40:07.963 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:07 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T16:40:07.963 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:07 smithi134 ceph-mon[31708]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:40:07.963 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:07 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:07.963 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:07 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:40:07.964 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:07 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:07.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:07 smithi081 ceph-mon[28640]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:40:07.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:07 smithi081 ceph-mon[28640]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-03T16:40:07.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:07 smithi081 ceph-mon[28640]: osdmap e46: 8 total, 7 up, 8 in 2024-05-03T16:40:07.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:07 smithi081 ceph-mon[28640]: from='osd.7 [v2:172.21.15.134:6816/3241993481,v1:172.21.15.134:6817/3241993481]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:40:07.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:07 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T16:40:07.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:07 smithi081 ceph-mon[28640]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:40:07.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:07 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:07.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:07 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:40:07.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:07 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:08.026 DEBUG:teuthology.orchestra.run.smithi134:osd.7> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.7.service 2024-05-03T16:40:08.033 INFO:tasks.cephadm:Deploying osd.8 on smithi146 with /dev/vg_nvme/lv_2... 2024-05-03T16:40:08.033 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-03T16:40:08.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:07 smithi146 ceph-mon[32357]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:40:08.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:07 smithi146 ceph-mon[32357]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-03T16:40:08.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:07 smithi146 ceph-mon[32357]: osdmap e46: 8 total, 7 up, 8 in 2024-05-03T16:40:08.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:07 smithi146 ceph-mon[32357]: from='osd.7 [v2:172.21.15.134:6816/3241993481,v1:172.21.15.134:6817/3241993481]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:40:08.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T16:40:08.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:07 smithi146 ceph-mon[32357]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:40:08.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:08.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:40:08.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:08.467 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T16:40:08.957 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:08 smithi146 ceph-mon[32357]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-03T16:40:08.957 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:08 smithi146 ceph-mon[32357]: osdmap e47: 8 total, 7 up, 8 in 2024-05-03T16:40:08.957 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:08 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T16:40:08.958 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:08 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T16:40:08.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:08 smithi134 ceph-mon[31708]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-03T16:40:08.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:08 smithi134 ceph-mon[31708]: osdmap e47: 8 total, 7 up, 8 in 2024-05-03T16:40:08.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:08 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T16:40:08.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:08 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T16:40:08.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:08 smithi081 ceph-mon[28640]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-03T16:40:08.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:08 smithi081 ceph-mon[28640]: osdmap e47: 8 total, 7 up, 8 in 2024-05-03T16:40:08.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:08 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T16:40:08.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:08 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T16:40:09.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:09 smithi146 ceph-mon[32357]: purged_snaps scrub starts 2024-05-03T16:40:09.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:09 smithi146 ceph-mon[32357]: purged_snaps scrub ok 2024-05-03T16:40:09.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:09 smithi146 ceph-mon[32357]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:40:09.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:09 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T16:40:09.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:09 smithi146 ceph-mon[32357]: osd.7 [v2:172.21.15.134:6816/3241993481,v1:172.21.15.134:6817/3241993481] boot 2024-05-03T16:40:09.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:09 smithi146 ceph-mon[32357]: osdmap e48: 8 total, 8 up, 8 in 2024-05-03T16:40:09.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:09 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T16:40:09.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:09 smithi146 ceph-mon[32357]: osdmap e49: 8 total, 8 up, 8 in 2024-05-03T16:40:09.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:09 smithi134 ceph-mon[31708]: purged_snaps scrub starts 2024-05-03T16:40:09.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:09 smithi134 ceph-mon[31708]: purged_snaps scrub ok 2024-05-03T16:40:09.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:09 smithi134 ceph-mon[31708]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:40:09.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:09 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T16:40:09.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:09 smithi134 ceph-mon[31708]: osd.7 [v2:172.21.15.134:6816/3241993481,v1:172.21.15.134:6817/3241993481] boot 2024-05-03T16:40:09.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:09 smithi134 ceph-mon[31708]: osdmap e48: 8 total, 8 up, 8 in 2024-05-03T16:40:09.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:09 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T16:40:09.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:09 smithi134 ceph-mon[31708]: osdmap e49: 8 total, 8 up, 8 in 2024-05-03T16:40:09.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:09 smithi081 ceph-mon[28640]: purged_snaps scrub starts 2024-05-03T16:40:09.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:09 smithi081 ceph-mon[28640]: purged_snaps scrub ok 2024-05-03T16:40:09.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:09 smithi081 ceph-mon[28640]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T16:40:09.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:09 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T16:40:09.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:09 smithi081 ceph-mon[28640]: osd.7 [v2:172.21.15.134:6816/3241993481,v1:172.21.15.134:6817/3241993481] boot 2024-05-03T16:40:09.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:09 smithi081 ceph-mon[28640]: osdmap e48: 8 total, 8 up, 8 in 2024-05-03T16:40:09.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:09 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T16:40:09.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:09 smithi081 ceph-mon[28640]: osdmap e49: 8 total, 8 up, 8 in 2024-05-03T16:40:10.922 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:10 smithi146 ceph-mon[32357]: osdmap e50: 8 total, 8 up, 8 in 2024-05-03T16:40:11.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:10 smithi134 ceph-mon[31708]: osdmap e50: 8 total, 8 up, 8 in 2024-05-03T16:40:11.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:10 smithi081 ceph-mon[28640]: osdmap e50: 8 total, 8 up, 8 in 2024-05-03T16:40:11.551 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-03T16:40:11.552 INFO:teuthology.orchestra.run.smithi146.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-03T16:40:11.552 INFO:teuthology.orchestra.run.smithi146.stderr: stderr: 10+0 records in 2024-05-03T16:40:11.552 INFO:teuthology.orchestra.run.smithi146.stderr:10+0 records out 2024-05-03T16:40:11.552 INFO:teuthology.orchestra.run.smithi146.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.032864 s, 319 MB/s 2024-05-03T16:40:11.552 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping successful for: 2024-05-03T16:40:11.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:11 smithi146 ceph-mon[32357]: pgmap v223: 1 pgs: 1 peering; 0 B data, 228 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:12.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:11 smithi134 ceph-mon[31708]: pgmap v223: 1 pgs: 1 peering; 0 B data, 228 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:11 smithi081 ceph-mon[28640]: pgmap v223: 1 pgs: 1 peering; 0 B data, 228 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:12.473 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi146:vg_nvme/lv_2 2024-05-03T16:40:12.944 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T16:40:13.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:13 smithi146 ceph-mon[32357]: pgmap v224: 1 pgs: 1 peering; 0 B data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:13.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:13 smithi146 ceph-mon[32357]: Detected new or changed devices on smithi134 2024-05-03T16:40:13.814 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:13.814 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:13.814 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:40:13.814 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:40:13.814 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:40:13.814 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:13 smithi146 ceph-mon[32357]: Adjusting osd_memory_target on smithi134 to 5696M 2024-05-03T16:40:13.814 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:13.814 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:13.814 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:40:13.814 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:13.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:13 smithi134 ceph-mon[31708]: pgmap v224: 1 pgs: 1 peering; 0 B data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:13.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:13 smithi134 ceph-mon[31708]: Detected new or changed devices on smithi134 2024-05-03T16:40:13.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:13.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:13.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:40:13.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:40:13.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:40:13.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:13 smithi134 ceph-mon[31708]: Adjusting osd_memory_target on smithi134 to 5696M 2024-05-03T16:40:13.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:13.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:13.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:40:13.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:13.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:13 smithi081 ceph-mon[28640]: pgmap v224: 1 pgs: 1 peering; 0 B data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:13.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:13 smithi081 ceph-mon[28640]: Detected new or changed devices on smithi134 2024-05-03T16:40:13.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:13.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:13.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:40:13.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:40:13.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:40:13.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:13 smithi081 ceph-mon[28640]: Adjusting osd_memory_target on smithi134 to 5696M 2024-05-03T16:40:13.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:13.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:13.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:40:13.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:15.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.338+0000 7faf33200700 1 -- 172.21.15.146:0/4109144574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf2c10b5d0 msgr2=0x7faf2c111e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:40:15.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.338+0000 7faf33200700 1 --2- 172.21.15.146:0/4109144574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf2c10b5d0 0x7faf2c111e80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faf2800b0a0 tx=0x7faf2800b3b0 comp rx=0 tx=0).stop 2024-05-03T16:40:15.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.338+0000 7faf33200700 1 -- 172.21.15.146:0/4109144574 shutdown_connections 2024-05-03T16:40:15.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.338+0000 7faf33200700 1 --2- 172.21.15.146:0/4109144574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf2c10b5d0 0x7faf2c111e80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:40:15.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.338+0000 7faf33200700 1 --2- 172.21.15.146:0/4109144574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf2c109a30 0x7faf2c109e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:40:15.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.338+0000 7faf33200700 1 --2- 172.21.15.146:0/4109144574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf2c10ac30 0x7faf2c10b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:40:15.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.338+0000 7faf33200700 1 -- 172.21.15.146:0/4109144574 >> 172.21.15.146:0/4109144574 conn(0x7faf2c078a00 msgr2=0x7faf2c07ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:40:15.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.338+0000 7faf33200700 1 -- 172.21.15.146:0/4109144574 shutdown_connections 2024-05-03T16:40:15.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.338+0000 7faf33200700 1 -- 172.21.15.146:0/4109144574 wait complete. 2024-05-03T16:40:15.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.339+0000 7faf33200700 1 Processor -- start 2024-05-03T16:40:15.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.339+0000 7faf33200700 1 -- start start 2024-05-03T16:40:15.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.339+0000 7faf33200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf2c109a30 0x7faf2c19f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:40:15.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.339+0000 7faf33200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf2c10ac30 0x7faf2c19fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:40:15.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.339+0000 7faf33200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf2c10b5d0 0x7faf2c1a6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:40:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.339+0000 7faf33200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c1153d0 con 0x7faf2c109a30 2024-05-03T16:40:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.339+0000 7faf33200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c115250 con 0x7faf2c10b5d0 2024-05-03T16:40:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.339+0000 7faf33200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c115550 con 0x7faf2c10ac30 2024-05-03T16:40:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.340+0000 7faf31400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf2c10ac30 0x7faf2c19fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:40:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.340+0000 7faf31400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf2c10ac30 0x7faf2c19fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47112/0 (socket says 172.21.15.146:47112) 2024-05-03T16:40:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.340+0000 7faf31400700 1 -- 172.21.15.146:0/3636886830 learned_addr learned my addr 172.21.15.146:0/3636886830 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-05-03T16:40:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.340+0000 7faf31e00700 1 --2- 172.21.15.146:0/3636886830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf2c109a30 0x7faf2c19f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:40:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.340+0000 7faf32800700 1 --2- 172.21.15.146:0/3636886830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf2c10b5d0 0x7faf2c1a6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:40:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.340+0000 7faf31400700 1 -- 172.21.15.146:0/3636886830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf2c10b5d0 msgr2=0x7faf2c1a6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:40:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.340+0000 7faf31400700 1 --2- 172.21.15.146:0/3636886830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf2c10b5d0 0x7faf2c1a6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:40:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.340+0000 7faf31400700 1 -- 172.21.15.146:0/3636886830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf2c109a30 msgr2=0x7faf2c19f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:40:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.340+0000 7faf31400700 1 --2- 172.21.15.146:0/3636886830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf2c109a30 0x7faf2c19f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:40:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.340+0000 7faf31400700 1 -- 172.21.15.146:0/3636886830 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2c1a7610 con 0x7faf2c10ac30 2024-05-03T16:40:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.340+0000 7faf32800700 1 --2- 172.21.15.146:0/3636886830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf2c10b5d0 0x7faf2c1a6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:40:15.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.341+0000 7faf31400700 1 --2- 172.21.15.146:0/3636886830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf2c10ac30 0x7faf2c19fef0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00c9a0 tx=0x7faf1c00cd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:40:15.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.341+0000 7faf26a00700 1 -- 172.21.15.146:0/3636886830 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c007a60 con 0x7faf2c10ac30 2024-05-03T16:40:15.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.341+0000 7faf26a00700 1 -- 172.21.15.146:0/3636886830 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf1c004cc0 con 0x7faf2c10ac30 2024-05-03T16:40:15.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.341+0000 7faf26a00700 1 -- 172.21.15.146:0/3636886830 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0055b0 con 0x7faf2c10ac30 2024-05-03T16:40:15.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.341+0000 7faf33200700 1 -- 172.21.15.146:0/3636886830 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf2c1a7900 con 0x7faf2c10ac30 2024-05-03T16:40:15.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.341+0000 7faf33200700 1 -- 172.21.15.146:0/3636886830 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf2c1a7df0 con 0x7faf2c10ac30 2024-05-03T16:40:15.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.342+0000 7faf33200700 1 -- 172.21.15.146:0/3636886830 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf2c06a190 con 0x7faf2c10ac30 2024-05-03T16:40:15.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.345+0000 7faf26a00700 1 -- 172.21.15.146:0/3636886830 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7faf1c007c90 con 0x7faf2c10ac30 2024-05-03T16:40:15.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.347+0000 7faf26a00700 1 --2- 172.21.15.146:0/3636886830 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7faf140b2880 0x7faf140b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:40:15.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.347+0000 7faf26a00700 1 -- 172.21.15.146:0/3636886830 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5397+0+0 (secure 0 0 0) 0x7faf1c0e1800 con 0x7faf2c10ac30 2024-05-03T16:40:15.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.348+0000 7faf31e00700 1 --2- 172.21.15.146:0/3636886830 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7faf140b2880 0x7faf140b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:40:15.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.348+0000 7faf26a00700 1 -- 172.21.15.146:0/3636886830 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7faf1c0aa100 con 0x7faf2c10ac30 2024-05-03T16:40:15.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.348+0000 7faf31e00700 1 --2- 172.21.15.146:0/3636886830 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7faf140b2880 0x7faf140b4d40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faf20005fd0 tx=0x7faf20005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:40:15.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:15.590+0000 7faf33200700 1 -- 172.21.15.146:0/3636886830 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7faf2c0638e0 con 0x7faf140b2880 2024-05-03T16:40:15.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:15 smithi134 ceph-mon[31708]: pgmap v225: 1 pgs: 1 peering; 0 B data, 228 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:15.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:15 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:40:15.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:15 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:40:15.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:15 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:15.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:15 smithi081 ceph-mon[28640]: pgmap v225: 1 pgs: 1 peering; 0 B data, 228 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:15.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:15 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:40:15.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:15 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:40:15.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:15 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:16.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:15 smithi146 ceph-mon[32357]: pgmap v225: 1 pgs: 1 peering; 0 B data, 228 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:16.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:15 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:40:16.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:15 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:40:16.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:15 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:16.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:16 smithi146 ceph-mon[32357]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:40:16.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:16 smithi134 ceph-mon[31708]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:40:16.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:16 smithi081 ceph-mon[28640]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:40:17.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:17 smithi134 ceph-mon[31708]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:17.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:17 smithi081 ceph-mon[28640]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:18.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:17 smithi146 ceph-mon[32357]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:19.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:19 smithi134 ceph-mon[31708]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:19.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:19 smithi081 ceph-mon[28640]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:20.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:19 smithi146 ceph-mon[32357]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:20.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:20 smithi134 ceph-mon[31708]: from='client.? 172.21.15.146:0/3413900863' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02b1b0fd-837c-4c29-bedb-54fa2ee7531d"}]: dispatch 2024-05-03T16:40:20.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:20 smithi134 ceph-mon[31708]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02b1b0fd-837c-4c29-bedb-54fa2ee7531d"}]: dispatch 2024-05-03T16:40:20.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:20 smithi134 ceph-mon[31708]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "02b1b0fd-837c-4c29-bedb-54fa2ee7531d"}]': finished 2024-05-03T16:40:20.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:20 smithi134 ceph-mon[31708]: osdmap e51: 9 total, 8 up, 9 in 2024-05-03T16:40:20.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:20.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:20 smithi134 ceph-mon[31708]: from='client.? 172.21.15.146:0/4155227683' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:40:20.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:20 smithi081 ceph-mon[28640]: from='client.? 172.21.15.146:0/3413900863' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02b1b0fd-837c-4c29-bedb-54fa2ee7531d"}]: dispatch 2024-05-03T16:40:20.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:20 smithi081 ceph-mon[28640]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02b1b0fd-837c-4c29-bedb-54fa2ee7531d"}]: dispatch 2024-05-03T16:40:20.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:20 smithi081 ceph-mon[28640]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "02b1b0fd-837c-4c29-bedb-54fa2ee7531d"}]': finished 2024-05-03T16:40:20.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:20 smithi081 ceph-mon[28640]: osdmap e51: 9 total, 8 up, 9 in 2024-05-03T16:40:20.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:20.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:20 smithi081 ceph-mon[28640]: from='client.? 172.21.15.146:0/4155227683' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:40:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:20 smithi146 ceph-mon[32357]: from='client.? 172.21.15.146:0/3413900863' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02b1b0fd-837c-4c29-bedb-54fa2ee7531d"}]: dispatch 2024-05-03T16:40:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:20 smithi146 ceph-mon[32357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02b1b0fd-837c-4c29-bedb-54fa2ee7531d"}]: dispatch 2024-05-03T16:40:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:20 smithi146 ceph-mon[32357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "02b1b0fd-837c-4c29-bedb-54fa2ee7531d"}]': finished 2024-05-03T16:40:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:20 smithi146 ceph-mon[32357]: osdmap e51: 9 total, 8 up, 9 in 2024-05-03T16:40:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:20 smithi146 ceph-mon[32357]: from='client.? 172.21.15.146:0/4155227683' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:40:22.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:21 smithi146 ceph-mon[32357]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:22.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:21 smithi134 ceph-mon[31708]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:22.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:21 smithi081 ceph-mon[28640]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:24.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:23 smithi146 ceph-mon[32357]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:24.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:23 smithi134 ceph-mon[31708]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:24.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:23 smithi081 ceph-mon[28640]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:26.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:25 smithi146 ceph-mon[32357]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:26.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:25 smithi134 ceph-mon[31708]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:26.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:25 smithi081 ceph-mon[28640]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:28.027 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:27 smithi146 ceph-mon[32357]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:28.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:27 smithi134 ceph-mon[31708]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:28.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:27 smithi081 ceph-mon[28640]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:30.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:29 smithi146 ceph-mon[32357]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:30.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-03T16:40:30.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:29 smithi134 ceph-mon[31708]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-03T16:40:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:30.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:29 smithi081 ceph-mon[28640]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:30.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-03T16:40:30.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:31.027 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:30 smithi146 ceph-mon[32357]: Deploying daemon osd.8 on smithi146 2024-05-03T16:40:31.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:30 smithi134 ceph-mon[31708]: Deploying daemon osd.8 on smithi146 2024-05-03T16:40:31.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:30 smithi081 ceph-mon[28640]: Deploying daemon osd.8 on smithi146 2024-05-03T16:40:32.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:31 smithi146 ceph-mon[32357]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:32.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:31 smithi134 ceph-mon[31708]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:32.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:31 smithi081 ceph-mon[28640]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:34.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:33 smithi134 ceph-mon[31708]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:34.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:33 smithi081 ceph-mon[28640]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:34.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:33 smithi146 ceph-mon[32357]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:36.096 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:35 smithi134 ceph-mon[31708]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:36.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:35 smithi081 ceph-mon[28640]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:36.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:35 smithi146 ceph-mon[32357]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:38.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:37 smithi146 ceph-mon[32357]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:38.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:37 smithi134 ceph-mon[31708]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:38.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:37 smithi081 ceph-mon[28640]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:39.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:39 smithi081 ceph-mon[28640]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:39.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:39.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:39.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:40:40.006 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:39 smithi146 ceph-mon[32357]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:40.006 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:40.006 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:40.006 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:40:40.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:39 smithi134 ceph-mon[31708]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:40.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:40.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:40.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:40:41.924 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:41 smithi146 ceph-mon[32357]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:41.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:41 smithi081 ceph-mon[28640]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:42.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:41 smithi134 ceph-mon[31708]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:42.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:42 smithi146 ceph-mon[32357]: from='osd.8 [v2:172.21.15.146:6816/2423161684,v1:172.21.15.146:6817/2423161684]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-03T16:40:42.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:42 smithi146 ceph-mon[32357]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-03T16:40:42.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:42 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:42.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:42 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:43.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:42 smithi134 ceph-mon[31708]: from='osd.8 [v2:172.21.15.146:6816/2423161684,v1:172.21.15.146:6817/2423161684]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-03T16:40:43.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:42 smithi134 ceph-mon[31708]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-03T16:40:43.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:42 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:43.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:42 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:43.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:42 smithi081 ceph-mon[28640]: from='osd.8 [v2:172.21.15.146:6816/2423161684,v1:172.21.15.146:6817/2423161684]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-03T16:40:43.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:42 smithi081 ceph-mon[28640]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-03T16:40:43.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:42 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:43.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:42 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:43.907 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:43 smithi146 ceph-mon[32357]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:43.908 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:43 smithi146 ceph-mon[32357]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-03T16:40:43.908 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:43 smithi146 ceph-mon[32357]: from='osd.8 [v2:172.21.15.146:6816/2423161684,v1:172.21.15.146:6817/2423161684]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:40:43.908 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:43 smithi146 ceph-mon[32357]: osdmap e52: 9 total, 8 up, 9 in 2024-05-03T16:40:43.908 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:43 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:43.908 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:43 smithi146 ceph-mon[32357]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:40:44.130 INFO:teuthology.orchestra.run.smithi146.stdout:Created osd(s) 8 on host 'smithi146' 2024-05-03T16:40:44.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:44.127+0000 7faf26a00700 1 -- 172.21.15.146:0/3636886830 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7faf2c0638e0 con 0x7faf140b2880 2024-05-03T16:40:44.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:44.130+0000 7faf33200700 1 -- 172.21.15.146:0/3636886830 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7faf140b2880 msgr2=0x7faf140b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:40:44.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:44.130+0000 7faf33200700 1 --2- 172.21.15.146:0/3636886830 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7faf140b2880 0x7faf140b4d40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faf20005fd0 tx=0x7faf20005e50 comp rx=0 tx=0).stop 2024-05-03T16:40:44.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:44.131+0000 7faf33200700 1 -- 172.21.15.146:0/3636886830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf2c10ac30 msgr2=0x7faf2c19fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:40:44.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:44.131+0000 7faf33200700 1 --2- 172.21.15.146:0/3636886830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf2c10ac30 0x7faf2c19fef0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00c9a0 tx=0x7faf1c00cd60 comp rx=0 tx=0).stop 2024-05-03T16:40:44.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:44.131+0000 7faf33200700 1 -- 172.21.15.146:0/3636886830 shutdown_connections 2024-05-03T16:40:44.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:44.131+0000 7faf33200700 1 --2- 172.21.15.146:0/3636886830 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7faf140b2880 0x7faf140b4d40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:40:44.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:44.131+0000 7faf33200700 1 --2- 172.21.15.146:0/3636886830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf2c10b5d0 0x7faf2c1a6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:40:44.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:44.131+0000 7faf33200700 1 --2- 172.21.15.146:0/3636886830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf2c109a30 0x7faf2c19f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:40:44.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:44.131+0000 7faf33200700 1 --2- 172.21.15.146:0/3636886830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf2c10ac30 0x7faf2c19fef0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:40:44.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:44.131+0000 7faf33200700 1 -- 172.21.15.146:0/3636886830 >> 172.21.15.146:0/3636886830 conn(0x7faf2c078a00 msgr2=0x7faf2c10df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:40:44.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:44.131+0000 7faf33200700 1 -- 172.21.15.146:0/3636886830 shutdown_connections 2024-05-03T16:40:44.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:40:44.131+0000 7faf33200700 1 -- 172.21.15.146:0/3636886830 wait complete. 2024-05-03T16:40:44.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:43 smithi134 ceph-mon[31708]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:44.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:43 smithi134 ceph-mon[31708]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-03T16:40:44.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:43 smithi134 ceph-mon[31708]: from='osd.8 [v2:172.21.15.146:6816/2423161684,v1:172.21.15.146:6817/2423161684]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:40:44.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:43 smithi134 ceph-mon[31708]: osdmap e52: 9 total, 8 up, 9 in 2024-05-03T16:40:44.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:43 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:44.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:43 smithi134 ceph-mon[31708]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:40:44.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:43 smithi081 ceph-mon[28640]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:44.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:43 smithi081 ceph-mon[28640]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-03T16:40:44.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:43 smithi081 ceph-mon[28640]: from='osd.8 [v2:172.21.15.146:6816/2423161684,v1:172.21.15.146:6817/2423161684]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:40:44.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:43 smithi081 ceph-mon[28640]: osdmap e52: 9 total, 8 up, 9 in 2024-05-03T16:40:44.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:43 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:44.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:43 smithi081 ceph-mon[28640]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:40:44.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:44 smithi146 ceph-mon[32357]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-05-03T16:40:44.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:44 smithi146 ceph-mon[32357]: osdmap e53: 9 total, 8 up, 9 in 2024-05-03T16:40:44.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:44.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:44.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:44 smithi146 ceph-mon[32357]: osdmap e54: 9 total, 8 up, 9 in 2024-05-03T16:40:44.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:44.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:44.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:40:44.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:44.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:44.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:44.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:40:45.012 DEBUG:teuthology.orchestra.run.smithi146:osd.8> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.8.service 2024-05-03T16:40:45.019 INFO:tasks.cephadm:Deploying osd.9 on smithi081 with /dev/vg_nvme/lv_1... 2024-05-03T16:40:45.019 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-03T16:40:45.099 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:44 smithi081 ceph-mon[28640]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-05-03T16:40:45.099 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:44 smithi081 ceph-mon[28640]: osdmap e53: 9 total, 8 up, 9 in 2024-05-03T16:40:45.099 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:45.099 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:45.099 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:44 smithi081 ceph-mon[28640]: osdmap e54: 9 total, 8 up, 9 in 2024-05-03T16:40:45.099 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:45.099 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:45.100 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:40:45.100 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:45.100 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:45.100 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:45.100 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:40:45.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:44 smithi134 ceph-mon[31708]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-05-03T16:40:45.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:44 smithi134 ceph-mon[31708]: osdmap e53: 9 total, 8 up, 9 in 2024-05-03T16:40:45.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:45.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:45.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:44 smithi134 ceph-mon[31708]: osdmap e54: 9 total, 8 up, 9 in 2024-05-03T16:40:45.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:45.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:45.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:40:45.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:45.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:45.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:45.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:40:45.458 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:40:45.961 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:45 smithi081 ceph-mon[28640]: purged_snaps scrub starts 2024-05-03T16:40:45.961 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:45 smithi081 ceph-mon[28640]: purged_snaps scrub ok 2024-05-03T16:40:45.961 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:45 smithi081 ceph-mon[28640]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:45.961 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:45 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:45.961 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:45 smithi081 ceph-mon[28640]: osd.8 [v2:172.21.15.146:6816/2423161684,v1:172.21.15.146:6817/2423161684] boot 2024-05-03T16:40:45.961 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:45 smithi081 ceph-mon[28640]: osdmap e55: 9 total, 9 up, 9 in 2024-05-03T16:40:45.961 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:45 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:46.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:45 smithi146 ceph-mon[32357]: purged_snaps scrub starts 2024-05-03T16:40:46.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:45 smithi146 ceph-mon[32357]: purged_snaps scrub ok 2024-05-03T16:40:46.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:45 smithi146 ceph-mon[32357]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:46.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:45 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:46.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:45 smithi146 ceph-mon[32357]: osd.8 [v2:172.21.15.146:6816/2423161684,v1:172.21.15.146:6817/2423161684] boot 2024-05-03T16:40:46.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:45 smithi146 ceph-mon[32357]: osdmap e55: 9 total, 9 up, 9 in 2024-05-03T16:40:46.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:45 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:46.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:45 smithi134 ceph-mon[31708]: purged_snaps scrub starts 2024-05-03T16:40:46.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:45 smithi134 ceph-mon[31708]: purged_snaps scrub ok 2024-05-03T16:40:46.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:45 smithi134 ceph-mon[31708]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-03T16:40:46.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:45 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:46.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:45 smithi134 ceph-mon[31708]: osd.8 [v2:172.21.15.146:6816/2423161684,v1:172.21.15.146:6817/2423161684] boot 2024-05-03T16:40:46.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:45 smithi134 ceph-mon[31708]: osdmap e55: 9 total, 9 up, 9 in 2024-05-03T16:40:46.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:45 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T16:40:46.974 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:46 smithi146 ceph-mon[32357]: osdmap e56: 9 total, 9 up, 9 in 2024-05-03T16:40:47.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:46 smithi134 ceph-mon[31708]: osdmap e56: 9 total, 9 up, 9 in 2024-05-03T16:40:47.229 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:46 smithi081 ceph-mon[28640]: osdmap e56: 9 total, 9 up, 9 in 2024-05-03T16:40:47.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:47 smithi081 ceph-mon[28640]: pgmap v247: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:40:47.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:47 smithi081 ceph-mon[28640]: osdmap e57: 9 total, 9 up, 9 in 2024-05-03T16:40:48.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:47 smithi146 ceph-mon[32357]: pgmap v247: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:40:48.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:47 smithi146 ceph-mon[32357]: osdmap e57: 9 total, 9 up, 9 in 2024-05-03T16:40:48.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:47 smithi134 ceph-mon[31708]: pgmap v247: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:40:48.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:47 smithi134 ceph-mon[31708]: osdmap e57: 9 total, 9 up, 9 in 2024-05-03T16:40:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-03T16:40:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-03T16:40:48.465 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10+0 records in 2024-05-03T16:40:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:10+0 records out 2024-05-03T16:40:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.037036 s, 283 MB/s 2024-05-03T16:40:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping successful for: 2024-05-03T16:40:49.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_1 2024-05-03T16:40:49.836 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:40:50.108 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:49 smithi081 ceph-mon[28640]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:40:50.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:49 smithi134 ceph-mon[31708]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:40:50.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:49 smithi146 ceph-mon[32357]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:40:51.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:50 smithi081 ceph-mon[28640]: Detected new or changed devices on smithi146 2024-05-03T16:40:51.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:50 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:51.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:50 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:51.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:50 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:40:51.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:50 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:40:51.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:50 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:40:51.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:50 smithi081 ceph-mon[28640]: Adjusting osd_memory_target on smithi146 to 5696M 2024-05-03T16:40:51.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:50 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:51.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:50 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:51.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:50 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:40:51.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:50 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:51.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:50 smithi134 ceph-mon[31708]: Detected new or changed devices on smithi146 2024-05-03T16:40:51.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:50 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:51.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:50 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:51.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:50 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:40:51.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:50 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:40:51.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:50 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:40:51.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:50 smithi134 ceph-mon[31708]: Adjusting osd_memory_target on smithi146 to 5696M 2024-05-03T16:40:51.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:50 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:51.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:50 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:51.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:50 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:40:51.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:50 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:51.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:50 smithi146 ceph-mon[32357]: Detected new or changed devices on smithi146 2024-05-03T16:40:51.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:50 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:51.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:50 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:51.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:50 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:40:51.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:50 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:40:51.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:50 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:40:51.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:50 smithi146 ceph-mon[32357]: Adjusting osd_memory_target on smithi146 to 5696M 2024-05-03T16:40:51.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:50 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:51.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:50 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:51.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:50 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:40:51.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:50 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:40:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.001+0000 7f0382400700 1 -- 172.21.15.81:0/720610582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f037c103600 msgr2=0x7f037c103a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:40:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.001+0000 7f0382400700 1 --2- 172.21.15.81:0/720610582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f037c103600 0x7f037c103a60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f03680099c0 tx=0x7f0368009cd0 comp rx=0 tx=0).stop 2024-05-03T16:40:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.001+0000 7f0382400700 1 -- 172.21.15.81:0/720610582 shutdown_connections 2024-05-03T16:40:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.001+0000 7f0382400700 1 --2- 172.21.15.81:0/720610582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f037c102400 0x7f037c102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:40:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.001+0000 7f0382400700 1 --2- 172.21.15.81:0/720610582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f037c103fa0 0x7f037c10a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:40:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.001+0000 7f0382400700 1 --2- 172.21.15.81:0/720610582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f037c103600 0x7f037c103a60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:40:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.001+0000 7f0382400700 1 -- 172.21.15.81:0/720610582 >> 172.21.15.81:0/720610582 conn(0x7f037c0fd9a0 msgr2=0x7f037c0ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:40:52.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.001+0000 7f0382400700 1 -- 172.21.15.81:0/720610582 shutdown_connections 2024-05-03T16:40:52.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.001+0000 7f0382400700 1 -- 172.21.15.81:0/720610582 wait complete. 2024-05-03T16:40:52.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.002+0000 7f0382400700 1 Processor -- start 2024-05-03T16:40:52.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.002+0000 7f0382400700 1 -- start start 2024-05-03T16:40:52.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.003+0000 7f0382400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f037c102400 0x7f037c1995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:40:52.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.003+0000 7f0382400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f037c103600 0x7f037c199b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:40:52.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.003+0000 7f0382400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f037c103fa0 0x7f037c1a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:40:52.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.003+0000 7f0382400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f037c10dda0 con 0x7f037c103fa0 2024-05-03T16:40:52.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.003+0000 7f0382400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f037c10dc20 con 0x7f037c102400 2024-05-03T16:40:52.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.003+0000 7f0382400700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f037c10df20 con 0x7f037c103600 2024-05-03T16:40:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.003+0000 7f037be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f037c103fa0 0x7f037c1a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:40:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.003+0000 7f037be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f037c103fa0 0x7f037c1a0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49564/0 (socket says 172.21.15.81:49564) 2024-05-03T16:40:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.003+0000 7f037be00700 1 -- 172.21.15.81:0/1050867263 learned_addr learned my addr 172.21.15.81:0/1050867263 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:40:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.004+0000 7f037aa00700 1 --2- 172.21.15.81:0/1050867263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f037c103600 0x7f037c199b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:40:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.004+0000 7f037b400700 1 --2- 172.21.15.81:0/1050867263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f037c102400 0x7f037c1995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:40:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.004+0000 7f037be00700 1 -- 172.21.15.81:0/1050867263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f037c103600 msgr2=0x7f037c199b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:40:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.004+0000 7f037be00700 1 --2- 172.21.15.81:0/1050867263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f037c103600 0x7f037c199b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:40:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.004+0000 7f037be00700 1 -- 172.21.15.81:0/1050867263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f037c102400 msgr2=0x7f037c1995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:40:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.004+0000 7f037be00700 1 --2- 172.21.15.81:0/1050867263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f037c102400 0x7f037c1995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:40:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.004+0000 7f037be00700 1 -- 172.21.15.81:0/1050867263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037c104820 con 0x7f037c103fa0 2024-05-03T16:40:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.004+0000 7f037be00700 1 --2- 172.21.15.81:0/1050867263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f037c103fa0 0x7f037c1a0b80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0374007da0 tx=0x7f037400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:40:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.005+0000 7f0373e00700 1 -- 172.21.15.81:0/1050867263 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374016020 con 0x7f037c103fa0 2024-05-03T16:40:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.005+0000 7f0382400700 1 -- 172.21.15.81:0/1050867263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f037c104b10 con 0x7f037c103fa0 2024-05-03T16:40:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.005+0000 7f0382400700 1 -- 172.21.15.81:0/1050867263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f037c1050a0 con 0x7f037c103fa0 2024-05-03T16:40:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.006+0000 7f0382400700 1 -- 172.21.15.81:0/1050867263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f037c06a190 con 0x7f037c103fa0 2024-05-03T16:40:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.009+0000 7f0373e00700 1 -- 172.21.15.81:0/1050867263 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f037400ac50 con 0x7f037c103fa0 2024-05-03T16:40:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.009+0000 7f0373e00700 1 -- 172.21.15.81:0/1050867263 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03740056f0 con 0x7f037c103fa0 2024-05-03T16:40:52.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.012+0000 7f0373e00700 1 -- 172.21.15.81:0/1050867263 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0374019020 con 0x7f037c103fa0 2024-05-03T16:40:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.014+0000 7f0373e00700 1 --2- 172.21.15.81:0/1050867263 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f03600b2900 0x7f03600b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:40:52.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.015+0000 7f0373e00700 1 -- 172.21.15.81:0/1050867263 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5829+0+0 (secure 0 0 0) 0x7f03740e1920 con 0x7f037c103fa0 2024-05-03T16:40:52.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.015+0000 7f037b400700 1 --2- 172.21.15.81:0/1050867263 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f03600b2900 0x7f03600b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:40:52.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.015+0000 7f037b400700 1 --2- 172.21.15.81:0/1050867263 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f03600b2900 0x7f03600b4dc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f037c103460 tx=0x7f036c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:40:52.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.016+0000 7f0373e00700 1 -- 172.21.15.81:0/1050867263 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0374020030 con 0x7f037c103fa0 2024-05-03T16:40:52.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:40:52.263+0000 7f0382400700 1 -- 172.21.15.81:0/1050867263 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f037c06b890 con 0x7f03600b2900 2024-05-03T16:40:52.266 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:52 smithi081 ceph-mon[28640]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-03T16:40:52.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:52 smithi146 ceph-mon[32357]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-03T16:40:52.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:52 smithi134 ceph-mon[31708]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-03T16:40:53.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:53 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:40:53.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:53 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:40:53.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:53 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:53.403 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:53 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:40:53.403 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:53 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:40:53.403 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:53 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:53.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:53 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:40:53.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:53 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:40:53.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:53 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:40:54.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:54 smithi146 ceph-mon[32357]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-03T16:40:54.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:54 smithi146 ceph-mon[32357]: from='client.14427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:40:54.368 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:54 smithi134 ceph-mon[31708]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-03T16:40:54.368 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:54 smithi134 ceph-mon[31708]: from='client.14427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:40:54.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:54 smithi081 ceph-mon[28640]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-03T16:40:54.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:54 smithi081 ceph-mon[28640]: from='client.14427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:40:56.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:56 smithi146 ceph-mon[32357]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-05-03T16:40:56.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:56 smithi134 ceph-mon[31708]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-05-03T16:40:56.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:56 smithi081 ceph-mon[28640]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-05-03T16:40:57.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:57 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1995140605' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46713a8e-743d-44d5-babe-c01d3179afcb"}]: dispatch 2024-05-03T16:40:57.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:57 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1995140605' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46713a8e-743d-44d5-babe-c01d3179afcb"}]': finished 2024-05-03T16:40:57.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:57 smithi081 ceph-mon[28640]: osdmap e58: 10 total, 9 up, 10 in 2024-05-03T16:40:57.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:57 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T16:40:57.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:57 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/1995140605' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46713a8e-743d-44d5-babe-c01d3179afcb"}]: dispatch 2024-05-03T16:40:57.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:57 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/1995140605' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46713a8e-743d-44d5-babe-c01d3179afcb"}]': finished 2024-05-03T16:40:57.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:57 smithi146 ceph-mon[32357]: osdmap e58: 10 total, 9 up, 10 in 2024-05-03T16:40:57.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:57 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T16:40:57.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:57 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/1995140605' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46713a8e-743d-44d5-babe-c01d3179afcb"}]: dispatch 2024-05-03T16:40:57.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:57 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/1995140605' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46713a8e-743d-44d5-babe-c01d3179afcb"}]': finished 2024-05-03T16:40:57.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:57 smithi134 ceph-mon[31708]: osdmap e58: 10 total, 9 up, 10 in 2024-05-03T16:40:57.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:57 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T16:40:58.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:58 smithi146 ceph-mon[32357]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T16:40:58.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:58 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3643546405' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:40:58.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:58 smithi134 ceph-mon[31708]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T16:40:58.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:58 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3643546405' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:40:58.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:58 smithi081 ceph-mon[28640]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T16:40:58.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:58 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3643546405' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:41:00.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:40:59 smithi146 ceph-mon[32357]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T16:41:00.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:40:59 smithi134 ceph-mon[31708]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T16:41:00.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:40:59 smithi081 ceph-mon[28640]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T16:41:02.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:01 smithi146 ceph-mon[32357]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:01 smithi134 ceph-mon[31708]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:02.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:01 smithi081 ceph-mon[28640]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:03.962 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:03 smithi081 ceph-mon[28640]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:04.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:03 smithi146 ceph-mon[32357]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:04.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:03 smithi134 ceph-mon[31708]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:05.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:05 smithi081 ceph-mon[28640]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:05.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-03T16:41:05.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:41:06.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:05 smithi134 ceph-mon[31708]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:06.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:05 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-03T16:41:06.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:05 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:41:06.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:05 smithi146 ceph-mon[32357]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:06.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:05 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-03T16:41:06.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:05 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:41:06.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:06 smithi081 ceph-mon[28640]: Deploying daemon osd.9 on smithi081 2024-05-03T16:41:07.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:06 smithi134 ceph-mon[31708]: Deploying daemon osd.9 on smithi081 2024-05-03T16:41:07.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:06 smithi146 ceph-mon[32357]: Deploying daemon osd.9 on smithi081 2024-05-03T16:41:07.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:07 smithi081 ceph-mon[28640]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:08.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:07 smithi134 ceph-mon[31708]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:08.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:07 smithi146 ceph-mon[32357]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:09.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:09 smithi081 ceph-mon[28640]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:10.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:09 smithi134 ceph-mon[31708]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:10.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:09 smithi146 ceph-mon[32357]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:12.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:11 smithi134 ceph-mon[31708]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:12.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:11 smithi081 ceph-mon[28640]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:12.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:11 smithi146 ceph-mon[32357]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:14.202 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:13 smithi081 ceph-mon[28640]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:14.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:13 smithi134 ceph-mon[31708]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:14.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:13 smithi146 ceph-mon[32357]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:15.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:15 smithi081 ceph-mon[28640]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:15.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:15 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:41:15.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:15 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:15.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:15 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:16.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:15 smithi146 ceph-mon[32357]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:16.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:15 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:41:16.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:15 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:16.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:15 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:16.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:15 smithi134 ceph-mon[31708]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:16.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:15 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:41:16.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:15 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:16.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:15 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:17.896 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:17 smithi081 ceph-mon[28640]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:18.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:17 smithi146 ceph-mon[32357]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:18.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:17 smithi134 ceph-mon[31708]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:19.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:19 smithi081 ceph-mon[28640]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:19.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:19.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:19.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:19 smithi081 ceph-mon[28640]: from='osd.9 [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-03T16:41:19.866 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:19 smithi146 ceph-mon[32357]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:19.866 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:19 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:19.866 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:19 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:19.866 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:19 smithi146 ceph-mon[32357]: from='osd.9 [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-03T16:41:19.961 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 9 on host 'smithi081' 2024-05-03T16:41:19.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:41:19.959+0000 7f0373e00700 1 -- 172.21.15.81:0/1050867263 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f037c06b890 con 0x7f03600b2900 2024-05-03T16:41:19.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:41:19.962+0000 7f0382400700 1 -- 172.21.15.81:0/1050867263 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f03600b2900 msgr2=0x7f03600b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:41:19.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:41:19.962+0000 7f0382400700 1 --2- 172.21.15.81:0/1050867263 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f03600b2900 0x7f03600b4dc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f037c103460 tx=0x7f036c00b410 comp rx=0 tx=0).stop 2024-05-03T16:41:19.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:41:19.962+0000 7f0382400700 1 -- 172.21.15.81:0/1050867263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f037c103fa0 msgr2=0x7f037c1a0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:41:19.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:41:19.962+0000 7f0382400700 1 --2- 172.21.15.81:0/1050867263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f037c103fa0 0x7f037c1a0b80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0374007da0 tx=0x7f037400a340 comp rx=0 tx=0).stop 2024-05-03T16:41:19.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:41:19.962+0000 7f0382400700 1 -- 172.21.15.81:0/1050867263 shutdown_connections 2024-05-03T16:41:19.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:41:19.962+0000 7f0382400700 1 --2- 172.21.15.81:0/1050867263 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f03600b2900 0x7f03600b4dc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:41:19.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:41:19.962+0000 7f0382400700 1 --2- 172.21.15.81:0/1050867263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f037c103fa0 0x7f037c1a0b80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:41:19.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:41:19.962+0000 7f0382400700 1 --2- 172.21.15.81:0/1050867263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f037c102400 0x7f037c1995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:41:19.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:41:19.962+0000 7f0382400700 1 --2- 172.21.15.81:0/1050867263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f037c103600 0x7f037c199b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:41:19.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:41:19.962+0000 7f0382400700 1 -- 172.21.15.81:0/1050867263 >> 172.21.15.81:0/1050867263 conn(0x7f037c0fd9a0 msgr2=0x7f037c06b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:41:19.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:41:19.962+0000 7f0382400700 1 -- 172.21.15.81:0/1050867263 shutdown_connections 2024-05-03T16:41:19.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:41:19.963+0000 7f0382400700 1 -- 172.21.15.81:0/1050867263 wait complete. 2024-05-03T16:41:19.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:19 smithi134 ceph-mon[31708]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:19.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:19 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:19.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:19 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:19.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:19 smithi134 ceph-mon[31708]: from='osd.9 [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-03T16:41:20.746 DEBUG:teuthology.orchestra.run.smithi081:osd.9> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.9.service 2024-05-03T16:41:20.751 INFO:tasks.cephadm:Deploying osd.10 on smithi134 with /dev/vg_nvme/lv_1... 2024-05-03T16:41:20.751 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-03T16:41:20.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:20 smithi134 ceph-mon[31708]: from='osd.9 [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-03T16:41:20.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:20 smithi134 ceph-mon[31708]: osdmap e59: 10 total, 9 up, 10 in 2024-05-03T16:41:20.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:20 smithi134 ceph-mon[31708]: from='osd.9 [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-03T16:41:20.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T16:41:20.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:41:20.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:41:20.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:20.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:20.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:20.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:41:20.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:20 smithi081 ceph-mon[28640]: from='osd.9 [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-03T16:41:20.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:20 smithi081 ceph-mon[28640]: osdmap e59: 10 total, 9 up, 10 in 2024-05-03T16:41:20.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:20 smithi081 ceph-mon[28640]: from='osd.9 [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-03T16:41:20.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T16:41:20.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:41:20.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:41:20.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:20.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:20.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:20.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:41:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:20 smithi146 ceph-mon[32357]: from='osd.9 [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-03T16:41:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:20 smithi146 ceph-mon[32357]: osdmap e59: 10 total, 9 up, 10 in 2024-05-03T16:41:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:20 smithi146 ceph-mon[32357]: from='osd.9 [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-03T16:41:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T16:41:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:41:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:41:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:21.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:41:21.189 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T16:41:21.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:21 smithi081 ceph-mon[28640]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:21.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:21 smithi081 ceph-mon[28640]: from='osd.9 [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-03T16:41:21.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:21 smithi081 ceph-mon[28640]: osdmap e60: 10 total, 9 up, 10 in 2024-05-03T16:41:21.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T16:41:21.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T16:41:21.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:21 smithi081 ceph-mon[28640]: from='osd.9 [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886]' entity='osd.9' 2024-05-03T16:41:21.635 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 16:41:21 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T16:41:21.432+0000 7fe9c6600700 -1 osd.9 0 waiting for initial osdmap 2024-05-03T16:41:21.635 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 16:41:21 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T16:41:21.471+0000 7fe9bba00700 -1 osd.9 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T16:41:21.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:21 smithi134 ceph-mon[31708]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:21.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:21 smithi134 ceph-mon[31708]: from='osd.9 [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-03T16:41:21.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:21 smithi134 ceph-mon[31708]: osdmap e60: 10 total, 9 up, 10 in 2024-05-03T16:41:21.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T16:41:21.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T16:41:21.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:21 smithi134 ceph-mon[31708]: from='osd.9 [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886]' entity='osd.9' 2024-05-03T16:41:22.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:21 smithi146 ceph-mon[32357]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:22.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:21 smithi146 ceph-mon[32357]: from='osd.9 [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-03T16:41:22.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:21 smithi146 ceph-mon[32357]: osdmap e60: 10 total, 9 up, 10 in 2024-05-03T16:41:22.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T16:41:22.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T16:41:22.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:21 smithi146 ceph-mon[32357]: from='osd.9 [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886]' entity='osd.9' 2024-05-03T16:41:22.942 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:22 smithi081 ceph-mon[28640]: purged_snaps scrub starts 2024-05-03T16:41:22.942 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:22 smithi081 ceph-mon[28640]: purged_snaps scrub ok 2024-05-03T16:41:22.942 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T16:41:22.942 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:22 smithi081 ceph-mon[28640]: osd.9 [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886] boot 2024-05-03T16:41:22.942 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:22 smithi081 ceph-mon[28640]: osdmap e61: 10 total, 10 up, 10 in 2024-05-03T16:41:22.942 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T16:41:22.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:22 smithi134 ceph-mon[31708]: purged_snaps scrub starts 2024-05-03T16:41:22.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:22 smithi134 ceph-mon[31708]: purged_snaps scrub ok 2024-05-03T16:41:22.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T16:41:22.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:22 smithi134 ceph-mon[31708]: osd.9 [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886] boot 2024-05-03T16:41:22.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:22 smithi134 ceph-mon[31708]: osdmap e61: 10 total, 10 up, 10 in 2024-05-03T16:41:22.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T16:41:23.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:22 smithi146 ceph-mon[32357]: purged_snaps scrub starts 2024-05-03T16:41:23.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:22 smithi146 ceph-mon[32357]: purged_snaps scrub ok 2024-05-03T16:41:23.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T16:41:23.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:22 smithi146 ceph-mon[32357]: osd.9 [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886] boot 2024-05-03T16:41:23.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:22 smithi146 ceph-mon[32357]: osdmap e61: 10 total, 10 up, 10 in 2024-05-03T16:41:23.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T16:41:23.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:23 smithi134 ceph-mon[31708]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:23.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:23 smithi081 ceph-mon[28640]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:24.040 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-03T16:41:24.041 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-03T16:41:24.041 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-05-03T16:41:24.041 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-05-03T16:41:24.041 INFO:teuthology.orchestra.run.smithi134.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0362538 s, 289 MB/s 2024-05-03T16:41:24.041 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-05-03T16:41:24.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:23 smithi146 ceph-mon[32357]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-03T16:41:24.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:24 smithi134 ceph-mon[31708]: osdmap e62: 10 total, 10 up, 10 in 2024-05-03T16:41:24.919 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_1 2024-05-03T16:41:24.933 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:24 smithi081 ceph-mon[28640]: osdmap e62: 10 total, 10 up, 10 in 2024-05-03T16:41:25.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:24 smithi146 ceph-mon[32357]: osdmap e62: 10 total, 10 up, 10 in 2024-05-03T16:41:25.366 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T16:41:25.841 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:25 smithi134 ceph-mon[31708]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:25.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:25 smithi081 ceph-mon[28640]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:26.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:25 smithi146 ceph-mon[32357]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:27.060 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:26 smithi134 ceph-mon[31708]: Detected new or changed devices on smithi081 2024-05-03T16:41:27.060 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:26 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:27.060 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:26 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:27.060 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:26 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:41:27.061 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:26 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:41:27.061 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:26 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:41:27.061 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:26 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:41:27.061 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:26 smithi134 ceph-mon[31708]: Adjusting osd_memory_target on smithi081 to 4272M 2024-05-03T16:41:27.061 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:26 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:27.061 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:26 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:41:27.061 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:26 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:41:27.061 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:26 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:27.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:26 smithi081 ceph-mon[28640]: Detected new or changed devices on smithi081 2024-05-03T16:41:27.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:26 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:27.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:26 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:27.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:26 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:41:27.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:26 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:41:27.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:26 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:41:27.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:26 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:41:27.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:26 smithi081 ceph-mon[28640]: Adjusting osd_memory_target on smithi081 to 4272M 2024-05-03T16:41:27.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:26 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:27.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:26 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:41:27.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:26 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:41:27.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:26 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:27.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:26 smithi146 ceph-mon[32357]: Detected new or changed devices on smithi081 2024-05-03T16:41:27.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:26 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:27.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:26 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:27.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:26 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:41:27.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:26 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:41:27.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:26 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:41:27.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:26 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:41:27.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:26 smithi146 ceph-mon[32357]: Adjusting osd_memory_target on smithi081 to 4272M 2024-05-03T16:41:27.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:26 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:27.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:26 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:41:27.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:26 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:41:27.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:26 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:27.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.601+0000 7f41aca00700 1 -- 172.21.15.134:0/2957425943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a80774d0 msgr2=0x7f41a8075930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:41:27.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.601+0000 7f41aca00700 1 --2- 172.21.15.134:0/2957425943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a80774d0 0x7f41a8075930 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4198009990 tx=0x7f4198009ca0 comp rx=0 tx=0).stop 2024-05-03T16:41:27.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.602+0000 7f41aca00700 1 -- 172.21.15.134:0/2957425943 shutdown_connections 2024-05-03T16:41:27.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.602+0000 7f41aca00700 1 --2- 172.21.15.134:0/2957425943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41a810fae0 0x7f41a8111ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:41:27.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.602+0000 7f41aca00700 1 --2- 172.21.15.134:0/2957425943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a80774d0 0x7f41a8075930 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:41:27.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.602+0000 7f41aca00700 1 --2- 172.21.15.134:0/2957425943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41a8075f00 0x7f41a8076380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:41:27.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.602+0000 7f41aca00700 1 -- 172.21.15.134:0/2957425943 >> 172.21.15.134:0/2957425943 conn(0x7f41a80feaa0 msgr2=0x7f41a8100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:41:27.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.602+0000 7f41aca00700 1 -- 172.21.15.134:0/2957425943 shutdown_connections 2024-05-03T16:41:27.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.602+0000 7f41aca00700 1 -- 172.21.15.134:0/2957425943 wait complete. 2024-05-03T16:41:27.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.603+0000 7f41aca00700 1 Processor -- start 2024-05-03T16:41:27.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.603+0000 7f41aca00700 1 -- start start 2024-05-03T16:41:27.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.603+0000 7f41aca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41a8075f00 0x7f41a819fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:41:27.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.603+0000 7f41aca00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41a80774d0 0x7f41a81a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:41:27.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.603+0000 7f41aca00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a810fae0 0x7f41a81a7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:41:27.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.603+0000 7f41aca00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f41a8115490 con 0x7f41a8075f00 2024-05-03T16:41:27.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.603+0000 7f41aca00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f41a8115310 con 0x7f41a810fae0 2024-05-03T16:41:27.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.603+0000 7f41aca00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f41a8115610 con 0x7f41a80774d0 2024-05-03T16:41:27.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.604+0000 7f41a6800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a810fae0 0x7f41a81a7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:41:27.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.604+0000 7f41a6800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a810fae0 0x7f41a81a7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43942/0 (socket says 172.21.15.134:43942) 2024-05-03T16:41:27.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.604+0000 7f41a6800700 1 -- 172.21.15.134:0/561886975 learned_addr learned my addr 172.21.15.134:0/561886975 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-05-03T16:41:27.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.604+0000 7f41a5e00700 1 --2- 172.21.15.134:0/561886975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41a8075f00 0x7f41a819fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:41:27.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.604+0000 7f41a5400700 1 --2- 172.21.15.134:0/561886975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41a80774d0 0x7f41a81a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:41:27.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.604+0000 7f41a6800700 1 -- 172.21.15.134:0/561886975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41a80774d0 msgr2=0x7f41a81a00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:41:27.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.604+0000 7f41a6800700 1 --2- 172.21.15.134:0/561886975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41a80774d0 0x7f41a81a00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:41:27.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.604+0000 7f41a6800700 1 -- 172.21.15.134:0/561886975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41a8075f00 msgr2=0x7f41a819fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:41:27.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.604+0000 7f41a6800700 1 --2- 172.21.15.134:0/561886975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41a8075f00 0x7f41a819fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:41:27.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.604+0000 7f41a6800700 1 -- 172.21.15.134:0/561886975 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a81a77e0 con 0x7f41a810fae0 2024-05-03T16:41:27.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.604+0000 7f41a6800700 1 --2- 172.21.15.134:0/561886975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a810fae0 0x7f41a81a7140 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f41a0007d70 tx=0x7f41a000a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:41:27.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.605+0000 7f419ea00700 1 -- 172.21.15.134:0/561886975 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0016020 con 0x7f41a810fae0 2024-05-03T16:41:27.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.605+0000 7f41aca00700 1 -- 172.21.15.134:0/561886975 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a81a7ad0 con 0x7f41a810fae0 2024-05-03T16:41:27.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.605+0000 7f419ea00700 1 -- 172.21.15.134:0/561886975 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f41a000ad40 con 0x7f41a810fae0 2024-05-03T16:41:27.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.605+0000 7f419ea00700 1 -- 172.21.15.134:0/561886975 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a00115e0 con 0x7f41a810fae0 2024-05-03T16:41:27.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.605+0000 7f41aca00700 1 -- 172.21.15.134:0/561886975 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a81a8060 con 0x7f41a810fae0 2024-05-03T16:41:27.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.606+0000 7f41aca00700 1 -- 172.21.15.134:0/561886975 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a806a190 con 0x7f41a810fae0 2024-05-03T16:41:27.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.608+0000 7f419ea00700 1 -- 172.21.15.134:0/561886975 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f41a0019020 con 0x7f41a810fae0 2024-05-03T16:41:27.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.611+0000 7f419ea00700 1 --2- 172.21.15.134:0/561886975 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f418c0b2900 0x7f418c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:41:27.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.611+0000 7f419ea00700 1 -- 172.21.15.134:0/561886975 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6261+0+0 (secure 0 0 0) 0x7f41a00e19d0 con 0x7f41a810fae0 2024-05-03T16:41:27.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.611+0000 7f41a5e00700 1 --2- 172.21.15.134:0/561886975 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f418c0b2900 0x7f418c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:41:27.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.613+0000 7f41a5e00700 1 --2- 172.21.15.134:0/561886975 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f418c0b2900 0x7f418c0b4dc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f419800b5c0 tx=0x7f4198005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:41:27.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.616+0000 7f419ea00700 1 -- 172.21.15.134:0/561886975 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f41a0020020 con 0x7f41a810fae0 2024-05-03T16:41:27.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:27.862+0000 7f41aca00700 1 -- 172.21.15.134:0/561886975 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f41a80638e0 con 0x7f418c0b2900 2024-05-03T16:41:28.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:27 smithi134 ceph-mon[31708]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:28.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:27 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:41:28.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:27 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:41:28.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:27 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:41:28.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:27 smithi081 ceph-mon[28640]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:28.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:27 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:41:28.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:27 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:41:28.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:27 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:41:28.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:27 smithi146 ceph-mon[32357]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:28.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:27 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:41:28.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:27 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:41:28.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:27 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:41:29.178 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:28 smithi134 ceph-mon[31708]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:41:29.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:28 smithi081 ceph-mon[28640]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:41:29.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:28 smithi146 ceph-mon[32357]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:41:29.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:29 smithi134 ceph-mon[31708]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:30.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:29 smithi081 ceph-mon[28640]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:30.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:29 smithi146 ceph-mon[32357]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:32.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:31 smithi134 ceph-mon[31708]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:32.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:31 smithi081 ceph-mon[28640]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:32.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:31 smithi146 ceph-mon[32357]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:33.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:32 smithi134 ceph-mon[31708]: from='client.? 172.21.15.134:0/3814980887' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12fcae89-30af-436b-a513-3998303da93e"}]: dispatch 2024-05-03T16:41:33.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:32 smithi134 ceph-mon[31708]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12fcae89-30af-436b-a513-3998303da93e"}]: dispatch 2024-05-03T16:41:33.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:32 smithi134 ceph-mon[31708]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12fcae89-30af-436b-a513-3998303da93e"}]': finished 2024-05-03T16:41:33.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:32 smithi134 ceph-mon[31708]: osdmap e63: 11 total, 10 up, 11 in 2024-05-03T16:41:33.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:32 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T16:41:33.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:32 smithi081 ceph-mon[28640]: from='client.? 172.21.15.134:0/3814980887' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12fcae89-30af-436b-a513-3998303da93e"}]: dispatch 2024-05-03T16:41:33.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:32 smithi081 ceph-mon[28640]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12fcae89-30af-436b-a513-3998303da93e"}]: dispatch 2024-05-03T16:41:33.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:32 smithi081 ceph-mon[28640]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12fcae89-30af-436b-a513-3998303da93e"}]': finished 2024-05-03T16:41:33.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:32 smithi081 ceph-mon[28640]: osdmap e63: 11 total, 10 up, 11 in 2024-05-03T16:41:33.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:32 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T16:41:33.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:32 smithi146 ceph-mon[32357]: from='client.? 172.21.15.134:0/3814980887' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12fcae89-30af-436b-a513-3998303da93e"}]: dispatch 2024-05-03T16:41:33.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:32 smithi146 ceph-mon[32357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12fcae89-30af-436b-a513-3998303da93e"}]: dispatch 2024-05-03T16:41:33.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:32 smithi146 ceph-mon[32357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12fcae89-30af-436b-a513-3998303da93e"}]': finished 2024-05-03T16:41:33.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:32 smithi146 ceph-mon[32357]: osdmap e63: 11 total, 10 up, 11 in 2024-05-03T16:41:33.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:32 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T16:41:34.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:33 smithi134 ceph-mon[31708]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:34.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:33 smithi134 ceph-mon[31708]: from='client.? 172.21.15.134:0/2230865015' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:41:34.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:33 smithi081 ceph-mon[28640]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:34.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:33 smithi081 ceph-mon[28640]: from='client.? 172.21.15.134:0/2230865015' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:41:34.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:33 smithi146 ceph-mon[32357]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:34.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:33 smithi146 ceph-mon[32357]: from='client.? 172.21.15.134:0/2230865015' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:41:36.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:35 smithi134 ceph-mon[31708]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:36.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:35 smithi081 ceph-mon[28640]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:36.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:35 smithi146 ceph-mon[32357]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:38.184 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:37 smithi134 ceph-mon[31708]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:38.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:37 smithi081 ceph-mon[28640]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:38.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:37 smithi146 ceph-mon[32357]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:40.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:39 smithi134 ceph-mon[31708]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:40.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:39 smithi081 ceph-mon[28640]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:40.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:39 smithi146 ceph-mon[32357]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:42.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:41 smithi134 ceph-mon[31708]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:42.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-03T16:41:42.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:41:42.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:41 smithi081 ceph-mon[28640]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:42.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-03T16:41:42.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:41:42.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:41 smithi146 ceph-mon[32357]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-03T16:41:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:41:43.202 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:42 smithi134 ceph-mon[31708]: Deploying daemon osd.10 on smithi134 2024-05-03T16:41:43.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:42 smithi081 ceph-mon[28640]: Deploying daemon osd.10 on smithi134 2024-05-03T16:41:43.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:42 smithi146 ceph-mon[32357]: Deploying daemon osd.10 on smithi134 2024-05-03T16:41:44.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:43 smithi134 ceph-mon[31708]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:44.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:43 smithi081 ceph-mon[28640]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:44.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:43 smithi146 ceph-mon[32357]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:46.089 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:45 smithi134 ceph-mon[31708]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:46.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:45 smithi081 ceph-mon[28640]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:46.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:45 smithi146 ceph-mon[32357]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:48.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:47 smithi134 ceph-mon[31708]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:48.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:47 smithi081 ceph-mon[28640]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:48.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:47 smithi146 ceph-mon[32357]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:50.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:49 smithi081 ceph-mon[28640]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:50.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:49 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:50.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:49 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:50.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:49 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:41:50.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:49 smithi146 ceph-mon[32357]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:50.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:49 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:50.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:49 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:50.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:49 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:41:50.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:49 smithi134 ceph-mon[31708]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:50.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:49 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:50.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:49 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:50.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:49 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:41:52.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:51 smithi134 ceph-mon[31708]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:52.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:51 smithi081 ceph-mon[28640]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:52.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:51 smithi146 ceph-mon[32357]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:54.151 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:53 smithi134 ceph-mon[31708]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:54.151 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:53 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:54.151 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:53 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:54.151 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:53 smithi134 ceph-mon[31708]: from='osd.10 [v2:172.21.15.134:6824/1183629038,v1:172.21.15.134:6825/1183629038]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-03T16:41:54.152 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:53 smithi134 ceph-mon[31708]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-03T16:41:54.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:53 smithi081 ceph-mon[28640]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:54.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:53 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:54.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:53 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:54.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:53 smithi081 ceph-mon[28640]: from='osd.10 [v2:172.21.15.134:6824/1183629038,v1:172.21.15.134:6825/1183629038]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-03T16:41:54.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:53 smithi081 ceph-mon[28640]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-03T16:41:54.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:53 smithi146 ceph-mon[32357]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:54.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:53 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:54.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:53 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:54.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:53 smithi146 ceph-mon[32357]: from='osd.10 [v2:172.21.15.134:6824/1183629038,v1:172.21.15.134:6825/1183629038]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-03T16:41:54.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:53 smithi146 ceph-mon[32357]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-03T16:41:54.343 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 10 on host 'smithi134' 2024-05-03T16:41:54.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:54.341+0000 7f419ea00700 1 -- 172.21.15.134:0/561886975 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f41a80638e0 con 0x7f418c0b2900 2024-05-03T16:41:54.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:54.345+0000 7f41aca00700 1 -- 172.21.15.134:0/561886975 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f418c0b2900 msgr2=0x7f418c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:41:54.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:54.345+0000 7f41aca00700 1 --2- 172.21.15.134:0/561886975 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f418c0b2900 0x7f418c0b4dc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f419800b5c0 tx=0x7f4198005fd0 comp rx=0 tx=0).stop 2024-05-03T16:41:54.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:54.345+0000 7f41aca00700 1 -- 172.21.15.134:0/561886975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a810fae0 msgr2=0x7f41a81a7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:41:54.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:54.345+0000 7f41aca00700 1 --2- 172.21.15.134:0/561886975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a810fae0 0x7f41a81a7140 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f41a0007d70 tx=0x7f41a000a340 comp rx=0 tx=0).stop 2024-05-03T16:41:54.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:54.345+0000 7f41aca00700 1 -- 172.21.15.134:0/561886975 shutdown_connections 2024-05-03T16:41:54.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:54.345+0000 7f41aca00700 1 --2- 172.21.15.134:0/561886975 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f418c0b2900 0x7f418c0b4dc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:41:54.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:54.345+0000 7f41aca00700 1 --2- 172.21.15.134:0/561886975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a810fae0 0x7f41a81a7140 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:41:54.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:54.345+0000 7f41aca00700 1 --2- 172.21.15.134:0/561886975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41a8075f00 0x7f41a819fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:41:54.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:54.345+0000 7f41aca00700 1 --2- 172.21.15.134:0/561886975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41a80774d0 0x7f41a81a00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:41:54.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:54.345+0000 7f41aca00700 1 -- 172.21.15.134:0/561886975 >> 172.21.15.134:0/561886975 conn(0x7f41a80feaa0 msgr2=0x7f41a8102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:41:54.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:54.346+0000 7f41aca00700 1 -- 172.21.15.134:0/561886975 shutdown_connections 2024-05-03T16:41:54.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-03T16:41:54.346+0000 7f41aca00700 1 -- 172.21.15.134:0/561886975 wait complete. 2024-05-03T16:41:55.190 DEBUG:teuthology.orchestra.run.smithi134:osd.10> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.10.service 2024-05-03T16:41:55.194 INFO:tasks.cephadm:Deploying osd.11 on smithi146 with /dev/vg_nvme/lv_1... 2024-05-03T16:41:55.194 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-03T16:41:55.407 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:55 smithi134 ceph-mon[31708]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-03T16:41:55.407 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:55 smithi134 ceph-mon[31708]: osdmap e64: 11 total, 10 up, 11 in 2024-05-03T16:41:55.408 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T16:41:55.408 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:55 smithi134 ceph-mon[31708]: from='osd.10 [v2:172.21.15.134:6824/1183629038,v1:172.21.15.134:6825/1183629038]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:41:55.408 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:55 smithi134 ceph-mon[31708]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:41:55.408 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:55.408 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:55.408 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:55 smithi134 ceph-mon[31708]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:55.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:55 smithi081 ceph-mon[28640]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-03T16:41:55.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:55 smithi081 ceph-mon[28640]: osdmap e64: 11 total, 10 up, 11 in 2024-05-03T16:41:55.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T16:41:55.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:55 smithi081 ceph-mon[28640]: from='osd.10 [v2:172.21.15.134:6824/1183629038,v1:172.21.15.134:6825/1183629038]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:41:55.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:55 smithi081 ceph-mon[28640]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:41:55.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:55.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:55.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:55 smithi081 ceph-mon[28640]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:55.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:55 smithi146 ceph-mon[32357]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-03T16:41:55.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:55 smithi146 ceph-mon[32357]: osdmap e64: 11 total, 10 up, 11 in 2024-05-03T16:41:55.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T16:41:55.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:55 smithi146 ceph-mon[32357]: from='osd.10 [v2:172.21.15.134:6824/1183629038,v1:172.21.15.134:6825/1183629038]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:41:55.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:55 smithi146 ceph-mon[32357]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-03T16:41:55.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:55.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:41:55.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:55 smithi146 ceph-mon[32357]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T16:41:55.632 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T16:41:56.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:56 smithi134 ceph-mon[31708]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-03T16:41:56.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:56 smithi134 ceph-mon[31708]: osdmap e65: 11 total, 10 up, 11 in 2024-05-03T16:41:56.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:56 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T16:41:56.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:56 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T16:41:56.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:56 smithi134 ceph-mon[31708]: osd.10 [v2:172.21.15.134:6824/1183629038,v1:172.21.15.134:6825/1183629038] boot 2024-05-03T16:41:56.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:56 smithi134 ceph-mon[31708]: osdmap e66: 11 total, 11 up, 11 in 2024-05-03T16:41:56.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:56 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T16:41:56.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:56 smithi081 ceph-mon[28640]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-03T16:41:56.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:56 smithi081 ceph-mon[28640]: osdmap e65: 11 total, 10 up, 11 in 2024-05-03T16:41:56.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:56 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T16:41:56.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:56 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T16:41:56.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:56 smithi081 ceph-mon[28640]: osd.10 [v2:172.21.15.134:6824/1183629038,v1:172.21.15.134:6825/1183629038] boot 2024-05-03T16:41:56.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:56 smithi081 ceph-mon[28640]: osdmap e66: 11 total, 11 up, 11 in 2024-05-03T16:41:56.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:56 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T16:41:56.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:56 smithi146 ceph-mon[32357]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-03T16:41:56.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:56 smithi146 ceph-mon[32357]: osdmap e65: 11 total, 10 up, 11 in 2024-05-03T16:41:56.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:56 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T16:41:56.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:56 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T16:41:56.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:56 smithi146 ceph-mon[32357]: osd.10 [v2:172.21.15.134:6824/1183629038,v1:172.21.15.134:6825/1183629038] boot 2024-05-03T16:41:56.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:56 smithi146 ceph-mon[32357]: osdmap e66: 11 total, 11 up, 11 in 2024-05-03T16:41:56.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:56 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T16:41:57.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:57 smithi134 ceph-mon[31708]: purged_snaps scrub starts 2024-05-03T16:41:57.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:57 smithi134 ceph-mon[31708]: purged_snaps scrub ok 2024-05-03T16:41:57.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:57 smithi134 ceph-mon[31708]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:41:57.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:57 smithi134 ceph-mon[31708]: osdmap e67: 11 total, 11 up, 11 in 2024-05-03T16:41:57.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:57 smithi081 ceph-mon[28640]: purged_snaps scrub starts 2024-05-03T16:41:57.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:57 smithi081 ceph-mon[28640]: purged_snaps scrub ok 2024-05-03T16:41:57.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:57 smithi081 ceph-mon[28640]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:41:57.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:57 smithi081 ceph-mon[28640]: osdmap e67: 11 total, 11 up, 11 in 2024-05-03T16:41:57.525 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:57 smithi146 ceph-mon[32357]: purged_snaps scrub starts 2024-05-03T16:41:57.525 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:57 smithi146 ceph-mon[32357]: purged_snaps scrub ok 2024-05-03T16:41:57.525 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:57 smithi146 ceph-mon[32357]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:41:57.525 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:57 smithi146 ceph-mon[32357]: osdmap e67: 11 total, 11 up, 11 in 2024-05-03T16:41:58.805 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-03T16:41:58.805 INFO:teuthology.orchestra.run.smithi146.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-03T16:41:58.805 INFO:teuthology.orchestra.run.smithi146.stderr: stderr: 10+0 records in 2024-05-03T16:41:58.805 INFO:teuthology.orchestra.run.smithi146.stderr:10+0 records out 2024-05-03T16:41:58.805 INFO:teuthology.orchestra.run.smithi146.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0371119 s, 283 MB/s 2024-05-03T16:41:58.805 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping successful for: 2024-05-03T16:41:59.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:59 smithi134 ceph-mon[31708]: osdmap e68: 11 total, 11 up, 11 in 2024-05-03T16:41:59.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:41:59 smithi134 ceph-mon[31708]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:41:59.468 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:59 smithi146 ceph-mon[32357]: osdmap e68: 11 total, 11 up, 11 in 2024-05-03T16:41:59.468 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:41:59 smithi146 ceph-mon[32357]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:41:59.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:59 smithi081 ceph-mon[28640]: osdmap e68: 11 total, 11 up, 11 in 2024-05-03T16:41:59.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:41:59 smithi081 ceph-mon[28640]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:41:59.796 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi146:vg_nvme/lv_1 2024-05-03T16:42:00.217 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T16:42:00.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:00 smithi134 ceph-mon[31708]: Detected new or changed devices on smithi134 2024-05-03T16:42:00.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:00 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:00.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:00 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:00.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:00 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:00.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:00 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:00.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:00 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:00.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:00 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:00.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:00 smithi134 ceph-mon[31708]: Adjusting osd_memory_target on smithi134 to 4272M 2024-05-03T16:42:00.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:00 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:00.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:00 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:00.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:00 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:42:00.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:00 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:00.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:00 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:42:00.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:00 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:00.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:00 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:42:00.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:00 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:00.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:00 smithi081 ceph-mon[28640]: Detected new or changed devices on smithi134 2024-05-03T16:42:00.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:00 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:00.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:00 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:00.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:00 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:00.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:00 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:00.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:00 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:00.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:00 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:00.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:00 smithi081 ceph-mon[28640]: Adjusting osd_memory_target on smithi134 to 4272M 2024-05-03T16:42:00.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:00 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:00.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:00 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:00.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:00 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:42:00.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:00 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:00.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:00 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:42:00.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:00 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:00.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:00 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:42:00.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:00 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:01.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:00 smithi146 ceph-mon[32357]: Detected new or changed devices on smithi134 2024-05-03T16:42:01.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:00 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:01.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:00 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:01.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:00 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:01.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:00 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:01.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:00 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:01.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:00 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:01.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:00 smithi146 ceph-mon[32357]: Adjusting osd_memory_target on smithi134 to 4272M 2024-05-03T16:42:01.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:00 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:01.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:00 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:01.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:00 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:42:01.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:00 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:01.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:00 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:42:01.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:00 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:01.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:00 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:42:01.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:00 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:01.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:01 smithi134 ceph-mon[31708]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-05-03T16:42:01.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:01 smithi081 ceph-mon[28640]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-05-03T16:42:02.054 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:01 smithi146 ceph-mon[32357]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-05-03T16:42:02.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.547+0000 7f3ef3600700 1 -- 172.21.15.146:0/2816406231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eec10ad40 msgr2=0x7f3eec10b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:02.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.547+0000 7f3ef3600700 1 --2- 172.21.15.146:0/2816406231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eec10ad40 0x7f3eec10b1a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009990 tx=0x7f3ed8009ca0 comp rx=0 tx=0).stop 2024-05-03T16:42:02.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.547+0000 7f3ef3600700 1 -- 172.21.15.146:0/2816406231 shutdown_connections 2024-05-03T16:42:02.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.547+0000 7f3ef3600700 1 --2- 172.21.15.146:0/2816406231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eec10b6e0 0x7f3eec111f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:02.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.547+0000 7f3ef3600700 1 --2- 172.21.15.146:0/2816406231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3eec109b40 0x7f3eec109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:02.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.547+0000 7f3ef3600700 1 --2- 172.21.15.146:0/2816406231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eec10ad40 0x7f3eec10b1a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:02.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.547+0000 7f3ef3600700 1 -- 172.21.15.146:0/2816406231 >> 172.21.15.146:0/2816406231 conn(0x7f3eec078b10 msgr2=0x7f3eec07af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:42:02.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.547+0000 7f3ef3600700 1 -- 172.21.15.146:0/2816406231 shutdown_connections 2024-05-03T16:42:02.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.547+0000 7f3ef3600700 1 -- 172.21.15.146:0/2816406231 wait complete. 2024-05-03T16:42:02.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.548+0000 7f3ef3600700 1 Processor -- start 2024-05-03T16:42:02.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.548+0000 7f3ef3600700 1 -- start start 2024-05-03T16:42:02.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.549+0000 7f3ef3600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eec109b40 0x7f3eec19fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:02.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.549+0000 7f3ef3600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3eec10ad40 0x7f3eec1a0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:02.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.549+0000 7f3ef3600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eec10b6e0 0x7f3eec1a7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:02.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.549+0000 7f3ef3600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3eec1154d0 con 0x7f3eec109b40 2024-05-03T16:42:02.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.549+0000 7f3ef3600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3eec115350 con 0x7f3eec10ad40 2024-05-03T16:42:02.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.549+0000 7f3ef3600700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3eec115650 con 0x7f3eec10b6e0 2024-05-03T16:42:02.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.549+0000 7f3ef1600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eec10b6e0 0x7f3eec1a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:02.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.549+0000 7f3ef1600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eec10b6e0 0x7f3eec1a7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36238/0 (socket says 172.21.15.146:36238) 2024-05-03T16:42:02.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.549+0000 7f3ef1600700 1 -- 172.21.15.146:0/1983601190 learned_addr learned my addr 172.21.15.146:0/1983601190 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-05-03T16:42:02.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.549+0000 7f3ef0c00700 1 --2- 172.21.15.146:0/1983601190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eec109b40 0x7f3eec19fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:02.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.549+0000 7f3eebe00700 1 --2- 172.21.15.146:0/1983601190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3eec10ad40 0x7f3eec1a0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:02.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.550+0000 7f3ef1600700 1 -- 172.21.15.146:0/1983601190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3eec10ad40 msgr2=0x7f3eec1a0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:02.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.550+0000 7f3ef1600700 1 --2- 172.21.15.146:0/1983601190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3eec10ad40 0x7f3eec1a0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:02.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.550+0000 7f3ef1600700 1 -- 172.21.15.146:0/1983601190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eec109b40 msgr2=0x7f3eec19fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:02.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.550+0000 7f3ef1600700 1 --2- 172.21.15.146:0/1983601190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eec109b40 0x7f3eec19fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:02.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.550+0000 7f3ef1600700 1 -- 172.21.15.146:0/1983601190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eec1a7830 con 0x7f3eec10b6e0 2024-05-03T16:42:02.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.550+0000 7f3ef0c00700 1 --2- 172.21.15.146:0/1983601190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eec109b40 0x7f3eec19fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:42:02.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.550+0000 7f3ef1600700 1 --2- 172.21.15.146:0/1983601190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eec10b6e0 0x7f3eec1a7190 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4007f10 tx=0x7f3ee400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:42:02.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.550+0000 7f3ee9600700 1 -- 172.21.15.146:0/1983601190 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee4004bb0 con 0x7f3eec10b6e0 2024-05-03T16:42:02.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.550+0000 7f3ee9600700 1 -- 172.21.15.146:0/1983601190 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ee4004d50 con 0x7f3eec10b6e0 2024-05-03T16:42:02.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.550+0000 7f3ee9600700 1 -- 172.21.15.146:0/1983601190 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee4005970 con 0x7f3eec10b6e0 2024-05-03T16:42:02.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.550+0000 7f3ef3600700 1 -- 172.21.15.146:0/1983601190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eec1a7b20 con 0x7f3eec10b6e0 2024-05-03T16:42:02.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.550+0000 7f3ef3600700 1 -- 172.21.15.146:0/1983601190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eec1a8010 con 0x7f3eec10b6e0 2024-05-03T16:42:02.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.551+0000 7f3ef3600700 1 -- 172.21.15.146:0/1983601190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eec06a190 con 0x7f3eec10b6e0 2024-05-03T16:42:02.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.554+0000 7f3ee9600700 1 -- 172.21.15.146:0/1983601190 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f3ee401a020 con 0x7f3eec10b6e0 2024-05-03T16:42:02.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.555+0000 7f3ee9600700 1 --2- 172.21.15.146:0/1983601190 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3ed40b2880 0x7f3ed40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:02.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.555+0000 7f3ee9600700 1 -- 172.21.15.146:0/1983601190 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6694+0+0 (secure 0 0 0) 0x7f3ee40e1450 con 0x7f3eec10b6e0 2024-05-03T16:42:02.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.556+0000 7f3ef0c00700 1 --2- 172.21.15.146:0/1983601190 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3ed40b2880 0x7f3ed40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:02.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.557+0000 7f3ef0c00700 1 --2- 172.21.15.146:0/1983601190 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3ed40b2880 0x7f3ed40b4d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0005950 tx=0x7f3ee00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:42:02.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.560+0000 7f3ee9600700 1 -- 172.21.15.146:0/1983601190 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f3ee4010070 con 0x7f3eec10b6e0 2024-05-03T16:42:02.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:02.806+0000 7f3ef3600700 1 -- 172.21.15.146:0/1983601190 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3eec0638e0 con 0x7f3ed40b2880 2024-05-03T16:42:03.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:03 smithi134 ceph-mon[31708]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-05-03T16:42:03.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:03 smithi134 ceph-mon[31708]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:42:03.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:03 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:42:03.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:03 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:42:03.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:03 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:03.971 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:03 smithi146 ceph-mon[32357]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-05-03T16:42:03.971 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:03 smithi146 ceph-mon[32357]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:42:03.971 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:03 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:42:03.971 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:03 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:42:03.971 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:03 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:03.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:03 smithi081 ceph-mon[28640]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-05-03T16:42:03.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:03 smithi081 ceph-mon[28640]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:42:03.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:03 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T16:42:03.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:03 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T16:42:03.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:03 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:05.779 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:05 smithi146 ceph-mon[32357]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T16:42:05.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:05 smithi134 ceph-mon[31708]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T16:42:05.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:05 smithi081 ceph-mon[28640]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T16:42:07.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:07 smithi134 ceph-mon[31708]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-05-03T16:42:07.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:07 smithi134 ceph-mon[31708]: from='client.? 172.21.15.146:0/1469914050' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a543f42c-61da-4a93-b16b-a2891a4ef873"}]: dispatch 2024-05-03T16:42:07.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:07 smithi134 ceph-mon[31708]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a543f42c-61da-4a93-b16b-a2891a4ef873"}]: dispatch 2024-05-03T16:42:07.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:07 smithi134 ceph-mon[31708]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a543f42c-61da-4a93-b16b-a2891a4ef873"}]': finished 2024-05-03T16:42:07.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:07 smithi134 ceph-mon[31708]: osdmap e69: 12 total, 11 up, 12 in 2024-05-03T16:42:07.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:07 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T16:42:07.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:07 smithi081 ceph-mon[28640]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-05-03T16:42:07.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:07 smithi081 ceph-mon[28640]: from='client.? 172.21.15.146:0/1469914050' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a543f42c-61da-4a93-b16b-a2891a4ef873"}]: dispatch 2024-05-03T16:42:07.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:07 smithi081 ceph-mon[28640]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a543f42c-61da-4a93-b16b-a2891a4ef873"}]: dispatch 2024-05-03T16:42:07.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:07 smithi081 ceph-mon[28640]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a543f42c-61da-4a93-b16b-a2891a4ef873"}]': finished 2024-05-03T16:42:07.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:07 smithi081 ceph-mon[28640]: osdmap e69: 12 total, 11 up, 12 in 2024-05-03T16:42:07.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:07 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T16:42:08.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:07 smithi146 ceph-mon[32357]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-05-03T16:42:08.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:07 smithi146 ceph-mon[32357]: from='client.? 172.21.15.146:0/1469914050' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a543f42c-61da-4a93-b16b-a2891a4ef873"}]: dispatch 2024-05-03T16:42:08.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:07 smithi146 ceph-mon[32357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a543f42c-61da-4a93-b16b-a2891a4ef873"}]: dispatch 2024-05-03T16:42:08.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:07 smithi146 ceph-mon[32357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a543f42c-61da-4a93-b16b-a2891a4ef873"}]': finished 2024-05-03T16:42:08.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:07 smithi146 ceph-mon[32357]: osdmap e69: 12 total, 11 up, 12 in 2024-05-03T16:42:08.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T16:42:08.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:08 smithi134 ceph-mon[31708]: from='client.? 172.21.15.146:0/4182780518' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:42:08.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:08 smithi081 ceph-mon[28640]: from='client.? 172.21.15.146:0/4182780518' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:42:09.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:08 smithi146 ceph-mon[32357]: from='client.? 172.21.15.146:0/4182780518' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T16:42:09.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:09 smithi134 ceph-mon[31708]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T16:42:09.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:09 smithi081 ceph-mon[28640]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T16:42:10.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:09 smithi146 ceph-mon[32357]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T16:42:11.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:11 smithi134 ceph-mon[31708]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:11.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:11 smithi081 ceph-mon[28640]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:12.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:11 smithi146 ceph-mon[32357]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:13.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:13 smithi134 ceph-mon[31708]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:13.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:13 smithi081 ceph-mon[28640]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:14.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:13 smithi146 ceph-mon[32357]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:15.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:15 smithi146 ceph-mon[32357]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:15.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:15 smithi134 ceph-mon[31708]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:15.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:15 smithi081 ceph-mon[28640]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:17.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:17 smithi134 ceph-mon[31708]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:17.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-03T16:42:17.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:17.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:17 smithi134 ceph-mon[31708]: Deploying daemon osd.11 on smithi146 2024-05-03T16:42:17.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:17 smithi081 ceph-mon[28640]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:17.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-03T16:42:17.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:17.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:17 smithi081 ceph-mon[28640]: Deploying daemon osd.11 on smithi146 2024-05-03T16:42:18.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:17 smithi146 ceph-mon[32357]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:18.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-03T16:42:18.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:18.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:17 smithi146 ceph-mon[32357]: Deploying daemon osd.11 on smithi146 2024-05-03T16:42:19.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:19 smithi146 ceph-mon[32357]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:19.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:19 smithi081 ceph-mon[28640]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:20.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:19 smithi134 ceph-mon[31708]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:21.859 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:21 smithi146 ceph-mon[32357]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:21.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:21 smithi081 ceph-mon[28640]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:22.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:21 smithi134 ceph-mon[31708]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:23.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:23 smithi081 ceph-mon[28640]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:24.019 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:23 smithi134 ceph-mon[31708]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:24.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:23 smithi146 ceph-mon[32357]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:25.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:25 smithi134 ceph-mon[31708]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:25.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:25 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:25.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:25 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:25.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:25 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:42:25.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:25 smithi081 ceph-mon[28640]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:25.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:25 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:25.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:25 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:25.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:25 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:42:26.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:25 smithi146 ceph-mon[32357]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:26.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:25 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:26.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:25 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:26.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:25 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:42:27.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:27 smithi081 ceph-mon[28640]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:28.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:27 smithi146 ceph-mon[32357]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:28.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:27 smithi134 ceph-mon[31708]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:29.798 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:29 smithi146 ceph-mon[32357]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:29.799 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:29 smithi146 ceph-mon[32357]: from='osd.11 [v2:172.21.15.146:6824/2627233639,v1:172.21.15.146:6825/2627233639]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-03T16:42:29.799 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:29 smithi146 ceph-mon[32357]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-03T16:42:29.799 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:29.799 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:29.799 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:29.799 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:42:29.799 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:29 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:29 smithi134 ceph-mon[31708]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:29 smithi134 ceph-mon[31708]: from='osd.11 [v2:172.21.15.146:6824/2627233639,v1:172.21.15.146:6825/2627233639]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-03T16:42:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:29 smithi134 ceph-mon[31708]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-03T16:42:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:42:30.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:29 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:30.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:29 smithi081 ceph-mon[28640]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:30.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:29 smithi081 ceph-mon[28640]: from='osd.11 [v2:172.21.15.146:6824/2627233639,v1:172.21.15.146:6825/2627233639]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-03T16:42:30.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:29 smithi081 ceph-mon[28640]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-03T16:42:30.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:30.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:30.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:30.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:42:30.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:29 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:30.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:30.724+0000 7f3ee9600700 1 -- 172.21.15.146:0/1983601190 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3eec0638e0 con 0x7f3ed40b2880 2024-05-03T16:42:30.725 INFO:teuthology.orchestra.run.smithi146.stdout:Created osd(s) 11 on host 'smithi146' 2024-05-03T16:42:30.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:30.728+0000 7f3ef3600700 1 -- 172.21.15.146:0/1983601190 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3ed40b2880 msgr2=0x7f3ed40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:30.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:30.728+0000 7f3ef3600700 1 --2- 172.21.15.146:0/1983601190 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3ed40b2880 0x7f3ed40b4d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0005950 tx=0x7f3ee00058e0 comp rx=0 tx=0).stop 2024-05-03T16:42:30.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:30.728+0000 7f3ef3600700 1 -- 172.21.15.146:0/1983601190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eec10b6e0 msgr2=0x7f3eec1a7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:30.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:30.728+0000 7f3ef3600700 1 --2- 172.21.15.146:0/1983601190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eec10b6e0 0x7f3eec1a7190 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4007f10 tx=0x7f3ee400d3b0 comp rx=0 tx=0).stop 2024-05-03T16:42:30.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:30.728+0000 7f3ef3600700 1 -- 172.21.15.146:0/1983601190 shutdown_connections 2024-05-03T16:42:30.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:30.728+0000 7f3ef3600700 1 --2- 172.21.15.146:0/1983601190 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3ed40b2880 0x7f3ed40b4d40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:30.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:30.728+0000 7f3ef3600700 1 --2- 172.21.15.146:0/1983601190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eec10b6e0 0x7f3eec1a7190 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:30.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:30.728+0000 7f3ef3600700 1 --2- 172.21.15.146:0/1983601190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eec109b40 0x7f3eec19fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:30.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:30.728+0000 7f3ef3600700 1 --2- 172.21.15.146:0/1983601190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3eec10ad40 0x7f3eec1a0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:30.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:30.728+0000 7f3ef3600700 1 -- 172.21.15.146:0/1983601190 >> 172.21.15.146:0/1983601190 conn(0x7f3eec078b10 msgr2=0x7f3eec10e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:42:30.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:30.728+0000 7f3ef3600700 1 -- 172.21.15.146:0/1983601190 shutdown_connections 2024-05-03T16:42:30.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:30.728+0000 7f3ef3600700 1 -- 172.21.15.146:0/1983601190 wait complete. 2024-05-03T16:42:31.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:30 smithi146 ceph-mon[32357]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-03T16:42:31.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:30 smithi146 ceph-mon[32357]: osdmap e70: 12 total, 11 up, 12 in 2024-05-03T16:42:31.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:30 smithi146 ceph-mon[32357]: from='osd.11 [v2:172.21.15.146:6824/2627233639,v1:172.21.15.146:6825/2627233639]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:42:31.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:30 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T16:42:31.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:30 smithi146 ceph-mon[32357]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:42:31.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:30 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:31.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:30 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:31.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:30 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:42:31.143 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:30 smithi081 ceph-mon[28640]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-03T16:42:31.143 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:30 smithi081 ceph-mon[28640]: osdmap e70: 12 total, 11 up, 12 in 2024-05-03T16:42:31.143 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:30 smithi081 ceph-mon[28640]: from='osd.11 [v2:172.21.15.146:6824/2627233639,v1:172.21.15.146:6825/2627233639]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:42:31.143 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:30 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T16:42:31.143 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:30 smithi081 ceph-mon[28640]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:42:31.143 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:30 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:31.143 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:30 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:31.143 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:30 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:42:31.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:30 smithi134 ceph-mon[31708]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-03T16:42:31.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:30 smithi134 ceph-mon[31708]: osdmap e70: 12 total, 11 up, 12 in 2024-05-03T16:42:31.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:30 smithi134 ceph-mon[31708]: from='osd.11 [v2:172.21.15.146:6824/2627233639,v1:172.21.15.146:6825/2627233639]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:42:31.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:30 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T16:42:31.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:30 smithi134 ceph-mon[31708]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-05-03T16:42:31.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:30 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:31.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:30 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:31.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:30 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:42:31.562 DEBUG:teuthology.orchestra.run.smithi146:osd.11> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.11.service 2024-05-03T16:42:31.566 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-03T16:42:31.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-03T16:42:31.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:31 smithi081 ceph-mon[28640]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:31.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:31 smithi081 ceph-mon[28640]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-05-03T16:42:31.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:31 smithi081 ceph-mon[28640]: osdmap e71: 12 total, 11 up, 12 in 2024-05-03T16:42:31.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T16:42:31.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T16:42:32.006 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:42:32.045 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:31 smithi146 ceph-mon[32357]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:32.045 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:31 smithi146 ceph-mon[32357]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-05-03T16:42:32.045 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:31 smithi146 ceph-mon[32357]: osdmap e71: 12 total, 11 up, 12 in 2024-05-03T16:42:32.045 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T16:42:32.045 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T16:42:32.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:31 smithi134 ceph-mon[31708]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-05-03T16:42:32.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:31 smithi134 ceph-mon[31708]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-05-03T16:42:32.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:31 smithi134 ceph-mon[31708]: osdmap e71: 12 total, 11 up, 12 in 2024-05-03T16:42:32.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T16:42:32.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T16:42:33.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:32 smithi146 ceph-mon[32357]: purged_snaps scrub starts 2024-05-03T16:42:33.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:32 smithi146 ceph-mon[32357]: purged_snaps scrub ok 2024-05-03T16:42:33.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:32 smithi146 ceph-mon[32357]: osd.11 [v2:172.21.15.146:6824/2627233639,v1:172.21.15.146:6825/2627233639] boot 2024-05-03T16:42:33.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:32 smithi146 ceph-mon[32357]: osdmap e72: 12 total, 12 up, 12 in 2024-05-03T16:42:33.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:32 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T16:42:33.173 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:32 smithi081 ceph-mon[28640]: purged_snaps scrub starts 2024-05-03T16:42:33.173 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:32 smithi081 ceph-mon[28640]: purged_snaps scrub ok 2024-05-03T16:42:33.173 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:32 smithi081 ceph-mon[28640]: osd.11 [v2:172.21.15.146:6824/2627233639,v1:172.21.15.146:6825/2627233639] boot 2024-05-03T16:42:33.173 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:32 smithi081 ceph-mon[28640]: osdmap e72: 12 total, 12 up, 12 in 2024-05-03T16:42:33.173 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:32 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T16:42:33.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:32 smithi134 ceph-mon[31708]: purged_snaps scrub starts 2024-05-03T16:42:33.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:32 smithi134 ceph-mon[31708]: purged_snaps scrub ok 2024-05-03T16:42:33.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:32 smithi134 ceph-mon[31708]: osd.11 [v2:172.21.15.146:6824/2627233639,v1:172.21.15.146:6825/2627233639] boot 2024-05-03T16:42:33.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:32 smithi134 ceph-mon[31708]: osdmap e72: 12 total, 12 up, 12 in 2024-05-03T16:42:33.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:32 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T16:42:34.037 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:33 smithi146 ceph-mon[32357]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:34.037 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:33 smithi146 ceph-mon[32357]: osdmap e73: 12 total, 12 up, 12 in 2024-05-03T16:42:34.048 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:33 smithi081 ceph-mon[28640]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:34.048 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:33 smithi081 ceph-mon[28640]: osdmap e73: 12 total, 12 up, 12 in 2024-05-03T16:42:34.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:33 smithi134 ceph-mon[31708]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:34.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:33 smithi134 ceph-mon[31708]: osdmap e73: 12 total, 12 up, 12 in 2024-05-03T16:42:34.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.314+0000 7f371a600700 1 -- 172.21.15.81:0/315307817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3714103eb0 msgr2=0x7f37141062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:34.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.314+0000 7f371a600700 1 --2- 172.21.15.81:0/315307817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3714103eb0 0x7f37141062a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3708009990 tx=0x7f3708009ca0 comp rx=0 tx=0).stop 2024-05-03T16:42:34.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.314+0000 7f371a600700 1 -- 172.21.15.81:0/315307817 shutdown_connections 2024-05-03T16:42:34.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.314+0000 7f371a600700 1 --2- 172.21.15.81:0/315307817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3714109110 0x7f371410b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:34.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.314+0000 7f371a600700 1 --2- 172.21.15.81:0/315307817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3714103eb0 0x7f37141062a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:34.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.314+0000 7f371a600700 1 --2- 172.21.15.81:0/315307817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37141067e0 0x7f3714108bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:34.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.314+0000 7f371a600700 1 -- 172.21.15.81:0/315307817 >> 172.21.15.81:0/315307817 conn(0x7f37140fd8c0 msgr2=0x7f37140ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:42:34.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.314+0000 7f371a600700 1 -- 172.21.15.81:0/315307817 shutdown_connections 2024-05-03T16:42:34.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.314+0000 7f371a600700 1 -- 172.21.15.81:0/315307817 wait complete. 2024-05-03T16:42:34.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.315+0000 7f371a600700 1 Processor -- start 2024-05-03T16:42:34.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.316+0000 7f371a600700 1 -- start start 2024-05-03T16:42:34.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.316+0000 7f371a600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3714103eb0 0x7f3714103810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:34.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.316+0000 7f371a600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37141067e0 0x7f3714101e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:34.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.316+0000 7f371a600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3714109110 0x7f37141023a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:34.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.316+0000 7f371a600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f371410ede0 con 0x7f3714103eb0 2024-05-03T16:42:34.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.316+0000 7f371a600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f371410ec60 con 0x7f3714109110 2024-05-03T16:42:34.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.316+0000 7f371a600700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f371410ef60 con 0x7f37141067e0 2024-05-03T16:42:34.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.316+0000 7f3719200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3714103eb0 0x7f3714103810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:34.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.316+0000 7f3719200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3714103eb0 0x7f3714103810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48412/0 (socket says 172.21.15.81:48412) 2024-05-03T16:42:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.316+0000 7f3719200700 1 -- 172.21.15.81:0/2456048984 learned_addr learned my addr 172.21.15.81:0/2456048984 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:42:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.316+0000 7f3713e00700 1 --2- 172.21.15.81:0/2456048984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37141067e0 0x7f3714101e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.316+0000 7f3719c00700 1 --2- 172.21.15.81:0/2456048984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3714109110 0x7f37141023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.317+0000 7f3719200700 1 -- 172.21.15.81:0/2456048984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37141067e0 msgr2=0x7f3714101e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.317+0000 7f3719200700 1 --2- 172.21.15.81:0/2456048984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37141067e0 0x7f3714101e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.317+0000 7f3719200700 1 -- 172.21.15.81:0/2456048984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3714109110 msgr2=0x7f37141023a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.317+0000 7f3719200700 1 --2- 172.21.15.81:0/2456048984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3714109110 0x7f37141023a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.317+0000 7f3719200700 1 -- 172.21.15.81:0/2456048984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3714102c50 con 0x7f3714103eb0 2024-05-03T16:42:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.317+0000 7f3719200700 1 --2- 172.21.15.81:0/2456048984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3714103eb0 0x7f3714103810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3708005910 tx=0x7f370800bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:42:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.317+0000 7f3711600700 1 -- 172.21.15.81:0/2456048984 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3708026070 con 0x7f3714103eb0 2024-05-03T16:42:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.317+0000 7f3711600700 1 -- 172.21.15.81:0/2456048984 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3708003da0 con 0x7f3714103eb0 2024-05-03T16:42:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.317+0000 7f371a600700 1 -- 172.21.15.81:0/2456048984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37141a35a0 con 0x7f3714103eb0 2024-05-03T16:42:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.317+0000 7f3711600700 1 -- 172.21.15.81:0/2456048984 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3708021410 con 0x7f3714103eb0 2024-05-03T16:42:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.317+0000 7f371a600700 1 -- 172.21.15.81:0/2456048984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37141a39f0 con 0x7f3714103eb0 2024-05-03T16:42:34.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.319+0000 7f371a600700 1 -- 172.21.15.81:0/2456048984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f371406a190 con 0x7f3714103eb0 2024-05-03T16:42:34.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.321+0000 7f3711600700 1 -- 172.21.15.81:0/2456048984 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f3708029070 con 0x7f3714103eb0 2024-05-03T16:42:34.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.322+0000 7f3711600700 1 --2- 172.21.15.81:0/2456048984 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f36fc0b2880 0x7f36fc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:34.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.323+0000 7f3711600700 1 -- 172.21.15.81:0/2456048984 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f37080e2f20 con 0x7f3714103eb0 2024-05-03T16:42:34.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.323+0000 7f3713e00700 1 --2- 172.21.15.81:0/2456048984 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f36fc0b2880 0x7f36fc0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:34.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.324+0000 7f3713e00700 1 --2- 172.21.15.81:0/2456048984 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f36fc0b2880 0x7f36fc0b4d40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3700005950 tx=0x7f370000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:42:34.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.327+0000 7f3711600700 1 -- 172.21.15.81:0/2456048984 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f3708030080 con 0x7f3714103eb0 2024-05-03T16:42:34.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.559+0000 7f371a600700 1 -- 172.21.15.81:0/2456048984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f37140640b0 con 0x7f3714103eb0 2024-05-03T16:42:34.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.560+0000 7f3711600700 1 -- 172.21.15.81:0/2456048984 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f3708013070 con 0x7f3714103eb0 2024-05-03T16:42:34.562 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:42:34.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.562+0000 7f371a600700 1 -- 172.21.15.81:0/2456048984 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f36fc0b2880 msgr2=0x7f36fc0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:34.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.562+0000 7f371a600700 1 --2- 172.21.15.81:0/2456048984 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f36fc0b2880 0x7f36fc0b4d40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3700005950 tx=0x7f370000b410 comp rx=0 tx=0).stop 2024-05-03T16:42:34.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.563+0000 7f371a600700 1 -- 172.21.15.81:0/2456048984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3714103eb0 msgr2=0x7f3714103810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:34.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.563+0000 7f371a600700 1 --2- 172.21.15.81:0/2456048984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3714103eb0 0x7f3714103810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3708005910 tx=0x7f370800bb20 comp rx=0 tx=0).stop 2024-05-03T16:42:34.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.563+0000 7f371a600700 1 -- 172.21.15.81:0/2456048984 shutdown_connections 2024-05-03T16:42:34.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.563+0000 7f371a600700 1 --2- 172.21.15.81:0/2456048984 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f36fc0b2880 0x7f36fc0b4d40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:34.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.563+0000 7f371a600700 1 --2- 172.21.15.81:0/2456048984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3714109110 0x7f37141023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:34.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.563+0000 7f371a600700 1 --2- 172.21.15.81:0/2456048984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3714103eb0 0x7f3714103810 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:34.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.563+0000 7f371a600700 1 --2- 172.21.15.81:0/2456048984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37141067e0 0x7f3714101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:34.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.563+0000 7f371a600700 1 -- 172.21.15.81:0/2456048984 >> 172.21.15.81:0/2456048984 conn(0x7f37140fd8c0 msgr2=0x7f3714105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:42:34.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.563+0000 7f371a600700 1 -- 172.21.15.81:0/2456048984 shutdown_connections 2024-05-03T16:42:34.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:34.563+0000 7f371a600700 1 -- 172.21.15.81:0/2456048984 wait complete. 2024-05-03T16:42:35.111 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:34 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2456048984' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-03T16:42:35.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:34 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2456048984' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-03T16:42:35.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:34 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2456048984' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-03T16:42:35.475 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":73,"num_osds":12,"num_up_osds":12,"osd_up_since":1714754551,"num_in_osds":12,"osd_in_since":1714754526,"num_remapped_pgs":0} 2024-05-03T16:42:35.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T16:42:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:42:36.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:35 smithi146 ceph-mon[32357]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:36.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:35 smithi081 ceph-mon[28640]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:36.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:35 smithi134 ceph-mon[31708]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:37.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:37 smithi081 ceph-mon[28640]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:37.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:37 smithi081 ceph-mon[28640]: Detected new or changed devices on smithi146 2024-05-03T16:42:37.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:37.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:37.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:37.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:37.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:37.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:37.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:37 smithi081 ceph-mon[28640]: Adjusting osd_memory_target on smithi146 to 4272M 2024-05-03T16:42:37.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:37.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:37.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:42:37.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:37.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:37 smithi134 ceph-mon[31708]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:37.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:37 smithi134 ceph-mon[31708]: Detected new or changed devices on smithi146 2024-05-03T16:42:37.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:37.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:37.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:37.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:37.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:37.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:37.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:37 smithi134 ceph-mon[31708]: Adjusting osd_memory_target on smithi146 to 4272M 2024-05-03T16:42:37.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:37.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:37.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:42:37.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:38.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:37 smithi146 ceph-mon[32357]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:38.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:37 smithi146 ceph-mon[32357]: Detected new or changed devices on smithi146 2024-05-03T16:42:38.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:38.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:38.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:38.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:38.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:38.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:42:38.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:37 smithi146 ceph-mon[32357]: Adjusting osd_memory_target on smithi146 to 4272M 2024-05-03T16:42:38.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:38.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:38.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:42:38.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:38.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.283+0000 7f2fc9800700 1 -- 172.21.15.81:0/1490288147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4075ff0 msgr2=0x7f2fc4114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:38.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.283+0000 7f2fc9800700 1 --2- 172.21.15.81:0/1490288147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4075ff0 0x7f2fc4114130 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009990 tx=0x7f2fac009ca0 comp rx=0 tx=0).stop 2024-05-03T16:42:38.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.283+0000 7f2fc9800700 1 -- 172.21.15.81:0/1490288147 shutdown_connections 2024-05-03T16:42:38.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.283+0000 7f2fc9800700 1 --2- 172.21.15.81:0/1490288147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc4114670 0x7f2fc4116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:38.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.283+0000 7f2fc9800700 1 --2- 172.21.15.81:0/1490288147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fc40756d0 0x7f2fc4075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:38.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.283+0000 7f2fc9800700 1 --2- 172.21.15.81:0/1490288147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4075ff0 0x7f2fc4114130 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:38.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.283+0000 7f2fc9800700 1 -- 172.21.15.81:0/1490288147 >> 172.21.15.81:0/1490288147 conn(0x7f2fc407a600 msgr2=0x7f2fc407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:42:38.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.283+0000 7f2fc9800700 1 -- 172.21.15.81:0/1490288147 shutdown_connections 2024-05-03T16:42:38.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.283+0000 7f2fc9800700 1 -- 172.21.15.81:0/1490288147 wait complete. 2024-05-03T16:42:38.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.285+0000 7f2fc9800700 1 Processor -- start 2024-05-03T16:42:38.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.285+0000 7f2fc9800700 1 -- start start 2024-05-03T16:42:38.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.285+0000 7f2fc9800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fc40756d0 0x7f2fc41a0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:38.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.285+0000 7f2fc9800700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc4075ff0 0x7f2fc41a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:38.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.285+0000 7f2fc9800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4114670 0x7f2fc41a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:38.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.285+0000 7f2fc9800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc4119b60 con 0x7f2fc4114670 2024-05-03T16:42:38.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.285+0000 7f2fc9800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc41199e0 con 0x7f2fc40756d0 2024-05-03T16:42:38.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.285+0000 7f2fc9800700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc4119ce0 con 0x7f2fc4075ff0 2024-05-03T16:42:38.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.285+0000 7f2fc3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4114670 0x7f2fc41a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:38.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.286+0000 7f2fc3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4114670 0x7f2fc41a4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59270/0 (socket says 172.21.15.81:59270) 2024-05-03T16:42:38.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.286+0000 7f2fc3400700 1 -- 172.21.15.81:0/3553022118 learned_addr learned my addr 172.21.15.81:0/3553022118 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:42:38.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.286+0000 7f2fba000700 1 --2- 172.21.15.81:0/3553022118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc4075ff0 0x7f2fc41a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:38.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.286+0000 7f2fc2a00700 1 --2- 172.21.15.81:0/3553022118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fc40756d0 0x7f2fc41a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:38.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.286+0000 7f2fc3400700 1 -- 172.21.15.81:0/3553022118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc4075ff0 msgr2=0x7f2fc41a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:38.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.286+0000 7f2fc3400700 1 --2- 172.21.15.81:0/3553022118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc4075ff0 0x7f2fc41a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:38.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.286+0000 7f2fc3400700 1 -- 172.21.15.81:0/3553022118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fc40756d0 msgr2=0x7f2fc41a0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:38.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.286+0000 7f2fc3400700 1 --2- 172.21.15.81:0/3553022118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fc40756d0 0x7f2fc41a0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:38.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.286+0000 7f2fc3400700 1 -- 172.21.15.81:0/3553022118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc41a50a0 con 0x7f2fc4114670 2024-05-03T16:42:38.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.286+0000 7f2fc3400700 1 --2- 172.21.15.81:0/3553022118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4114670 0x7f2fc41a4960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00c970 tx=0x7f2fbc00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:42:38.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.287+0000 7f2fbbe00700 1 -- 172.21.15.81:0/3553022118 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc007b00 con 0x7f2fc4114670 2024-05-03T16:42:38.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.287+0000 7f2fbbe00700 1 -- 172.21.15.81:0/3553022118 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2fbc00ce50 con 0x7f2fc4114670 2024-05-03T16:42:38.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.287+0000 7f2fbbe00700 1 -- 172.21.15.81:0/3553022118 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc005430 con 0x7f2fc4114670 2024-05-03T16:42:38.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.287+0000 7f2fc9800700 1 -- 172.21.15.81:0/3553022118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc41a5390 con 0x7f2fc4114670 2024-05-03T16:42:38.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.287+0000 7f2fc9800700 1 -- 172.21.15.81:0/3553022118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc41acc10 con 0x7f2fc4114670 2024-05-03T16:42:38.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.288+0000 7f2fc9800700 1 -- 172.21.15.81:0/3553022118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc406a190 con 0x7f2fc4114670 2024-05-03T16:42:38.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.290+0000 7f2fbbe00700 1 -- 172.21.15.81:0/3553022118 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f2fbc004750 con 0x7f2fc4114670 2024-05-03T16:42:38.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.292+0000 7f2fbbe00700 1 --2- 172.21.15.81:0/3553022118 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f2fa80b2900 0x7f2fa80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:38.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.292+0000 7f2fbbe00700 1 -- 172.21.15.81:0/3553022118 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f2fbc0e1cf0 con 0x7f2fc4114670 2024-05-03T16:42:38.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.292+0000 7f2fc2a00700 1 --2- 172.21.15.81:0/3553022118 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f2fa80b2900 0x7f2fa80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:38.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.293+0000 7f2fc2a00700 1 --2- 172.21.15.81:0/3553022118 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f2fa80b2900 0x7f2fa80b4dc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4007fd0 tx=0x7f2fb4009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:42:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.294+0000 7f2fbbe00700 1 -- 172.21.15.81:0/3553022118 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f2fbc014030 con 0x7f2fc4114670 2024-05-03T16:42:38.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.530+0000 7f2fc9800700 1 -- 172.21.15.81:0/3553022118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2fc41a13f0 con 0x7f2fc4114670 2024-05-03T16:42:38.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.531+0000 7f2fbbe00700 1 -- 172.21.15.81:0/3553022118 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18482 (secure 0 0 0) 0x7f2fc41a13f0 con 0x7f2fc4114670 2024-05-03T16:42:38.534 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:42:38.534 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":73,"fsid":"8988869e-096a-11ef-bc97-c7b262605968","created":"2024-05-03T16:32:56.440204+0000","modified":"2024-05-03T16:42:32.787913+0000","last_up_change":"2024-05-03T16:42:31.768974+0000","last_in_change":"2024-05-03T16:42:06.989688+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T16:37:18.271939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"957b05dc-dfb9-4561-8800-b7ec0aba679d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6803","nonce":1639968055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6805","nonce":1639968055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6809","nonce":1639968055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6807","nonce":1639968055}]},"public_addr":"172.21.15.81:6803/1639968055","cluster_addr":"172.21.15.81:6805/1639968055","heartbeat_back_addr":"172.21.15.81:6809/1639968055","heartbeat_front_addr":"172.21.15.81:6807/1639968055","state":["exists","up"]},{"osd":1,"uuid":"3bb199cd-b4d0-4c67-b98f-2106336dd57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6801","nonce":1928503491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6803","nonce":1928503491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6807","nonce":1928503491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6805","nonce":1928503491}]},"public_addr":"172.21.15.134:6801/1928503491","cluster_addr":"172.21.15.134:6803/1928503491","heartbeat_back_addr":"172.21.15.134:6807/1928503491","heartbeat_front_addr":"172.21.15.134:6805/1928503491","state":["exists","up"]},{"osd":2,"uuid":"79ec9995-50e8-4eaf-935a-39a479925734","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6801","nonce":1233108455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6803","nonce":1233108455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6807","nonce":1233108455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6805","nonce":1233108455}]},"public_addr":"172.21.15.146:6801/1233108455","cluster_addr":"172.21.15.146:6803/1233108455","heartbeat_back_addr":"172.21.15.146:6807/1233108455","heartbeat_front_addr":"172.21.15.146:6805/1233108455","state":["exists","up"]},{"osd":3,"uuid":"2d38f4e7-73c3-4e70-9f87-d44da28db452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6811","nonce":4128709465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6813","nonce":4128709465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6817","nonce":4128709465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6815","nonce":4128709465}]},"public_addr":"172.21.15.81:6811/4128709465","cluster_addr":"172.21.15.81:6813/4128709465","heartbeat_back_addr":"172.21.15.81:6817/4128709465","heartbeat_front_addr":"172.21.15.81:6815/4128709465","state":["exists","up"]},{"osd":4,"uuid":"3837a136-a25b-4cb9-aa82-084b477c67d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6809","nonce":1498616220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6811","nonce":1498616220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6815","nonce":1498616220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6813","nonce":1498616220}]},"public_addr":"172.21.15.134:6809/1498616220","cluster_addr":"172.21.15.134:6811/1498616220","heartbeat_back_addr":"172.21.15.134:6815/1498616220","heartbeat_front_addr":"172.21.15.134:6813/1498616220","state":["exists","up"]},{"osd":5,"uuid":"2e783d2e-c181-41a9-97de-f17705a201bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6809","nonce":1276988922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6811","nonce":1276988922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6815","nonce":1276988922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6813","nonce":1276988922}]},"public_addr":"172.21.15.146:6809/1276988922","cluster_addr":"172.21.15.146:6811/1276988922","heartbeat_back_addr":"172.21.15.146:6815/1276988922","heartbeat_front_addr":"172.21.15.146:6813/1276988922","state":["exists","up"]},{"osd":6,"uuid":"6faebdbf-7820-42e5-b07c-15db11f278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6819","nonce":3319125020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6821","nonce":3319125020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6825","nonce":3319125020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6823","nonce":3319125020}]},"public_addr":"172.21.15.81:6819/3319125020","cluster_addr":"172.21.15.81:6821/3319125020","heartbeat_back_addr":"172.21.15.81:6825/3319125020","heartbeat_front_addr":"172.21.15.81:6823/3319125020","state":["exists","up"]},{"osd":7,"uuid":"ec4b6b84-6c5f-4d07-a747-06610b2cd345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6817","nonce":3241993481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6819","nonce":3241993481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6823","nonce":3241993481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6821","nonce":3241993481}]},"public_addr":"172.21.15.134:6817/3241993481","cluster_addr":"172.21.15.134:6819/3241993481","heartbeat_back_addr":"172.21.15.134:6823/3241993481","heartbeat_front_addr":"172.21.15.134:6821/3241993481","state":["exists","up"]},{"osd":8,"uuid":"02b1b0fd-837c-4c29-bedb-54fa2ee7531d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6817","nonce":2423161684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6819","nonce":2423161684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6823","nonce":2423161684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6821","nonce":2423161684}]},"public_addr":"172.21.15.146:6817/2423161684","cluster_addr":"172.21.15.146:6819/2423161684","heartbeat_back_addr":"172.21.15.146:6823/2423161684","heartbeat_front_addr":"172.21.15.146:6821/2423161684","state":["exists","up"]},{"osd":9,"uuid":"46713a8e-743d-44d5-babe-c01d3179afcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6827","nonce":873909886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6829","nonce":873909886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6833","nonce":873909886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6831","nonce":873909886}]},"public_addr":"172.21.15.81:6827/873909886","cluster_addr":"172.21.15.81:6829/873909886","heartbeat_back_addr":"172.21.15.81:6833/873909886","heartbeat_front_addr":"172.21.15.81:6831/873909886","state":["exists","up"]},{"osd":10,"uuid":"12fcae89-30af-436b-a513-3998303da93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6825","nonce":1183629038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6827","nonce":1183629038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6831","nonce":1183629038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6829","nonce":1183629038}]},"public_addr":"172.21.15.134:6825/1183629038","cluster_addr":"172.21.15.134:6827/1183629038","heartbeat_back_addr":"172.21.15.134:6831/1183629038","heartbeat_front_addr":"172.21.15.134:6829/1183629038","state":["exists","up"]},{"osd":11,"uuid":"a543f42c-61da-4a93-b16b-a2891a4ef873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6825","nonce":2627233639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6827","nonce":2627233639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6831","nonce":2627233639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6829","nonce":2627233639}]},"public_addr":"172.21.15.146:6825/2627233639","cluster_addr":"172.21.15.146:6827/2627233639","heartbeat_back_addr":"172.21.15.146:6831/2627233639","heartbeat_front_addr":"172.21.15.146:6829/2627233639","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:08.411954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:41.459869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:15.068172+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:49.711273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:23.231811+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:57.917964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:39:32.982397+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:07.434610+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:43.606108+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:19.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:54.917284+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:42:30.525217+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6801/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/2237510960":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6801/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/3199433706":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1689714816":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/2777950369":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/1982866220":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1112375028":"2024-05-04T16:33:30.274051+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T16:42:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.534+0000 7f2fc9800700 1 -- 172.21.15.81:0/3553022118 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f2fa80b2900 msgr2=0x7f2fa80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.534+0000 7f2fc9800700 1 --2- 172.21.15.81:0/3553022118 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f2fa80b2900 0x7f2fa80b4dc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4007fd0 tx=0x7f2fb4009040 comp rx=0 tx=0).stop 2024-05-03T16:42:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.534+0000 7f2fc9800700 1 -- 172.21.15.81:0/3553022118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4114670 msgr2=0x7f2fc41a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.534+0000 7f2fc9800700 1 --2- 172.21.15.81:0/3553022118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4114670 0x7f2fc41a4960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00c970 tx=0x7f2fbc00cd30 comp rx=0 tx=0).stop 2024-05-03T16:42:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.535+0000 7f2fc9800700 1 -- 172.21.15.81:0/3553022118 shutdown_connections 2024-05-03T16:42:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.535+0000 7f2fc9800700 1 --2- 172.21.15.81:0/3553022118 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f2fa80b2900 0x7f2fa80b4dc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.535+0000 7f2fc9800700 1 --2- 172.21.15.81:0/3553022118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4114670 0x7f2fc41a4960 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.535+0000 7f2fc9800700 1 --2- 172.21.15.81:0/3553022118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fc40756d0 0x7f2fc41a0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.535+0000 7f2fc9800700 1 --2- 172.21.15.81:0/3553022118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc4075ff0 0x7f2fc41a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.535+0000 7f2fc9800700 1 -- 172.21.15.81:0/3553022118 >> 172.21.15.81:0/3553022118 conn(0x7f2fc407a600 msgr2=0x7f2fc41134a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:42:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.535+0000 7f2fc9800700 1 -- 172.21.15.81:0/3553022118 shutdown_connections 2024-05-03T16:42:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:38.535+0000 7f2fc9800700 1 -- 172.21.15.81:0/3553022118 wait complete. 2024-05-03T16:42:38.928 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:38 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3553022118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:42:38.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:38 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3553022118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:42:39.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:38 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3553022118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:42:39.390 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-03T16:37:18.271939+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-03T16:42:39.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-03T16:42:39.819 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:42:39.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:39 smithi134 ceph-mon[31708]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:39.972 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:39 smithi081 ceph-mon[28640]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:40.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:39 smithi146 ceph-mon[32357]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:41.750 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:41 smithi081 ceph-mon[28640]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:41.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:41 smithi134 ceph-mon[31708]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.045+0000 7f5c22800700 1 -- 172.21.15.81:0/2362847913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c101840 msgr2=0x7f5c1c101c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.045+0000 7f5c22800700 1 --2- 172.21.15.81:0/2362847913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c101840 0x7f5c1c101c20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009990 tx=0x7f5c10009ca0 comp rx=0 tx=0).stop 2024-05-03T16:42:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.045+0000 7f5c22800700 1 -- 172.21.15.81:0/2362847913 shutdown_connections 2024-05-03T16:42:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.045+0000 7f5c22800700 1 --2- 172.21.15.81:0/2362847913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c1c10fd80 0x7f5c1c112170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.045+0000 7f5c22800700 1 --2- 172.21.15.81:0/2362847913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c101840 0x7f5c1c101c20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.045+0000 7f5c22800700 1 --2- 172.21.15.81:0/2362847913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c1c102160 0x7f5c1c10f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.045+0000 7f5c22800700 1 -- 172.21.15.81:0/2362847913 >> 172.21.15.81:0/2362847913 conn(0x7f5c1c077140 msgr2=0x7f5c1c077550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:42:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.045+0000 7f5c22800700 1 -- 172.21.15.81:0/2362847913 shutdown_connections 2024-05-03T16:42:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.045+0000 7f5c22800700 1 -- 172.21.15.81:0/2362847913 wait complete. 2024-05-03T16:42:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.046+0000 7f5c22800700 1 Processor -- start 2024-05-03T16:42:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.047+0000 7f5c22800700 1 -- start start 2024-05-03T16:42:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.047+0000 7f5c22800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c101840 0x7f5c1c1a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.047+0000 7f5c22800700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c1c102160 0x7f5c1c1a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.047+0000 7f5c22800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c1c10fd80 0x7f5c1c19b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.047+0000 7f5c22800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c115680 con 0x7f5c1c101840 2024-05-03T16:42:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.047+0000 7f5c22800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c115500 con 0x7f5c1c10fd80 2024-05-03T16:42:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.047+0000 7f5c22800700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c115800 con 0x7f5c1c102160 2024-05-03T16:42:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.047+0000 7f5c21400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c101840 0x7f5c1c1a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.047+0000 7f5c21400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c101840 0x7f5c1c1a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59296/0 (socket says 172.21.15.81:59296) 2024-05-03T16:42:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.048+0000 7f5c21400700 1 -- 172.21.15.81:0/2815328704 learned_addr learned my addr 172.21.15.81:0/2815328704 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:42:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.048+0000 7f5c20a00700 1 --2- 172.21.15.81:0/2815328704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c1c102160 0x7f5c1c1a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.048+0000 7f5c21e00700 1 --2- 172.21.15.81:0/2815328704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c1c10fd80 0x7f5c1c19b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.048+0000 7f5c21400700 1 -- 172.21.15.81:0/2815328704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c1c102160 msgr2=0x7f5c1c1a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.048+0000 7f5c21400700 1 --2- 172.21.15.81:0/2815328704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c1c102160 0x7f5c1c1a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.048+0000 7f5c21400700 1 -- 172.21.15.81:0/2815328704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c1c10fd80 msgr2=0x7f5c1c19b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.048+0000 7f5c21400700 1 --2- 172.21.15.81:0/2815328704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c1c10fd80 0x7f5c1c19b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.048+0000 7f5c21400700 1 -- 172.21.15.81:0/2815328704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1c19c140 con 0x7f5c1c101840 2024-05-03T16:42:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.048+0000 7f5c21400700 1 --2- 172.21.15.81:0/2815328704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c101840 0x7f5c1c1a17d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5c1000b650 tx=0x7f5c1000bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:42:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.049+0000 7f5c1a000700 1 -- 172.21.15.81:0/2815328704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c10027070 con 0x7f5c1c101840 2024-05-03T16:42:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.049+0000 7f5c1a000700 1 -- 172.21.15.81:0/2815328704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c10022470 con 0x7f5c1c101840 2024-05-03T16:42:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.049+0000 7f5c1a000700 1 -- 172.21.15.81:0/2815328704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c10017650 con 0x7f5c1c101840 2024-05-03T16:42:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.049+0000 7f5c22800700 1 -- 172.21.15.81:0/2815328704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c1c19c3d0 con 0x7f5c1c101840 2024-05-03T16:42:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.049+0000 7f5c22800700 1 -- 172.21.15.81:0/2815328704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c1c1a86a0 con 0x7f5c1c101840 2024-05-03T16:42:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.050+0000 7f5c22800700 1 -- 172.21.15.81:0/2815328704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c1c102a60 con 0x7f5c1c101840 2024-05-03T16:42:42.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.052+0000 7f5c1a000700 1 -- 172.21.15.81:0/2815328704 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f5c10009d10 con 0x7f5c1c101840 2024-05-03T16:42:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.054+0000 7f5c1a000700 1 --2- 172.21.15.81:0/2815328704 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5c040b2880 0x7f5c040b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.054+0000 7f5c1a000700 1 -- 172.21.15.81:0/2815328704 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f5c100e2a10 con 0x7f5c1c101840 2024-05-03T16:42:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.054+0000 7f5c20a00700 1 --2- 172.21.15.81:0/2815328704 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5c040b2880 0x7f5c040b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.055+0000 7f5c20a00700 1 --2- 172.21.15.81:0/2815328704 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5c040b2880 0x7f5c040b4d40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c1047d0 tx=0x7f5c08009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:42:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.059+0000 7f5c1a000700 1 -- 172.21.15.81:0/2815328704 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f5c10013070 con 0x7f5c1c101840 2024-05-03T16:42:42.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:41 smithi146 ceph-mon[32357]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:42.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.287+0000 7f5c22800700 1 -- 172.21.15.81:0/2815328704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5c1c19cec0 con 0x7f5c1c101840 2024-05-03T16:42:42.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.288+0000 7f5c1a000700 1 -- 172.21.15.81:0/2815328704 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f5c100aabc0 con 0x7f5c1c101840 2024-05-03T16:42:42.291 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-03T16:42:42.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.291+0000 7f5c22800700 1 -- 172.21.15.81:0/2815328704 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5c040b2880 msgr2=0x7f5c040b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.291+0000 7f5c22800700 1 --2- 172.21.15.81:0/2815328704 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5c040b2880 0x7f5c040b4d40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c1047d0 tx=0x7f5c08009260 comp rx=0 tx=0).stop 2024-05-03T16:42:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.291+0000 7f5c22800700 1 -- 172.21.15.81:0/2815328704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c101840 msgr2=0x7f5c1c1a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.291+0000 7f5c22800700 1 --2- 172.21.15.81:0/2815328704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c101840 0x7f5c1c1a17d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5c1000b650 tx=0x7f5c1000bfc0 comp rx=0 tx=0).stop 2024-05-03T16:42:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.291+0000 7f5c22800700 1 -- 172.21.15.81:0/2815328704 shutdown_connections 2024-05-03T16:42:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.291+0000 7f5c22800700 1 --2- 172.21.15.81:0/2815328704 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5c040b2880 0x7f5c040b4d40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.291+0000 7f5c22800700 1 --2- 172.21.15.81:0/2815328704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c1c10fd80 0x7f5c1c19b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:42.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.291+0000 7f5c22800700 1 --2- 172.21.15.81:0/2815328704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c101840 0x7f5c1c1a17d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:42.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.291+0000 7f5c22800700 1 --2- 172.21.15.81:0/2815328704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c1c102160 0x7f5c1c1a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:42.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.291+0000 7f5c22800700 1 -- 172.21.15.81:0/2815328704 >> 172.21.15.81:0/2815328704 conn(0x7f5c1c077140 msgr2=0x7f5c1c110340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:42:42.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.291+0000 7f5c22800700 1 -- 172.21.15.81:0/2815328704 shutdown_connections 2024-05-03T16:42:42.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:42.292+0000 7f5c22800700 1 -- 172.21.15.81:0/2815328704 wait complete. 2024-05-03T16:42:42.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:42 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2815328704' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-03T16:42:42.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:42 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2815328704' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-03T16:42:43.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:42 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2815328704' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-03T16:42:43.110 INFO:tasks.cephadm:Adding mds.a on smithi081 2024-05-03T16:42:43.111 INFO:tasks.cephadm:Adding mds.d on smithi081 2024-05-03T16:42:43.111 INFO:tasks.cephadm:Adding mds.g on smithi081 2024-05-03T16:42:43.111 INFO:tasks.cephadm:Adding mds.j on smithi081 2024-05-03T16:42:43.111 INFO:tasks.cephadm:Adding mds.b on smithi134 2024-05-03T16:42:43.111 INFO:tasks.cephadm:Adding mds.e on smithi134 2024-05-03T16:42:43.111 INFO:tasks.cephadm:Adding mds.h on smithi134 2024-05-03T16:42:43.111 INFO:tasks.cephadm:Adding mds.k on smithi134 2024-05-03T16:42:43.111 INFO:tasks.cephadm:Adding mds.c on smithi146 2024-05-03T16:42:43.111 INFO:tasks.cephadm:Adding mds.f on smithi146 2024-05-03T16:42:43.111 INFO:tasks.cephadm:Adding mds.i on smithi146 2024-05-03T16:42:43.111 INFO:tasks.cephadm:Adding mds.l on smithi146 2024-05-03T16:42:43.111 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph orch apply mds all '12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi146=c;smithi146=f;smithi146=i;smithi146=l' 2024-05-03T16:42:43.560 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T16:42:43.966 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:43 smithi146 ceph-mon[32357]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:43.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:43 smithi134 ceph-mon[31708]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:43.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:43 smithi081 ceph-mon[28640]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:45.797 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:45 smithi146 ceph-mon[32357]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:45.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.862+0000 7f8215c00700 1 -- 172.21.15.146:0/2105290547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8210103500 msgr2=0x7f8210103920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:45.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.862+0000 7f8215c00700 1 --2- 172.21.15.146:0/2105290547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8210103500 0x7f8210103920 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8200009990 tx=0x7f8200009ca0 comp rx=0 tx=0).stop 2024-05-03T16:42:45.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.862+0000 7f8215c00700 1 -- 172.21.15.146:0/2105290547 shutdown_connections 2024-05-03T16:42:45.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.862+0000 7f8215c00700 1 --2- 172.21.15.146:0/2105290547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8210103500 0x7f8210103920 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:45.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.862+0000 7f8215c00700 1 --2- 172.21.15.146:0/2105290547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82101050a0 0x7f821010b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:45.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.862+0000 7f8215c00700 1 --2- 172.21.15.146:0/2105290547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8210104700 0x7f8210104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:45.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.862+0000 7f8215c00700 1 -- 172.21.15.146:0/2105290547 >> 172.21.15.146:0/2105290547 conn(0x7f82100feaa0 msgr2=0x7f8210100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:42:45.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.862+0000 7f8215c00700 1 -- 172.21.15.146:0/2105290547 shutdown_connections 2024-05-03T16:42:45.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.862+0000 7f8215c00700 1 -- 172.21.15.146:0/2105290547 wait complete. 2024-05-03T16:42:45.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.863+0000 7f8215c00700 1 Processor -- start 2024-05-03T16:42:45.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.863+0000 7f8215c00700 1 -- start start 2024-05-03T16:42:45.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.864+0000 7f8215c00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8210103500 0x7f821019b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.864+0000 7f8215c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8210104700 0x7f821019bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.864+0000 7f8215c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82101050a0 0x7f82101a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.864+0000 7f8215c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f821010ee50 con 0x7f82101050a0 2024-05-03T16:42:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.864+0000 7f8215c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f821010ecd0 con 0x7f8210104700 2024-05-03T16:42:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.864+0000 7f8215c00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f821010efd0 con 0x7f8210103500 2024-05-03T16:42:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.864+0000 7f820ea00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8210103500 0x7f821019b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.864+0000 7f820ea00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8210103500 0x7f821019b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45926/0 (socket says 172.21.15.146:45926) 2024-05-03T16:42:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.864+0000 7f820ea00700 1 -- 172.21.15.146:0/1650199892 learned_addr learned my addr 172.21.15.146:0/1650199892 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-05-03T16:42:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.864+0000 7f820e000700 1 --2- 172.21.15.146:0/1650199892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8210104700 0x7f821019bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.864+0000 7f820ea00700 1 -- 172.21.15.146:0/1650199892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8210104700 msgr2=0x7f821019bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.864+0000 7f820ea00700 1 --2- 172.21.15.146:0/1650199892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8210104700 0x7f821019bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.864+0000 7f820ea00700 1 -- 172.21.15.146:0/1650199892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82101050a0 msgr2=0x7f82101a2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.864+0000 7f820ea00700 1 --2- 172.21.15.146:0/1650199892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82101050a0 0x7f82101a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.864+0000 7f820ea00700 1 -- 172.21.15.146:0/1650199892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82101a3410 con 0x7f8210103500 2024-05-03T16:42:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.864+0000 7f820e000700 1 --2- 172.21.15.146:0/1650199892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8210104700 0x7f821019bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:42:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.865+0000 7f820ea00700 1 --2- 172.21.15.146:0/1650199892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8210103500 0x7f821019b7b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8200000c00 tx=0x7f82000047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:42:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.865+0000 7f8207400700 1 -- 172.21.15.146:0/1650199892 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200003c90 con 0x7f8210103500 2024-05-03T16:42:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.865+0000 7f8207400700 1 -- 172.21.15.146:0/1650199892 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8200004830 con 0x7f8210103500 2024-05-03T16:42:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.865+0000 7f8207400700 1 -- 172.21.15.146:0/1650199892 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200005280 con 0x7f8210103500 2024-05-03T16:42:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.865+0000 7f8215c00700 1 -- 172.21.15.146:0/1650199892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82101a36a0 con 0x7f8210103500 2024-05-03T16:42:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.865+0000 7f8215c00700 1 -- 172.21.15.146:0/1650199892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82101a3a40 con 0x7f8210103500 2024-05-03T16:42:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.866+0000 7f8215c00700 1 -- 172.21.15.146:0/1650199892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f821006a1d0 con 0x7f8210103500 2024-05-03T16:42:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.870+0000 7f8207400700 1 -- 172.21.15.146:0/1650199892 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f8200005440 con 0x7f8210103500 2024-05-03T16:42:45.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.872+0000 7f8207400700 1 --2- 172.21.15.146:0/1650199892 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f81f40b2900 0x7f81f40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:45.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.872+0000 7f8207400700 1 -- 172.21.15.146:0/1650199892 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f82000e3380 con 0x7f8210103500 2024-05-03T16:42:45.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.873+0000 7f820e000700 1 --2- 172.21.15.146:0/1650199892 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f81f40b2900 0x7f81f40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:45.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.874+0000 7f820e000700 1 --2- 172.21.15.146:0/1650199892 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f81f40b2900 0x7f81f40b4dc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f81fc005fd0 tx=0x7f81fc005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:42:45.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:45.875+0000 7f8207400700 1 -- 172.21.15.146:0/1650199892 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8200013070 con 0x7f8210103500 2024-05-03T16:42:45.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:45 smithi134 ceph-mon[31708]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:45.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:45 smithi081 ceph-mon[28640]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:46.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:46.118+0000 7f8215c00700 1 -- 172.21.15.146:0/1650199892 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi146=c;smithi146=f;smithi146=i;smithi146=l", "target": ["mon-mgr", ""]}) -- 0x7f821010b6f0 con 0x7f81f40b2900 2024-05-03T16:42:46.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:46.136+0000 7f8207400700 1 -- 172.21.15.146:0/1650199892 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f821010b6f0 con 0x7f81f40b2900 2024-05-03T16:42:46.138 INFO:teuthology.orchestra.run.smithi146.stdout:Scheduled mds.all update... 2024-05-03T16:42:46.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:46.139+0000 7f8215c00700 1 -- 172.21.15.146:0/1650199892 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f81f40b2900 msgr2=0x7f81f40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:46.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:46.139+0000 7f8215c00700 1 --2- 172.21.15.146:0/1650199892 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f81f40b2900 0x7f81f40b4dc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f81fc005fd0 tx=0x7f81fc005ee0 comp rx=0 tx=0).stop 2024-05-03T16:42:46.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:46.139+0000 7f8215c00700 1 -- 172.21.15.146:0/1650199892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8210103500 msgr2=0x7f821019b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:46.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:46.139+0000 7f8215c00700 1 --2- 172.21.15.146:0/1650199892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8210103500 0x7f821019b7b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8200000c00 tx=0x7f82000047b0 comp rx=0 tx=0).stop 2024-05-03T16:42:46.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:46.139+0000 7f8215c00700 1 -- 172.21.15.146:0/1650199892 shutdown_connections 2024-05-03T16:42:46.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:46.139+0000 7f8215c00700 1 --2- 172.21.15.146:0/1650199892 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f81f40b2900 0x7f81f40b4dc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:46.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:46.139+0000 7f8215c00700 1 --2- 172.21.15.146:0/1650199892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8210103500 0x7f821019b7b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:46.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:46.139+0000 7f8215c00700 1 --2- 172.21.15.146:0/1650199892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82101050a0 0x7f82101a2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:46.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:46.139+0000 7f8215c00700 1 --2- 172.21.15.146:0/1650199892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8210104700 0x7f821019bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:46.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:46.139+0000 7f8215c00700 1 -- 172.21.15.146:0/1650199892 >> 172.21.15.146:0/1650199892 conn(0x7f82100feaa0 msgr2=0x7f8210109ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:42:46.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:46.139+0000 7f8215c00700 1 -- 172.21.15.146:0/1650199892 shutdown_connections 2024-05-03T16:42:46.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-05-03T16:42:46.139+0000 7f8215c00700 1 -- 172.21.15.146:0/1650199892 wait complete. 2024-05-03T16:42:47.143 DEBUG:teuthology.orchestra.run.smithi081:mds.a> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.a.service 2024-05-03T16:42:47.151 DEBUG:teuthology.orchestra.run.smithi081:mds.d> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.d.service 2024-05-03T16:42:47.198 DEBUG:teuthology.orchestra.run.smithi081:mds.g> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.g.service 2024-05-03T16:42:47.244 DEBUG:teuthology.orchestra.run.smithi081:mds.j> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.j.service 2024-05-03T16:42:47.289 DEBUG:teuthology.orchestra.run.smithi134:mds.b> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.b.service 2024-05-03T16:42:47.297 DEBUG:teuthology.orchestra.run.smithi134:mds.e> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.e.service 2024-05-03T16:42:47.343 DEBUG:teuthology.orchestra.run.smithi134:mds.h> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.h.service 2024-05-03T16:42:47.390 DEBUG:teuthology.orchestra.run.smithi134:mds.k> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.k.service 2024-05-03T16:42:47.405 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:47 smithi134 ceph-mon[31708]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi146=c;smithi146=f;smithi146=i;smithi146=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:42:47.405 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:47 smithi134 ceph-mon[31708]: Saving service mds.all spec with placement smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi146=c;smithi146=f;smithi146=i;smithi146=l;count:12 2024-05-03T16:42:47.406 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:47 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:47.406 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:47 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:42:47.406 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:47 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:47.406 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:47 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:42:47.406 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:47 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:47.406 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:47 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:42:47.406 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:47 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:42:47.406 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:47 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:47.406 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:47 smithi134 ceph-mon[31708]: Deploying daemon mds.l on smithi146 2024-05-03T16:42:47.406 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:47 smithi134 ceph-mon[31708]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:47.407 DEBUG:teuthology.orchestra.run.smithi146:mds.c> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.c.service 2024-05-03T16:42:47.412 DEBUG:teuthology.orchestra.run.smithi146:mds.f> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.f.service 2024-05-03T16:42:47.452 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:47 smithi146 ceph-mon[32357]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi146=c;smithi146=f;smithi146=i;smithi146=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:42:47.452 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:47 smithi146 ceph-mon[32357]: Saving service mds.all spec with placement smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi146=c;smithi146=f;smithi146=i;smithi146=l;count:12 2024-05-03T16:42:47.452 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:47 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:47.452 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:47 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:42:47.452 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:47 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:47.452 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:47 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:42:47.453 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:47 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:47.453 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:47 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:42:47.453 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:47 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:42:47.453 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:47 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:47.453 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:47 smithi146 ceph-mon[32357]: Deploying daemon mds.l on smithi146 2024-05-03T16:42:47.453 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:47 smithi146 ceph-mon[32357]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:47.455 DEBUG:teuthology.orchestra.run.smithi146:mds.i> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.i.service 2024-05-03T16:42:47.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:47 smithi081 ceph-mon[28640]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi146=c;smithi146=f;smithi146=i;smithi146=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:42:47.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:47 smithi081 ceph-mon[28640]: Saving service mds.all spec with placement smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi146=c;smithi146=f;smithi146=i;smithi146=l;count:12 2024-05-03T16:42:47.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:47.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:42:47.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:47.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:42:47.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:47.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:42:47.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:42:47.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:47.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:47 smithi081 ceph-mon[28640]: Deploying daemon mds.l on smithi146 2024-05-03T16:42:47.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:47 smithi081 ceph-mon[28640]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:47.499 DEBUG:teuthology.orchestra.run.smithi146:mds.l> sudo journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.l.service 2024-05-03T16:42:47.544 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-03T16:42:47.544 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T16:42:48.003 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:42:49.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:49 smithi146 ceph-mon[32357]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:49.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:49 smithi134 ceph-mon[31708]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:49.736 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:49 smithi081 ceph-mon[28640]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:49.941 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 16:42:49 smithi146 systemd[1]: Starting Ceph mds.l for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T16:42:50.256 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 16:42:49 smithi146 podman[62388]: 2024-05-03 16:42:49.844866029 +0000 UTC m=+0.037541137 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T16:42:50.256 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 16:42:49 smithi146 podman[62388]: 2024-05-03 16:42:49.963267874 +0000 UTC m=+0.155943047 container create de57b2e8ac3fdd4eb7b51cb55040c0eae022d6f7bcd274a6a638a713e4c0dbab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0) 2024-05-03T16:42:50.256 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 16:42:50 smithi146 podman[62388]: 2024-05-03 16:42:50.252659786 +0000 UTC m=+0.445334935 container init de57b2e8ac3fdd4eb7b51cb55040c0eae022d6f7bcd274a6a638a713e4c0dbab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-l, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, ceph=True) 2024-05-03T16:42:50.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.267+0000 7f9967e00700 1 -- 172.21.15.81:0/2307751122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9968076190 msgr2=0x7f996810f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:50.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.267+0000 7f9967e00700 1 --2- 172.21.15.81:0/2307751122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9968076190 0x7f996810f730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9950009990 tx=0x7f9950009ca0 comp rx=0 tx=0).stop 2024-05-03T16:42:50.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.267+0000 7f9967e00700 1 -- 172.21.15.81:0/2307751122 shutdown_connections 2024-05-03T16:42:50.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.267+0000 7f9967e00700 1 --2- 172.21.15.81:0/2307751122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9968075870 0x7f9968075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:50.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.267+0000 7f9967e00700 1 --2- 172.21.15.81:0/2307751122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f996810fc70 0x7f9968112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:50.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.267+0000 7f9967e00700 1 --2- 172.21.15.81:0/2307751122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9968076190 0x7f996810f730 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:50.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.267+0000 7f9967e00700 1 -- 172.21.15.81:0/2307751122 >> 172.21.15.81:0/2307751122 conn(0x7f99680fef20 msgr2=0x7f9968101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:42:50.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.267+0000 7f9967e00700 1 -- 172.21.15.81:0/2307751122 shutdown_connections 2024-05-03T16:42:50.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.267+0000 7f9967e00700 1 -- 172.21.15.81:0/2307751122 wait complete. 2024-05-03T16:42:50.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.268+0000 7f9967e00700 1 Processor -- start 2024-05-03T16:42:50.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.269+0000 7f9967e00700 1 -- start start 2024-05-03T16:42:50.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.269+0000 7f9967e00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9968075870 0x7f99681a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:50.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.269+0000 7f9967e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9968076190 0x7f99681a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:50.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.269+0000 7f9967e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f996810fc70 0x7f996819bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:50.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.269+0000 7f9967e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9968115750 con 0x7f9968076190 2024-05-03T16:42:50.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.269+0000 7f9967e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f99681155d0 con 0x7f996810fc70 2024-05-03T16:42:50.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.269+0000 7f9967e00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f99681158d0 con 0x7f9968075870 2024-05-03T16:42:50.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.269+0000 7f995fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9968076190 0x7f99681a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:50.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.269+0000 7f995fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9968076190 0x7f99681a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47276/0 (socket says 172.21.15.81:47276) 2024-05-03T16:42:50.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.269+0000 7f995fe00700 1 -- 172.21.15.81:0/3282871603 learned_addr learned my addr 172.21.15.81:0/3282871603 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:42:50.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.270+0000 7f9966a00700 1 --2- 172.21.15.81:0/3282871603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9968075870 0x7f99681a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:50.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.270+0000 7f9967400700 1 --2- 172.21.15.81:0/3282871603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f996810fc70 0x7f996819bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:50.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.270+0000 7f995fe00700 1 -- 172.21.15.81:0/3282871603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9968075870 msgr2=0x7f99681a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:50.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.270+0000 7f995fe00700 1 --2- 172.21.15.81:0/3282871603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9968075870 0x7f99681a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:50.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.270+0000 7f995fe00700 1 -- 172.21.15.81:0/3282871603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f996810fc70 msgr2=0x7f996819bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:50.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.270+0000 7f995fe00700 1 --2- 172.21.15.81:0/3282871603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f996810fc70 0x7f996819bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:50.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.270+0000 7f995fe00700 1 -- 172.21.15.81:0/3282871603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996819c270 con 0x7f9968076190 2024-05-03T16:42:50.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.270+0000 7f995fe00700 1 --2- 172.21.15.81:0/3282871603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9968076190 0x7f99681a1e40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9950005910 tx=0x7f99500047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:42:50.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.271+0000 7f995f400700 1 -- 172.21.15.81:0/3282871603 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950004830 con 0x7f9968076190 2024-05-03T16:42:50.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.271+0000 7f995f400700 1 -- 172.21.15.81:0/3282871603 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9950005020 con 0x7f9968076190 2024-05-03T16:42:50.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.271+0000 7f9967e00700 1 -- 172.21.15.81:0/3282871603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f996819c500 con 0x7f9968076190 2024-05-03T16:42:50.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.271+0000 7f995f400700 1 -- 172.21.15.81:0/3282871603 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995000f960 con 0x7f9968076190 2024-05-03T16:42:50.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.271+0000 7f9967e00700 1 -- 172.21.15.81:0/3282871603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99681a87d0 con 0x7f9968076190 2024-05-03T16:42:50.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.272+0000 7f9967e00700 1 -- 172.21.15.81:0/3282871603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9968076f20 con 0x7f9968076190 2024-05-03T16:42:50.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.274+0000 7f995f400700 1 -- 172.21.15.81:0/3282871603 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f99500054d0 con 0x7f9968076190 2024-05-03T16:42:50.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.276+0000 7f995f400700 1 --2- 172.21.15.81:0/3282871603 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f994c0b2880 0x7f994c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:50.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.277+0000 7f995f400700 1 -- 172.21.15.81:0/3282871603 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f99500e2c70 con 0x7f9968076190 2024-05-03T16:42:50.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.277+0000 7f9966a00700 1 --2- 172.21.15.81:0/3282871603 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f994c0b2880 0x7f994c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:50.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.278+0000 7f9966a00700 1 --2- 172.21.15.81:0/3282871603 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f994c0b2880 0x7f994c0b4d40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9968102820 tx=0x7f995800b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:42:50.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.281+0000 7f995f400700 1 -- 172.21.15.81:0/3282871603 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f9950013070 con 0x7f9968076190 2024-05-03T16:42:50.563 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 16:42:50 smithi146 podman[62388]: 2024-05-03 16:42:50.263352286 +0000 UTC m=+0.456027482 container start de57b2e8ac3fdd4eb7b51cb55040c0eae022d6f7bcd274a6a638a713e4c0dbab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-l, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-05-03T16:42:50.563 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 16:42:50 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-l[62403]: starting mds.l at 2024-05-03T16:42:50.563 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 16:42:50 smithi146 bash[62388]: de57b2e8ac3fdd4eb7b51cb55040c0eae022d6f7bcd274a6a638a713e4c0dbab 2024-05-03T16:42:50.563 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 16:42:50 smithi146 systemd[1]: Started Ceph mds.l for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:42:50.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.567+0000 7f9967e00700 1 -- 172.21.15.81:0/3282871603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f996819cff0 con 0x7f9968076190 2024-05-03T16:42:50.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.574+0000 7f995f400700 1 -- 172.21.15.81:0/3282871603 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7f99500aae20 con 0x7f9968076190 2024-05-03T16:42:50.576 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:42:50.576 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1900581381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1900581381},{"type":"v1","addr":"172.21.15.146:6833","nonce":1900581381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-03T16:42:50.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.577+0000 7f9967e00700 1 -- 172.21.15.81:0/3282871603 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f994c0b2880 msgr2=0x7f994c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:50.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.577+0000 7f9967e00700 1 --2- 172.21.15.81:0/3282871603 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f994c0b2880 0x7f994c0b4d40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9968102820 tx=0x7f995800b3c0 comp rx=0 tx=0).stop 2024-05-03T16:42:50.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.577+0000 7f9967e00700 1 -- 172.21.15.81:0/3282871603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9968076190 msgr2=0x7f99681a1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:50.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.577+0000 7f9967e00700 1 --2- 172.21.15.81:0/3282871603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9968076190 0x7f99681a1e40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9950005910 tx=0x7f99500047b0 comp rx=0 tx=0).stop 2024-05-03T16:42:50.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.577+0000 7f9967e00700 1 -- 172.21.15.81:0/3282871603 shutdown_connections 2024-05-03T16:42:50.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.577+0000 7f9967e00700 1 --2- 172.21.15.81:0/3282871603 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f994c0b2880 0x7f994c0b4d40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:50.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.577+0000 7f9967e00700 1 --2- 172.21.15.81:0/3282871603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9968075870 0x7f99681a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:50.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.577+0000 7f9967e00700 1 --2- 172.21.15.81:0/3282871603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f996810fc70 0x7f996819bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:50.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.577+0000 7f9967e00700 1 --2- 172.21.15.81:0/3282871603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9968076190 0x7f99681a1e40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:50.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.577+0000 7f9967e00700 1 -- 172.21.15.81:0/3282871603 >> 172.21.15.81:0/3282871603 conn(0x7f99680fef20 msgr2=0x7f99680ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:42:50.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.577+0000 7f9967e00700 1 -- 172.21.15.81:0/3282871603 shutdown_connections 2024-05-03T16:42:50.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:50.577+0000 7f9967e00700 1 -- 172.21.15.81:0/3282871603 wait complete. 2024-05-03T16:42:50.581 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 2 2024-05-03T16:42:51.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:51 smithi134 ceph-mon[31708]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:51.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:51 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.146:6832/1900581381,v1:172.21.15.146:6833/1900581381] up:boot 2024-05-03T16:42:51.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:51 smithi134 ceph-mon[31708]: fsmap 1 up:standby 2024-05-03T16:42:51.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:51 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-03T16:42:51.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:51 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:51.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:51 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:51.640 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:51 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3282871603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:42:51.640 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:51 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:51.640 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:51 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:42:51.640 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:51 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:42:51.640 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:51 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:51.640 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:51 smithi134 ceph-mon[31708]: Deploying daemon mds.k on smithi134 2024-05-03T16:42:51.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:51 smithi081 ceph-mon[28640]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:51.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:51 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.146:6832/1900581381,v1:172.21.15.146:6833/1900581381] up:boot 2024-05-03T16:42:51.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:51 smithi081 ceph-mon[28640]: fsmap 1 up:standby 2024-05-03T16:42:51.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:51 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-03T16:42:51.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:51 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:51.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:51 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:51.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:51 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3282871603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:42:51.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:51 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:51.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:51 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:42:51.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:51 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:42:51.742 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:51 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:51.742 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:51 smithi081 ceph-mon[28640]: Deploying daemon mds.k on smithi134 2024-05-03T16:42:51.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:51 smithi146 ceph-mon[32357]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:51.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:51 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.146:6832/1900581381,v1:172.21.15.146:6833/1900581381] up:boot 2024-05-03T16:42:51.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:51 smithi146 ceph-mon[32357]: fsmap 1 up:standby 2024-05-03T16:42:51.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:51 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-03T16:42:51.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:51 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:51.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:51 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:51.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:51 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3282871603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:42:51.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:51 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:51.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:51 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:42:51.814 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:51 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:42:51.814 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:51 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:51.814 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:51 smithi146 ceph-mon[32357]: Deploying daemon mds.k on smithi134 2024-05-03T16:42:53.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T16:42:53.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:53 smithi146 ceph-mon[32357]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:53.687 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:53 smithi134 ceph-mon[31708]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:53.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:53 smithi081 ceph-mon[28640]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:53.918 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:42:54.272 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 03 16:42:54 smithi134 podman[61279]: 2024-05-03 16:42:54.096035199 +0000 UTC m=+0.152966055 container create c9754eadb06ba2fdc7a6aea30cff9f1f324077264641b6cd8de91d5b11186c94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T16:42:54.718 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 03 16:42:54 smithi134 podman[61279]: 2024-05-03 16:42:54.374661049 +0000 UTC m=+0.431591912 container init c9754eadb06ba2fdc7a6aea30cff9f1f324077264641b6cd8de91d5b11186c94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-k, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-03T16:42:54.718 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 03 16:42:54 smithi134 podman[61279]: 2024-05-03 16:42:54.386073513 +0000 UTC m=+0.443004395 container start c9754eadb06ba2fdc7a6aea30cff9f1f324077264641b6cd8de91d5b11186c94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T16:42:54.718 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 03 16:42:54 smithi134 ceph-mds[61305]: -- 172.21.15.134:0/2117042343 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55627be4fa40 con 0x55627be23000 2024-05-03T16:42:54.718 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 03 16:42:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-k[61299]: starting mds.k at 2024-05-03T16:42:54.718 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 03 16:42:54 smithi134 bash[61279]: c9754eadb06ba2fdc7a6aea30cff9f1f324077264641b6cd8de91d5b11186c94 2024-05-03T16:42:54.718 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 03 16:42:54 smithi134 systemd[1]: Started Ceph mds.k for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:42:55.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:55 smithi081 ceph-mon[28640]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:55.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:55.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:55.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:55.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:42:55.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:42:55.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:55.663 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:55 smithi081 ceph-mon[28640]: Deploying daemon mds.j on smithi081 2024-05-03T16:42:55.663 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:55 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] up:boot 2024-05-03T16:42:55.663 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:55 smithi081 ceph-mon[28640]: fsmap 2 up:standby 2024-05-03T16:42:55.663 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-03T16:42:55.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:55 smithi134 ceph-mon[31708]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:55.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:55.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:55.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:55.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:42:55.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:42:55.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:55.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:55 smithi134 ceph-mon[31708]: Deploying daemon mds.j on smithi081 2024-05-03T16:42:55.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:55 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] up:boot 2024-05-03T16:42:55.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:55 smithi134 ceph-mon[31708]: fsmap 2 up:standby 2024-05-03T16:42:55.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-03T16:42:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:55 smithi146 ceph-mon[32357]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:42:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:42:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:56.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:55 smithi146 ceph-mon[32357]: Deploying daemon mds.j on smithi081 2024-05-03T16:42:56.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:55 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] up:boot 2024-05-03T16:42:56.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:55 smithi146 ceph-mon[32357]: fsmap 2 up:standby 2024-05-03T16:42:56.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-03T16:42:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.397+0000 7f7e1f200700 1 -- 172.21.15.81:0/1233809791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e181033d0 msgr2=0x7f7e18103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.397+0000 7f7e1f200700 1 --2- 172.21.15.81:0/1233809791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e181033d0 0x7f7e18103850 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009990 tx=0x7f7e08009ca0 comp rx=0 tx=0).stop 2024-05-03T16:42:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.398+0000 7f7e1f200700 1 -- 172.21.15.81:0/1233809791 shutdown_connections 2024-05-03T16:42:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.398+0000 7f7e1f200700 1 --2- 172.21.15.81:0/1233809791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e18103d90 0x7f7e181102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.398+0000 7f7e1f200700 1 --2- 172.21.15.81:0/1233809791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e18109460 0x7f7e18109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.398+0000 7f7e1f200700 1 --2- 172.21.15.81:0/1233809791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e181033d0 0x7f7e18103850 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.398+0000 7f7e1f200700 1 -- 172.21.15.81:0/1233809791 >> 172.21.15.81:0/1233809791 conn(0x7f7e180fef20 msgr2=0x7f7e18101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:42:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.398+0000 7f7e1f200700 1 -- 172.21.15.81:0/1233809791 shutdown_connections 2024-05-03T16:42:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.398+0000 7f7e1f200700 1 -- 172.21.15.81:0/1233809791 wait complete. 2024-05-03T16:42:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.399+0000 7f7e1f200700 1 Processor -- start 2024-05-03T16:42:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.399+0000 7f7e1f200700 1 -- start start 2024-05-03T16:42:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.399+0000 7f7e1f200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e181033d0 0x7f7e1819f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.399+0000 7f7e1f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e18103d90 0x7f7e1819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.399+0000 7f7e1f200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e18109460 0x7f7e18199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.399+0000 7f7e1f200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7e18113470 con 0x7f7e18103d90 2024-05-03T16:42:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.399+0000 7f7e1f200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181132f0 con 0x7f7e18109460 2024-05-03T16:42:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.399+0000 7f7e1f200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181135f0 con 0x7f7e181033d0 2024-05-03T16:42:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.400+0000 7f7e1d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e18103d90 0x7f7e1819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.400+0000 7f7e1d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e18103d90 0x7f7e1819fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42102/0 (socket says 172.21.15.81:42102) 2024-05-03T16:42:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.400+0000 7f7e1d400700 1 -- 172.21.15.81:0/739342255 learned_addr learned my addr 172.21.15.81:0/739342255 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:42:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.400+0000 7f7e1de00700 1 --2- 172.21.15.81:0/739342255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e181033d0 0x7f7e1819f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.400+0000 7f7e1e800700 1 --2- 172.21.15.81:0/739342255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e18109460 0x7f7e18199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.400+0000 7f7e1d400700 1 -- 172.21.15.81:0/739342255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e181033d0 msgr2=0x7f7e1819f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.400+0000 7f7e1d400700 1 --2- 172.21.15.81:0/739342255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e181033d0 0x7f7e1819f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.400+0000 7f7e1d400700 1 -- 172.21.15.81:0/739342255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e18109460 msgr2=0x7f7e18199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.400+0000 7f7e1d400700 1 --2- 172.21.15.81:0/739342255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e18109460 0x7f7e18199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.400+0000 7f7e1d400700 1 -- 172.21.15.81:0/739342255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1819a030 con 0x7f7e18103d90 2024-05-03T16:42:56.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.401+0000 7f7e1d400700 1 --2- 172.21.15.81:0/739342255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e18103d90 0x7f7e1819fc10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7e08000c00 tx=0x7f7e080036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:42:56.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.401+0000 7f7e12a00700 1 -- 172.21.15.81:0/739342255 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08027070 con 0x7f7e18103d90 2024-05-03T16:42:56.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.401+0000 7f7e12a00700 1 -- 172.21.15.81:0/739342255 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e0800fc80 con 0x7f7e18103d90 2024-05-03T16:42:56.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.401+0000 7f7e1f200700 1 -- 172.21.15.81:0/739342255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e1819a2c0 con 0x7f7e18103d90 2024-05-03T16:42:56.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.401+0000 7f7e12a00700 1 -- 172.21.15.81:0/739342255 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08022d60 con 0x7f7e18103d90 2024-05-03T16:42:56.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.401+0000 7f7e1f200700 1 -- 172.21.15.81:0/739342255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e180756d0 con 0x7f7e18103d90 2024-05-03T16:42:56.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.403+0000 7f7e1f200700 1 -- 172.21.15.81:0/739342255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e18104b10 con 0x7f7e18103d90 2024-05-03T16:42:56.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.405+0000 7f7e12a00700 1 -- 172.21.15.81:0/739342255 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7e0802a070 con 0x7f7e18103d90 2024-05-03T16:42:56.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.406+0000 7f7e12a00700 1 --2- 172.21.15.81:0/739342255 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f7e000b2880 0x7f7e000b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:42:56.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.407+0000 7f7e12a00700 1 -- 172.21.15.81:0/739342255 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f7e080e2f10 con 0x7f7e18103d90 2024-05-03T16:42:56.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.407+0000 7f7e1de00700 1 --2- 172.21.15.81:0/739342255 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f7e000b2880 0x7f7e000b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:42:56.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.407+0000 7f7e1de00700 1 --2- 172.21.15.81:0/739342255 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f7e000b2880 0x7f7e000b4d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c005fd0 tx=0x7f7e0c005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:42:56.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.408+0000 7f7e12a00700 1 -- 172.21.15.81:0/739342255 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f7e08031080 con 0x7f7e18103d90 2024-05-03T16:42:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.691+0000 7f7e1f200700 1 -- 172.21.15.81:0/739342255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e1819ad80 con 0x7f7e18103d90 2024-05-03T16:42:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.692+0000 7f7e12a00700 1 -- 172.21.15.81:0/739342255 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2221 (secure 0 0 0) 0x7f7e08013070 con 0x7f7e18103d90 2024-05-03T16:42:56.694 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:42:56.695 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1900581381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1900581381},{"type":"v1","addr":"172.21.15.146:6833","nonce":1900581381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34400,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/749392804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":749392804},{"type":"v1","addr":"172.21.15.134:6833","nonce":749392804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-03T16:42:56.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.695+0000 7f7e1f200700 1 -- 172.21.15.81:0/739342255 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f7e000b2880 msgr2=0x7f7e000b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:56.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.695+0000 7f7e1f200700 1 --2- 172.21.15.81:0/739342255 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f7e000b2880 0x7f7e000b4d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c005fd0 tx=0x7f7e0c005db0 comp rx=0 tx=0).stop 2024-05-03T16:42:56.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.695+0000 7f7e1f200700 1 -- 172.21.15.81:0/739342255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e18103d90 msgr2=0x7f7e1819fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:42:56.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.695+0000 7f7e1f200700 1 --2- 172.21.15.81:0/739342255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e18103d90 0x7f7e1819fc10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7e08000c00 tx=0x7f7e080036f0 comp rx=0 tx=0).stop 2024-05-03T16:42:56.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.695+0000 7f7e1f200700 1 -- 172.21.15.81:0/739342255 shutdown_connections 2024-05-03T16:42:56.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.695+0000 7f7e1f200700 1 --2- 172.21.15.81:0/739342255 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f7e000b2880 0x7f7e000b4d40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:56.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.695+0000 7f7e1f200700 1 --2- 172.21.15.81:0/739342255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e181033d0 0x7f7e1819f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:56.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.695+0000 7f7e1f200700 1 --2- 172.21.15.81:0/739342255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e18109460 0x7f7e18199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:56.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.695+0000 7f7e1f200700 1 --2- 172.21.15.81:0/739342255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e18103d90 0x7f7e1819fc10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:42:56.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.695+0000 7f7e1f200700 1 -- 172.21.15.81:0/739342255 >> 172.21.15.81:0/739342255 conn(0x7f7e180fef20 msgr2=0x7f7e180ff770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:42:56.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.696+0000 7f7e1f200700 1 -- 172.21.15.81:0/739342255 shutdown_connections 2024-05-03T16:42:56.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:42:56.696+0000 7f7e1f200700 1 -- 172.21.15.81:0/739342255 wait complete. 2024-05-03T16:42:56.699 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 3 2024-05-03T16:42:57.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:57 smithi134 ceph-mon[31708]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:57.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:57 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/739342255' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:42:57.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:57 smithi081 ceph-mon[28640]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:57.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:57 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/739342255' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:42:58.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:57 smithi146 ceph-mon[32357]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:58.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:57 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/739342255' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:42:58.740 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 03 16:42:58 smithi081 systemd[1]: Starting Ceph mds.j for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T16:42:59.118 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 03 16:42:58 smithi081 podman[66522]: 2024-05-03 16:42:58.744523794 +0000 UTC m=+0.035252350 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T16:42:59.119 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 03 16:42:58 smithi081 podman[66522]: 2024-05-03 16:42:58.846092116 +0000 UTC m=+0.136820702 container create 2f4da5fe397260b3fda03a516311d34a7efb6265000736bfa828d279e6737fb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-j, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T16:42:59.119 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 03 16:42:59 smithi081 podman[66522]: 2024-05-03 16:42:59.116774617 +0000 UTC m=+0.407503210 container init 2f4da5fe397260b3fda03a516311d34a7efb6265000736bfa828d279e6737fb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-j, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0) 2024-05-03T16:42:59.490 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 03 16:42:59 smithi081 podman[66522]: 2024-05-03 16:42:59.127318059 +0000 UTC m=+0.418046618 container start 2f4da5fe397260b3fda03a516311d34a7efb6265000736bfa828d279e6737fb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-03T16:42:59.490 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 03 16:42:59 smithi081 ceph-mds[66541]: -- 172.21.15.81:0/2796960933 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5650de42ba40 con 0x5650de3fec00 2024-05-03T16:42:59.490 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 03 16:42:59 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-j[66537]: starting mds.j at 2024-05-03T16:42:59.491 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 03 16:42:59 smithi081 bash[66522]: 2f4da5fe397260b3fda03a516311d34a7efb6265000736bfa828d279e6737fb1 2024-05-03T16:42:59.491 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 03 16:42:59 smithi081 systemd[1]: Started Ceph mds.j for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:42:59.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:59 smithi134 ceph-mon[31708]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:59.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:59 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:59.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:59 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:59.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:59 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:59.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:59 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:42:59.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:59 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:42:59.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:42:59 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:42:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:59 smithi081 ceph-mon[28640]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:42:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:59 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:59 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:59.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:59 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:42:59.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:59 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:42:59.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:59 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:42:59.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:42:59 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:00.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:59 smithi146 ceph-mon[32357]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:00.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:59 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:00.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:59 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:00.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:59 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:00.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:59 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:00.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:59 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:00.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:42:59 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:00.126 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T16:43:00.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:00 smithi081 ceph-mon[28640]: Deploying daemon mds.d on smithi081 2024-05-03T16:43:00.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:00 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.81:6834/886382058,v1:172.21.15.81:6835/886382058] up:boot 2024-05-03T16:43:00.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:00 smithi081 ceph-mon[28640]: fsmap 3 up:standby 2024-05-03T16:43:00.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:00 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-03T16:43:00.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:00 smithi134 ceph-mon[31708]: Deploying daemon mds.d on smithi081 2024-05-03T16:43:00.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:00 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.81:6834/886382058,v1:172.21.15.81:6835/886382058] up:boot 2024-05-03T16:43:00.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:00 smithi134 ceph-mon[31708]: fsmap 3 up:standby 2024-05-03T16:43:00.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:00 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-03T16:43:01.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:00 smithi146 ceph-mon[32357]: Deploying daemon mds.d on smithi081 2024-05-03T16:43:01.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:00 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.81:6834/886382058,v1:172.21.15.81:6835/886382058] up:boot 2024-05-03T16:43:01.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:00 smithi146 ceph-mon[32357]: fsmap 3 up:standby 2024-05-03T16:43:01.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:00 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-03T16:43:01.668 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:43:01.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:01 smithi134 ceph-mon[31708]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:01.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:01 smithi081 ceph-mon[28640]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:02.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:01 smithi146 ceph-mon[32357]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:03.489 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 03 16:43:03 smithi081 podman[66929]: 2024-05-03 16:43:03.377635517 +0000 UTC m=+0.174474627 container create cbbb5c0207c08ceda76c063015badeaabefc96a64c1497dae2f6bb9aefae7933 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-03T16:43:03.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:03 smithi081 ceph-mon[28640]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:03.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:03 smithi134 ceph-mon[31708]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:04.027 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 03 16:43:03 smithi081 podman[66929]: 2024-05-03 16:43:03.919323669 +0000 UTC m=+0.716162811 container init cbbb5c0207c08ceda76c063015badeaabefc96a64c1497dae2f6bb9aefae7933 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=) 2024-05-03T16:43:04.028 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 03 16:43:03 smithi081 podman[66929]: 2024-05-03 16:43:03.930173315 +0000 UTC m=+0.727012424 container start cbbb5c0207c08ceda76c063015badeaabefc96a64c1497dae2f6bb9aefae7933 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-d, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-03T16:43:04.028 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 03 16:43:03 smithi081 ceph-mds[66970]: -- 172.21.15.81:0/3111922158 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56327728da40 con 0x563277260c00 2024-05-03T16:43:04.028 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 03 16:43:03 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-d[66961]: starting mds.d at 2024-05-03T16:43:04.028 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 03 16:43:04 smithi081 bash[66929]: cbbb5c0207c08ceda76c063015badeaabefc96a64c1497dae2f6bb9aefae7933 2024-05-03T16:43:04.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:03 smithi146 ceph-mon[32357]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:04.295 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 03 16:43:04 smithi081 systemd[1]: Started Ceph mds.d for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:43:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.300+0000 7f3ba5000700 1 -- 172.21.15.81:0/3788565344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba006b180 msgr2=0x7f3ba006b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.300+0000 7f3ba5000700 1 --2- 172.21.15.81:0/3788565344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba006b180 0x7f3ba006b600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009990 tx=0x7f3b8c009ca0 comp rx=0 tx=0).stop 2024-05-03T16:43:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.300+0000 7f3ba5000700 1 -- 172.21.15.81:0/3788565344 shutdown_connections 2024-05-03T16:43:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.300+0000 7f3ba5000700 1 --2- 172.21.15.81:0/3788565344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ba006bb40 0x7f3ba0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.300+0000 7f3ba5000700 1 --2- 172.21.15.81:0/3788565344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ba0109510 0x7f3ba01098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.300+0000 7f3ba5000700 1 --2- 172.21.15.81:0/3788565344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba006b180 0x7f3ba006b600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.300+0000 7f3ba5000700 1 -- 172.21.15.81:0/3788565344 >> 172.21.15.81:0/3788565344 conn(0x7f3ba0079350 msgr2=0x7f3ba0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.300+0000 7f3ba5000700 1 -- 172.21.15.81:0/3788565344 shutdown_connections 2024-05-03T16:43:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.300+0000 7f3ba5000700 1 -- 172.21.15.81:0/3788565344 wait complete. 2024-05-03T16:43:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.301+0000 7f3ba5000700 1 Processor -- start 2024-05-03T16:43:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.302+0000 7f3ba5000700 1 -- start start 2024-05-03T16:43:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.302+0000 7f3ba5000700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ba006b180 0x7f3ba01a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.302+0000 7f3ba5000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ba006bb40 0x7f3ba01a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.302+0000 7f3ba5000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba0109510 0x7f3ba019bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.302+0000 7f3ba5000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba01134d0 con 0x7f3ba0109510 2024-05-03T16:43:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.302+0000 7f3ba5000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba0113350 con 0x7f3ba006bb40 2024-05-03T16:43:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.302+0000 7f3ba5000700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba0113650 con 0x7f3ba006b180 2024-05-03T16:43:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.303+0000 7f3b9e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba0109510 0x7f3ba019bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.303+0000 7f3b9e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba0109510 0x7f3ba019bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42158/0 (socket says 172.21.15.81:42158) 2024-05-03T16:43:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.303+0000 7f3b9e800700 1 -- 172.21.15.81:0/1030927110 learned_addr learned my addr 172.21.15.81:0/1030927110 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:43:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.303+0000 7f3b9d400700 1 --2- 172.21.15.81:0/1030927110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ba006bb40 0x7f3ba01a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.303+0000 7f3b9de00700 1 --2- 172.21.15.81:0/1030927110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ba006b180 0x7f3ba01a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.303+0000 7f3b9e800700 1 -- 172.21.15.81:0/1030927110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ba006b180 msgr2=0x7f3ba01a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.303+0000 7f3b9e800700 1 --2- 172.21.15.81:0/1030927110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ba006b180 0x7f3ba01a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.303+0000 7f3b9e800700 1 -- 172.21.15.81:0/1030927110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ba006bb40 msgr2=0x7f3ba01a1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.303+0000 7f3b9e800700 1 --2- 172.21.15.81:0/1030927110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ba006bb40 0x7f3ba01a1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.303+0000 7f3b9e800700 1 -- 172.21.15.81:0/1030927110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba019c210 con 0x7f3ba0109510 2024-05-03T16:43:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.304+0000 7f3b9e800700 1 --2- 172.21.15.81:0/1030927110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba0109510 0x7f3ba019bab0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3b98007ee0 tx=0x7f3b9800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.304+0000 7f3b96a00700 1 -- 172.21.15.81:0/1030927110 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b98004bb0 con 0x7f3ba0109510 2024-05-03T16:43:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.304+0000 7f3ba5000700 1 -- 172.21.15.81:0/1030927110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba019c500 con 0x7f3ba0109510 2024-05-03T16:43:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.304+0000 7f3b96a00700 1 -- 172.21.15.81:0/1030927110 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b98004d50 con 0x7f3ba0109510 2024-05-03T16:43:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.304+0000 7f3b96a00700 1 -- 172.21.15.81:0/1030927110 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b980058b0 con 0x7f3ba0109510 2024-05-03T16:43:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.304+0000 7f3ba5000700 1 -- 172.21.15.81:0/1030927110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba01a87c0 con 0x7f3ba0109510 2024-05-03T16:43:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.305+0000 7f3ba5000700 1 -- 172.21.15.81:0/1030927110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ba006a190 con 0x7f3ba0109510 2024-05-03T16:43:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.309+0000 7f3b96a00700 1 -- 172.21.15.81:0/1030927110 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f3b9801a020 con 0x7f3ba0109510 2024-05-03T16:43:04.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.310+0000 7f3b96a00700 1 --2- 172.21.15.81:0/1030927110 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3b840b2880 0x7f3b840b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.311+0000 7f3b96a00700 1 -- 172.21.15.81:0/1030927110 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f3b980e1af0 con 0x7f3ba0109510 2024-05-03T16:43:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.311+0000 7f3b9de00700 1 --2- 172.21.15.81:0/1030927110 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3b840b2880 0x7f3b840b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.311+0000 7f3b9de00700 1 --2- 172.21.15.81:0/1030927110 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3b840b2880 0x7f3b840b4d40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3ba019cbf0 tx=0x7f3b900073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:04.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.313+0000 7f3b96a00700 1 -- 172.21.15.81:0/1030927110 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f3b98010070 con 0x7f3ba0109510 2024-05-03T16:43:04.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.592+0000 7f3ba5000700 1 -- 172.21.15.81:0/1030927110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ba01a8990 con 0x7f3ba0109510 2024-05-03T16:43:04.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.593+0000 7f3b96a00700 1 -- 172.21.15.81:0/1030927110 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3043 (secure 0 0 0) 0x7f3b980a9c10 con 0x7f3ba0109510 2024-05-03T16:43:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:43:04.596 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/886382058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":886382058},{"type":"v1","addr":"172.21.15.81:6835","nonce":886382058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1900581381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1900581381},{"type":"v1","addr":"172.21.15.146:6833","nonce":1900581381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34400,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/749392804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":749392804},{"type":"v1","addr":"172.21.15.134:6833","nonce":749392804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-03T16:43:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.597+0000 7f3ba5000700 1 -- 172.21.15.81:0/1030927110 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3b840b2880 msgr2=0x7f3b840b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.597+0000 7f3ba5000700 1 --2- 172.21.15.81:0/1030927110 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3b840b2880 0x7f3b840b4d40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3ba019cbf0 tx=0x7f3b900073d0 comp rx=0 tx=0).stop 2024-05-03T16:43:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.598+0000 7f3ba5000700 1 -- 172.21.15.81:0/1030927110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba0109510 msgr2=0x7f3ba019bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.598+0000 7f3ba5000700 1 --2- 172.21.15.81:0/1030927110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba0109510 0x7f3ba019bab0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3b98007ee0 tx=0x7f3b9800d3b0 comp rx=0 tx=0).stop 2024-05-03T16:43:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.598+0000 7f3ba5000700 1 -- 172.21.15.81:0/1030927110 shutdown_connections 2024-05-03T16:43:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.598+0000 7f3ba5000700 1 --2- 172.21.15.81:0/1030927110 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3b840b2880 0x7f3b840b4d40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.598+0000 7f3ba5000700 1 --2- 172.21.15.81:0/1030927110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ba006b180 0x7f3ba01a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.598+0000 7f3ba5000700 1 --2- 172.21.15.81:0/1030927110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba0109510 0x7f3ba019bab0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.598+0000 7f3ba5000700 1 --2- 172.21.15.81:0/1030927110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ba006bb40 0x7f3ba01a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.598+0000 7f3ba5000700 1 -- 172.21.15.81:0/1030927110 >> 172.21.15.81:0/1030927110 conn(0x7f3ba0079350 msgr2=0x7f3ba010e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.598+0000 7f3ba5000700 1 -- 172.21.15.81:0/1030927110 shutdown_connections 2024-05-03T16:43:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:04.598+0000 7f3ba5000700 1 -- 172.21.15.81:0/1030927110 wait complete. 2024-05-03T16:43:04.601 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 4 2024-05-03T16:43:05.388 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:05.388 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:05.388 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:05.388 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:05.388 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:05.388 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:05.388 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:05 smithi081 ceph-mon[28640]: Deploying daemon mds.e on smithi134 2024-05-03T16:43:05.389 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:05 smithi081 ceph-mon[28640]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:05.389 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:05 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1030927110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:05.389 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:05 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.81:6836/3285208793,v1:172.21.15.81:6837/3285208793] up:boot 2024-05-03T16:43:05.389 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:05 smithi081 ceph-mon[28640]: fsmap 4 up:standby 2024-05-03T16:43:05.389 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-03T16:43:05.402 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:05 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:05.402 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:05 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:05.402 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:05 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:05.402 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:05 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:05.402 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:05 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:05.403 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:05 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:05.403 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:05 smithi134 ceph-mon[31708]: Deploying daemon mds.e on smithi134 2024-05-03T16:43:05.403 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:05 smithi134 ceph-mon[31708]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:05.403 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:05 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/1030927110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:05.403 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:05 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.81:6836/3285208793,v1:172.21.15.81:6837/3285208793] up:boot 2024-05-03T16:43:05.403 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:05 smithi134 ceph-mon[31708]: fsmap 4 up:standby 2024-05-03T16:43:05.403 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:05 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-03T16:43:05.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:05 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:05.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:05 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:05.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:05 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:05.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:05 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:05.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:05 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:05.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:05 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:05.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:05 smithi146 ceph-mon[32357]: Deploying daemon mds.e on smithi134 2024-05-03T16:43:05.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:05 smithi146 ceph-mon[32357]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:05.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:05 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/1030927110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:05.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:05 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.81:6836/3285208793,v1:172.21.15.81:6837/3285208793] up:boot 2024-05-03T16:43:05.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:05 smithi146 ceph-mon[32357]: fsmap 4 up:standby 2024-05-03T16:43:05.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:05 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-03T16:43:07.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T16:43:07.659 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:07 smithi134 ceph-mon[31708]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:07.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:07 smithi081 ceph-mon[28640]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:07.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:07 smithi146 ceph-mon[32357]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:07.881 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:43:07.968 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 03 16:43:07 smithi134 podman[61593]: 2024-05-03 16:43:07.66719608 +0000 UTC m=+0.138060796 container create d3615a15fbb57b1c8b7ddf64d4b4f7d29330fa6095f41df3b710def3a252d363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-e, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-03T16:43:08.469 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 03 16:43:07 smithi134 podman[61593]: 2024-05-03 16:43:07.971941114 +0000 UTC m=+0.442805856 container init d3615a15fbb57b1c8b7ddf64d4b4f7d29330fa6095f41df3b710def3a252d363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-e, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-03T16:43:08.469 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 03 16:43:07 smithi134 podman[61593]: 2024-05-03 16:43:07.983806007 +0000 UTC m=+0.454670713 container start d3615a15fbb57b1c8b7ddf64d4b4f7d29330fa6095f41df3b710def3a252d363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-e, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2) 2024-05-03T16:43:08.469 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 03 16:43:08 smithi134 ceph-mds[61612]: -- 172.21.15.134:0/4057579874 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559a63d0da40 con 0x559a63ce1000 2024-05-03T16:43:08.470 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 03 16:43:08 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-e[61608]: starting mds.e at 2024-05-03T16:43:08.470 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 03 16:43:08 smithi134 bash[61593]: d3615a15fbb57b1c8b7ddf64d4b4f7d29330fa6095f41df3b710def3a252d363 2024-05-03T16:43:08.470 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 03 16:43:08 smithi134 systemd[1]: Started Ceph mds.e for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:43:09.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:09 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:09.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:09 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:09.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:09 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:09.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:09 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:09.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:09 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:09.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:09 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:09.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:09 smithi134 ceph-mon[31708]: Deploying daemon mds.f on smithi146 2024-05-03T16:43:09.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:09 smithi134 ceph-mon[31708]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:09.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:09 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] up:boot 2024-05-03T16:43:09.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:09 smithi134 ceph-mon[31708]: fsmap 5 up:standby 2024-05-03T16:43:09.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:09 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-03T16:43:09.475 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:09 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:09.475 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:09 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:09.475 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:09 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:09.475 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:09 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:09.475 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:09 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:09.475 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:09 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:09.475 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:09 smithi146 ceph-mon[32357]: Deploying daemon mds.f on smithi146 2024-05-03T16:43:09.475 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:09 smithi146 ceph-mon[32357]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:09.475 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:09 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] up:boot 2024-05-03T16:43:09.475 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:09 smithi146 ceph-mon[32357]: fsmap 5 up:standby 2024-05-03T16:43:09.475 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:09 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-03T16:43:09.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:09 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:09.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:09 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:09.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:09 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:09.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:09 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:09.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:09 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:09.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:09 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:09.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:09 smithi081 ceph-mon[28640]: Deploying daemon mds.f on smithi146 2024-05-03T16:43:09.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:09 smithi081 ceph-mon[28640]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:09.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:09 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] up:boot 2024-05-03T16:43:09.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:09 smithi081 ceph-mon[28640]: fsmap 5 up:standby 2024-05-03T16:43:09.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:09 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-03T16:43:10.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.098+0000 7f368d000700 1 -- 172.21.15.81:0/3662730552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368810b6e0 msgr2=0x7f368810bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:10.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.098+0000 7f368d000700 1 --2- 172.21.15.81:0/3662730552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368810b6e0 0x7f368810bac0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3678009990 tx=0x7f3678009ca0 comp rx=0 tx=0).stop 2024-05-03T16:43:10.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.098+0000 7f368d000700 1 -- 172.21.15.81:0/3662730552 shutdown_connections 2024-05-03T16:43:10.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.098+0000 7f368d000700 1 --2- 172.21.15.81:0/3662730552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36881060a0 0x7f36881125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:10.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.098+0000 7f368d000700 1 --2- 172.21.15.81:0/3662730552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368810b6e0 0x7f368810bac0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:10.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.098+0000 7f368d000700 1 --2- 172.21.15.81:0/3662730552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36881056e0 0x7f3688105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:10.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.098+0000 7f368d000700 1 -- 172.21.15.81:0/3662730552 >> 172.21.15.81:0/3662730552 conn(0x7f36881011d0 msgr2=0x7f36881035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:10.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.098+0000 7f368d000700 1 -- 172.21.15.81:0/3662730552 shutdown_connections 2024-05-03T16:43:10.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.098+0000 7f368d000700 1 -- 172.21.15.81:0/3662730552 wait complete. 2024-05-03T16:43:10.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.099+0000 7f368d000700 1 Processor -- start 2024-05-03T16:43:10.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.100+0000 7f368d000700 1 -- start start 2024-05-03T16:43:10.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.100+0000 7f368d000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36881056e0 0x7f36881a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:10.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.100+0000 7f368d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36881060a0 0x7f36881a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:10.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.100+0000 7f368d000700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f368810b6e0 0x7f368819bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:10.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.100+0000 7f368d000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f36881157e0 con 0x7f36881060a0 2024-05-03T16:43:10.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.100+0000 7f368d000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3688115660 con 0x7f36881056e0 2024-05-03T16:43:10.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.100+0000 7f368d000700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3688115960 con 0x7f368810b6e0 2024-05-03T16:43:10.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.100+0000 7f3685400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36881060a0 0x7f36881a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:10.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.100+0000 7f3685400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36881060a0 0x7f36881a1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58766/0 (socket says 172.21.15.81:58766) 2024-05-03T16:43:10.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.100+0000 7f3685400700 1 -- 172.21.15.81:0/3416079427 learned_addr learned my addr 172.21.15.81:0/3416079427 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:43:10.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.101+0000 7f3686800700 1 --2- 172.21.15.81:0/3416079427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f368810b6e0 0x7f368819bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:10.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.101+0000 7f3685e00700 1 --2- 172.21.15.81:0/3416079427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36881056e0 0x7f36881a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:10.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.101+0000 7f3685400700 1 -- 172.21.15.81:0/3416079427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f368810b6e0 msgr2=0x7f368819bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:10.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.101+0000 7f3685400700 1 --2- 172.21.15.81:0/3416079427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f368810b6e0 0x7f368819bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:10.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.101+0000 7f3685400700 1 -- 172.21.15.81:0/3416079427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36881056e0 msgr2=0x7f36881a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:10.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.101+0000 7f3685400700 1 --2- 172.21.15.81:0/3416079427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36881056e0 0x7f36881a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:10.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.101+0000 7f3685400700 1 -- 172.21.15.81:0/3416079427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f368819c240 con 0x7f36881060a0 2024-05-03T16:43:10.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.101+0000 7f3685400700 1 --2- 172.21.15.81:0/3416079427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36881060a0 0x7f36881a1e60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f367400c970 tx=0x7f367400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:10.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.101+0000 7f367ea00700 1 -- 172.21.15.81:0/3416079427 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3674007aa0 con 0x7f36881060a0 2024-05-03T16:43:10.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.101+0000 7f367ea00700 1 -- 172.21.15.81:0/3416079427 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3674004cc0 con 0x7f36881060a0 2024-05-03T16:43:10.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.101+0000 7f368d000700 1 -- 172.21.15.81:0/3416079427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f368819c530 con 0x7f36881060a0 2024-05-03T16:43:10.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.102+0000 7f367ea00700 1 -- 172.21.15.81:0/3416079427 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3674005500 con 0x7f36881060a0 2024-05-03T16:43:10.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.102+0000 7f368d000700 1 -- 172.21.15.81:0/3416079427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36881a87f0 con 0x7f36881060a0 2024-05-03T16:43:10.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.103+0000 7f368d000700 1 -- 172.21.15.81:0/3416079427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f368806a190 con 0x7f36881060a0 2024-05-03T16:43:10.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.108+0000 7f367ea00700 1 -- 172.21.15.81:0/3416079427 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f3674007c40 con 0x7f36881060a0 2024-05-03T16:43:10.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.109+0000 7f367ea00700 1 --2- 172.21.15.81:0/3416079427 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f366c0b2880 0x7f366c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:10.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.110+0000 7f367ea00700 1 -- 172.21.15.81:0/3416079427 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f36740e1f20 con 0x7f36881060a0 2024-05-03T16:43:10.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.110+0000 7f3685e00700 1 --2- 172.21.15.81:0/3416079427 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f366c0b2880 0x7f366c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:10.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.110+0000 7f3685e00700 1 --2- 172.21.15.81:0/3416079427 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f366c0b2880 0x7f366c0b4d40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f367800b5c0 tx=0x7f367801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:10.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.111+0000 7f367ea00700 1 -- 172.21.15.81:0/3416079427 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f36740aa160 con 0x7f36881060a0 2024-05-03T16:43:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.394+0000 7f368d000700 1 -- 172.21.15.81:0/3416079427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f368802e510 con 0x7f36881060a0 2024-05-03T16:43:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.395+0000 7f367ea00700 1 -- 172.21.15.81:0/3416079427 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4696 (secure 0 0 0) 0x7f3674005700 con 0x7f36881060a0 2024-05-03T16:43:10.397 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:43:10.397 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/886382058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":886382058},{"type":"v1","addr":"172.21.15.81:6835","nonce":886382058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3285208793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3285208793},{"type":"v1","addr":"172.21.15.81:6837","nonce":3285208793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1900581381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1900581381},{"type":"v1","addr":"172.21.15.146:6833","nonce":1900581381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34400,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/749392804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":749392804},{"type":"v1","addr":"172.21.15.134:6833","nonce":749392804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34418,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3681203129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3681203129},{"type":"v1","addr":"172.21.15.134:6835","nonce":3681203129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-03T16:43:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.398+0000 7f368d000700 1 -- 172.21.15.81:0/3416079427 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f366c0b2880 msgr2=0x7f366c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.398+0000 7f368d000700 1 --2- 172.21.15.81:0/3416079427 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f366c0b2880 0x7f366c0b4d40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f367800b5c0 tx=0x7f367801a040 comp rx=0 tx=0).stop 2024-05-03T16:43:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.398+0000 7f368d000700 1 -- 172.21.15.81:0/3416079427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36881060a0 msgr2=0x7f36881a1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.398+0000 7f368d000700 1 --2- 172.21.15.81:0/3416079427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36881060a0 0x7f36881a1e60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f367400c970 tx=0x7f367400cd30 comp rx=0 tx=0).stop 2024-05-03T16:43:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.399+0000 7f368d000700 1 -- 172.21.15.81:0/3416079427 shutdown_connections 2024-05-03T16:43:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.399+0000 7f368d000700 1 --2- 172.21.15.81:0/3416079427 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f366c0b2880 0x7f366c0b4d40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.399+0000 7f368d000700 1 --2- 172.21.15.81:0/3416079427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f368810b6e0 0x7f368819bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.399+0000 7f368d000700 1 --2- 172.21.15.81:0/3416079427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36881056e0 0x7f36881a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.399+0000 7f368d000700 1 --2- 172.21.15.81:0/3416079427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36881060a0 0x7f36881a1e60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.399+0000 7f368d000700 1 -- 172.21.15.81:0/3416079427 >> 172.21.15.81:0/3416079427 conn(0x7f36881011d0 msgr2=0x7f3688101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.399+0000 7f368d000700 1 -- 172.21.15.81:0/3416079427 shutdown_connections 2024-05-03T16:43:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:10.399+0000 7f368d000700 1 -- 172.21.15.81:0/3416079427 wait complete. 2024-05-03T16:43:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 6 2024-05-03T16:43:11.377 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:11 smithi146 ceph-mon[32357]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:11.377 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:11 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3416079427' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:11.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:11 smithi081 ceph-mon[28640]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:11.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:11 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3416079427' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:11.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:11 smithi134 ceph-mon[31708]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:11.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:11 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3416079427' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:11.728 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 16:43:11 smithi146 systemd[1]: Starting Ceph mds.f for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T16:43:12.033 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 16:43:11 smithi146 podman[62706]: 2024-05-03 16:43:11.638767393 +0000 UTC m=+0.033772094 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T16:43:12.033 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 16:43:11 smithi146 podman[62706]: 2024-05-03 16:43:11.760841011 +0000 UTC m=+0.155845743 container create b3f71a4c2b5f5d50107fd659d1d0bcf7cb7bb65a8656c7a00cc07092dbdc9aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-03T16:43:12.313 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 16:43:12 smithi146 podman[62706]: 2024-05-03 16:43:12.09347363 +0000 UTC m=+0.488478372 container init b3f71a4c2b5f5d50107fd659d1d0bcf7cb7bb65a8656c7a00cc07092dbdc9aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-f, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True) 2024-05-03T16:43:12.313 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 16:43:12 smithi146 podman[62706]: 2024-05-03 16:43:12.101757957 +0000 UTC m=+0.496762654 container start b3f71a4c2b5f5d50107fd659d1d0bcf7cb7bb65a8656c7a00cc07092dbdc9aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, ceph=True, org.label-schema.vendor=CentOS) 2024-05-03T16:43:12.313 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 16:43:12 smithi146 ceph-mds[62733]: -- 172.21.15.146:0/1990380934 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555bf75dba40 con 0x555bf75ae800 2024-05-03T16:43:12.313 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 16:43:12 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-f[62724]: starting mds.f at 2024-05-03T16:43:12.314 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 16:43:12 smithi146 bash[62706]: b3f71a4c2b5f5d50107fd659d1d0bcf7cb7bb65a8656c7a00cc07092dbdc9aaa 2024-05-03T16:43:12.314 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 16:43:12 smithi146 systemd[1]: Started Ceph mds.f for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:43:13.229 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T16:43:13.663 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:13 smithi146 ceph-mon[32357]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:13.663 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:13 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.146:6834/3514751933,v1:172.21.15.146:6835/3514751933] up:boot 2024-05-03T16:43:13.663 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:13 smithi146 ceph-mon[32357]: fsmap 6 up:standby 2024-05-03T16:43:13.663 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-03T16:43:13.663 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:13.663 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:13.663 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:13.663 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:13.664 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:13.664 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:13.664 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:13 smithi146 ceph-mon[32357]: Deploying daemon mds.c on smithi146 2024-05-03T16:43:13.679 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:43:13.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:13 smithi134 ceph-mon[31708]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:13.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:13 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.146:6834/3514751933,v1:172.21.15.146:6835/3514751933] up:boot 2024-05-03T16:43:13.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:13 smithi134 ceph-mon[31708]: fsmap 6 up:standby 2024-05-03T16:43:13.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-03T16:43:13.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:13.718 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:13.718 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:13.718 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:13.718 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:13.718 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:13.718 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:13 smithi134 ceph-mon[31708]: Deploying daemon mds.c on smithi146 2024-05-03T16:43:13.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:13 smithi081 ceph-mon[28640]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:13.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:13 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.146:6834/3514751933,v1:172.21.15.146:6835/3514751933] up:boot 2024-05-03T16:43:13.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:13 smithi081 ceph-mon[28640]: fsmap 6 up:standby 2024-05-03T16:43:13.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-03T16:43:13.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:13.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:13.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:13.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:13.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:13.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:13.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:13 smithi081 ceph-mon[28640]: Deploying daemon mds.c on smithi146 2024-05-03T16:43:15.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:15 smithi081 ceph-mon[28640]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:15.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:15 smithi146 ceph-mon[32357]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:15.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:15 smithi134 ceph-mon[31708]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:15.930 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 16:43:15 smithi146 systemd[1]: Starting Ceph mds.c for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T16:43:16.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.046+0000 7f9be9600700 1 -- 172.21.15.81:0/966116798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be41056e0 msgr2=0x7f9be4105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:16.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.046+0000 7f9be9600700 1 --2- 172.21.15.81:0/966116798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be41056e0 0x7f9be4105b60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009990 tx=0x7f9bd0009ca0 comp rx=0 tx=0).stop 2024-05-03T16:43:16.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.046+0000 7f9be9600700 1 -- 172.21.15.81:0/966116798 shutdown_connections 2024-05-03T16:43:16.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.046+0000 7f9be9600700 1 --2- 172.21.15.81:0/966116798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9be410b6e0 0x7f9be410bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:16.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.046+0000 7f9be9600700 1 --2- 172.21.15.81:0/966116798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9be41060a0 0x7f9be41125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:16.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.046+0000 7f9be9600700 1 --2- 172.21.15.81:0/966116798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be41056e0 0x7f9be4105b60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:16.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.046+0000 7f9be9600700 1 -- 172.21.15.81:0/966116798 >> 172.21.15.81:0/966116798 conn(0x7f9be41011d0 msgr2=0x7f9be41035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:16.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.046+0000 7f9be9600700 1 -- 172.21.15.81:0/966116798 shutdown_connections 2024-05-03T16:43:16.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.046+0000 7f9be9600700 1 -- 172.21.15.81:0/966116798 wait complete. 2024-05-03T16:43:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.047+0000 7f9be9600700 1 Processor -- start 2024-05-03T16:43:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.047+0000 7f9be9600700 1 -- start start 2024-05-03T16:43:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.048+0000 7f9be9600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9be41056e0 0x7f9be41a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.048+0000 7f9be9600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be41060a0 0x7f9be41a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.048+0000 7f9be9600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9be410b6e0 0x7f9be419bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.048+0000 7f9be9600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9be4115770 con 0x7f9be41060a0 2024-05-03T16:43:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.048+0000 7f9be9600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9be41155f0 con 0x7f9be410b6e0 2024-05-03T16:43:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.048+0000 7f9be9600700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9be41158f0 con 0x7f9be41056e0 2024-05-03T16:43:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.048+0000 7f9be2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be41060a0 0x7f9be41a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.048+0000 7f9be2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be41060a0 0x7f9be41a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37078/0 (socket says 172.21.15.81:37078) 2024-05-03T16:43:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.048+0000 7f9be2000700 1 -- 172.21.15.81:0/207756171 learned_addr learned my addr 172.21.15.81:0/207756171 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:43:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.049+0000 7f9be2a00700 1 --2- 172.21.15.81:0/207756171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9be41056e0 0x7f9be41a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.049+0000 7f9be2000700 1 -- 172.21.15.81:0/207756171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9be41056e0 msgr2=0x7f9be41a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.049+0000 7f9be2000700 1 --2- 172.21.15.81:0/207756171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9be41056e0 0x7f9be41a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.049+0000 7f9be2000700 1 -- 172.21.15.81:0/207756171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9be410b6e0 msgr2=0x7f9be419bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.049+0000 7f9be2000700 1 --2- 172.21.15.81:0/207756171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9be410b6e0 0x7f9be419bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.049+0000 7f9be2000700 1 -- 172.21.15.81:0/207756171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be419c270 con 0x7f9be41060a0 2024-05-03T16:43:16.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.049+0000 7f9be2000700 1 --2- 172.21.15.81:0/207756171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be41060a0 0x7f9be41a1e40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0000c00 tx=0x7f9bd000bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:16.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.049+0000 7f9bdb400700 1 -- 172.21.15.81:0/207756171 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0026070 con 0x7f9be41060a0 2024-05-03T16:43:16.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.049+0000 7f9bdb400700 1 -- 172.21.15.81:0/207756171 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9bd0021410 con 0x7f9be41060a0 2024-05-03T16:43:16.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.049+0000 7f9be9600700 1 -- 172.21.15.81:0/207756171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9be419c500 con 0x7f9be41060a0 2024-05-03T16:43:16.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.049+0000 7f9bdb400700 1 -- 172.21.15.81:0/207756171 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0017650 con 0x7f9be41060a0 2024-05-03T16:43:16.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.050+0000 7f9be9600700 1 -- 172.21.15.81:0/207756171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9be41a87d0 con 0x7f9be41060a0 2024-05-03T16:43:16.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.051+0000 7f9be9600700 1 -- 172.21.15.81:0/207756171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9be406a190 con 0x7f9be41060a0 2024-05-03T16:43:16.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.053+0000 7f9bdb400700 1 -- 172.21.15.81:0/207756171 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9bd0009d10 con 0x7f9be41060a0 2024-05-03T16:43:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.055+0000 7f9bdb400700 1 --2- 172.21.15.81:0/207756171 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f9bc80b2900 0x7f9bc80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.056+0000 7f9bdb400700 1 -- 172.21.15.81:0/207756171 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f9bd00e2ba0 con 0x7f9be41060a0 2024-05-03T16:43:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.056+0000 7f9be2a00700 1 --2- 172.21.15.81:0/207756171 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f9bc80b2900 0x7f9bc80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.056+0000 7f9be2a00700 1 --2- 172.21.15.81:0/207756171 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f9bc80b2900 0x7f9bc80b4dc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9be41032a0 tx=0x7f9bd400b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.059+0000 7f9bdb400700 1 -- 172.21.15.81:0/207756171 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f9bd00e2e20 con 0x7f9be41060a0 2024-05-03T16:43:16.204 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 16:43:15 smithi146 podman[63019]: 2024-05-03 16:43:15.83474435 +0000 UTC m=+0.037989283 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T16:43:16.204 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 16:43:15 smithi146 podman[63019]: 2024-05-03 16:43:15.983399771 +0000 UTC m=+0.186644735 container create 847115f495deaee97ac688cce6ad68deda98f350343cbe774afb68f9d793855c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-c, org.label-schema.build-date=20240430, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-03T16:43:16.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.337+0000 7f9be9600700 1 -- 172.21.15.81:0/207756171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9be402e510 con 0x7f9be41060a0 2024-05-03T16:43:16.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.344+0000 7f9bdb400700 1 -- 172.21.15.81:0/207756171 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5524 (secure 0 0 0) 0x7f9bd0013070 con 0x7f9be41060a0 2024-05-03T16:43:16.345 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:43:16.346 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/886382058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":886382058},{"type":"v1","addr":"172.21.15.81:6835","nonce":886382058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3285208793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3285208793},{"type":"v1","addr":"172.21.15.81:6837","nonce":3285208793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1900581381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1900581381},{"type":"v1","addr":"172.21.15.146:6833","nonce":1900581381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3514751933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3514751933},{"type":"v1","addr":"172.21.15.146:6835","nonce":3514751933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":34400,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/749392804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":749392804},{"type":"v1","addr":"172.21.15.134:6833","nonce":749392804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34418,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3681203129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3681203129},{"type":"v1","addr":"172.21.15.134:6835","nonce":3681203129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-03T16:43:16.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.347+0000 7f9be9600700 1 -- 172.21.15.81:0/207756171 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f9bc80b2900 msgr2=0x7f9bc80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:16.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.347+0000 7f9be9600700 1 --2- 172.21.15.81:0/207756171 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f9bc80b2900 0x7f9bc80b4dc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9be41032a0 tx=0x7f9bd400b5b0 comp rx=0 tx=0).stop 2024-05-03T16:43:16.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.347+0000 7f9be9600700 1 -- 172.21.15.81:0/207756171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be41060a0 msgr2=0x7f9be41a1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:16.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.347+0000 7f9be9600700 1 --2- 172.21.15.81:0/207756171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be41060a0 0x7f9be41a1e40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0000c00 tx=0x7f9bd000bfa0 comp rx=0 tx=0).stop 2024-05-03T16:43:16.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.347+0000 7f9be9600700 1 -- 172.21.15.81:0/207756171 shutdown_connections 2024-05-03T16:43:16.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.347+0000 7f9be9600700 1 --2- 172.21.15.81:0/207756171 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f9bc80b2900 0x7f9bc80b4dc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:16.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.347+0000 7f9be9600700 1 --2- 172.21.15.81:0/207756171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9be41056e0 0x7f9be41a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:16.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.347+0000 7f9be9600700 1 --2- 172.21.15.81:0/207756171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9be410b6e0 0x7f9be419bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:16.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.347+0000 7f9be9600700 1 --2- 172.21.15.81:0/207756171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be41060a0 0x7f9be41a1e40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:16.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.347+0000 7f9be9600700 1 -- 172.21.15.81:0/207756171 >> 172.21.15.81:0/207756171 conn(0x7f9be41011d0 msgr2=0x7f9be41019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:16.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.347+0000 7f9be9600700 1 -- 172.21.15.81:0/207756171 shutdown_connections 2024-05-03T16:43:16.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:16.347+0000 7f9be9600700 1 -- 172.21.15.81:0/207756171 wait complete. 2024-05-03T16:43:16.350 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-05-03T16:43:16.813 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 16:43:16 smithi146 podman[63019]: 2024-05-03 16:43:16.32164034 +0000 UTC m=+0.524885338 container init 847115f495deaee97ac688cce6ad68deda98f350343cbe774afb68f9d793855c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-c, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-03T16:43:16.814 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 16:43:16 smithi146 podman[63019]: 2024-05-03 16:43:16.332546932 +0000 UTC m=+0.535791878 container start 847115f495deaee97ac688cce6ad68deda98f350343cbe774afb68f9d793855c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-c, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-03T16:43:16.814 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 16:43:16 smithi146 ceph-mds[63037]: -- 172.21.15.146:0/177642149 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a63494fa40 con 0x55a634923000 2024-05-03T16:43:16.814 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 16:43:16 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-c[63033]: starting mds.c at 2024-05-03T16:43:16.814 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 16:43:16 smithi146 bash[63019]: 847115f495deaee97ac688cce6ad68deda98f350343cbe774afb68f9d793855c 2024-05-03T16:43:16.814 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 16:43:16 smithi146 systemd[1]: Started Ceph mds.c for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:43:17.657 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:17 smithi134 ceph-mon[31708]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:17.657 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:17 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/207756171' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:17.657 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:17.657 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:17.657 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:17.657 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:17.657 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:17.657 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:17.657 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:17 smithi134 ceph-mon[31708]: Deploying daemon mds.h on smithi134 2024-05-03T16:43:17.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:17 smithi081 ceph-mon[28640]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:17.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:17 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/207756171' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:17.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:17.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:17.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:17.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:17.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:17.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:17.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:17 smithi081 ceph-mon[28640]: Deploying daemon mds.h on smithi134 2024-05-03T16:43:17.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:17 smithi146 ceph-mon[32357]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:17.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:17 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/207756171' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:17.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:17.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:17.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:17.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:17.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:17.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:17.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:17 smithi146 ceph-mon[32357]: Deploying daemon mds.h on smithi134 2024-05-03T16:43:18.699 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:18 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.146:6836/971814714,v1:172.21.15.146:6837/971814714] up:boot 2024-05-03T16:43:18.699 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:18 smithi134 ceph-mon[31708]: fsmap 7 up:standby 2024-05-03T16:43:18.700 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:18 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-03T16:43:18.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:18 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.146:6836/971814714,v1:172.21.15.146:6837/971814714] up:boot 2024-05-03T16:43:18.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:18 smithi081 ceph-mon[28640]: fsmap 7 up:standby 2024-05-03T16:43:18.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:18 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-03T16:43:18.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:18 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.146:6836/971814714,v1:172.21.15.146:6837/971814714] up:boot 2024-05-03T16:43:18.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:18 smithi146 ceph-mon[32357]: fsmap 7 up:standby 2024-05-03T16:43:18.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:18 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-03T16:43:19.176 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T16:43:19.625 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:43:19.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:19 smithi134 ceph-mon[31708]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:19.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:19 smithi081 ceph-mon[28640]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:19.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:19 smithi146 ceph-mon[32357]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:20.086 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 16:43:19 smithi134 systemd[1]: Starting Ceph mds.h for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T16:43:20.395 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 16:43:20 smithi134 podman[61896]: 2024-05-03 16:43:19.98985681 +0000 UTC m=+0.035071724 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T16:43:20.395 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 16:43:20 smithi134 podman[61896]: 2024-05-03 16:43:20.122733245 +0000 UTC m=+0.167948184 container create b7eedcd07fe7418f5e5ef0574409bcf75fc804b1a7d967beb4ffe4c60b7431f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-h, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2) 2024-05-03T16:43:20.395 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 16:43:20 smithi134 podman[61896]: 2024-05-03 16:43:20.392993178 +0000 UTC m=+0.438208124 container init b7eedcd07fe7418f5e5ef0574409bcf75fc804b1a7d967beb4ffe4c60b7431f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS) 2024-05-03T16:43:20.718 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 16:43:20 smithi134 podman[61896]: 2024-05-03 16:43:20.403076606 +0000 UTC m=+0.448291520 container start b7eedcd07fe7418f5e5ef0574409bcf75fc804b1a7d967beb4ffe4c60b7431f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-h, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T16:43:20.718 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 16:43:20 smithi134 ceph-mds[61915]: -- 172.21.15.134:0/2764819634 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dc2b6bba40 con 0x55dc2b68e800 2024-05-03T16:43:20.718 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 16:43:20 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-h[61911]: starting mds.h at 2024-05-03T16:43:20.718 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 16:43:20 smithi134 bash[61896]: b7eedcd07fe7418f5e5ef0574409bcf75fc804b1a7d967beb4ffe4c60b7431f1 2024-05-03T16:43:20.718 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 16:43:20 smithi134 systemd[1]: Started Ceph mds.h for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:43:21.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.816+0000 7f5a1c800700 1 -- 172.21.15.81:0/2637078385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a1410b6e0 msgr2=0x7f5a1410bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:21.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.816+0000 7f5a1c800700 1 --2- 172.21.15.81:0/2637078385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a1410b6e0 0x7f5a1410bac0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009990 tx=0x7f5a08009ca0 comp rx=0 tx=0).stop 2024-05-03T16:43:21.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.816+0000 7f5a1c800700 1 -- 172.21.15.81:0/2637078385 shutdown_connections 2024-05-03T16:43:21.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.816+0000 7f5a1c800700 1 --2- 172.21.15.81:0/2637078385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a141060a0 0x7f5a141125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:21.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.816+0000 7f5a1c800700 1 --2- 172.21.15.81:0/2637078385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a1410b6e0 0x7f5a1410bac0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:21.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.816+0000 7f5a1c800700 1 --2- 172.21.15.81:0/2637078385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a141056e0 0x7f5a14105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:21.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.816+0000 7f5a1c800700 1 -- 172.21.15.81:0/2637078385 >> 172.21.15.81:0/2637078385 conn(0x7f5a141011d0 msgr2=0x7f5a141035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:21.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.817+0000 7f5a1c800700 1 -- 172.21.15.81:0/2637078385 shutdown_connections 2024-05-03T16:43:21.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.817+0000 7f5a1c800700 1 -- 172.21.15.81:0/2637078385 wait complete. 2024-05-03T16:43:21.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.818+0000 7f5a1c800700 1 Processor -- start 2024-05-03T16:43:21.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.818+0000 7f5a1c800700 1 -- start start 2024-05-03T16:43:21.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.819+0000 7f5a1c800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a141056e0 0x7f5a141a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:21.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.819+0000 7f5a1c800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a141060a0 0x7f5a141a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:21.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.819+0000 7f5a1c800700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a1410b6e0 0x7f5a1419ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:21.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.819+0000 7f5a1c800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5a141157e0 con 0x7f5a141056e0 2024-05-03T16:43:21.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.819+0000 7f5a1c800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a14115660 con 0x7f5a141060a0 2024-05-03T16:43:21.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.819+0000 7f5a1c800700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5a14115960 con 0x7f5a1410b6e0 2024-05-03T16:43:21.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.819+0000 7f5a19e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a141056e0 0x7f5a141a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:21.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.819+0000 7f5a19e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a141056e0 0x7f5a141a18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37086/0 (socket says 172.21.15.81:37086) 2024-05-03T16:43:21.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.819+0000 7f5a19e00700 1 -- 172.21.15.81:0/1913874506 learned_addr learned my addr 172.21.15.81:0/1913874506 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:43:21.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.819+0000 7f5a1a800700 1 --2- 172.21.15.81:0/1913874506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a1410b6e0 0x7f5a1419ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:21.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.819+0000 7f5a19400700 1 --2- 172.21.15.81:0/1913874506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a141060a0 0x7f5a141a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:21.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.819+0000 7f5a19e00700 1 -- 172.21.15.81:0/1913874506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a1410b6e0 msgr2=0x7f5a1419ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:21.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.819+0000 7f5a19e00700 1 --2- 172.21.15.81:0/1913874506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a1410b6e0 0x7f5a1419ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:21.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.819+0000 7f5a19e00700 1 -- 172.21.15.81:0/1913874506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a141060a0 msgr2=0x7f5a141a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:21.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.819+0000 7f5a19e00700 1 --2- 172.21.15.81:0/1913874506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a141060a0 0x7f5a141a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:21.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.819+0000 7f5a19e00700 1 -- 172.21.15.81:0/1913874506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1419c1e0 con 0x7f5a141056e0 2024-05-03T16:43:21.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.819+0000 7f5a1a800700 1 --2- 172.21.15.81:0/1913874506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a1410b6e0 0x7f5a1419ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:43:21.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.820+0000 7f5a19e00700 1 --2- 172.21.15.81:0/1913874506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a141056e0 0x7f5a141a18c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800b650 tx=0x7f5a0800bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.820+0000 7f5a0ea00700 1 -- 172.21.15.81:0/1913874506 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a08027070 con 0x7f5a141056e0 2024-05-03T16:43:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.820+0000 7f5a0ea00700 1 -- 172.21.15.81:0/1913874506 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a08022470 con 0x7f5a141056e0 2024-05-03T16:43:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.820+0000 7f5a0ea00700 1 -- 172.21.15.81:0/1913874506 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a08017650 con 0x7f5a141056e0 2024-05-03T16:43:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.820+0000 7f5a1c800700 1 -- 172.21.15.81:0/1913874506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a1419c470 con 0x7f5a141056e0 2024-05-03T16:43:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.820+0000 7f5a1c800700 1 -- 172.21.15.81:0/1913874506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a141a8790 con 0x7f5a141056e0 2024-05-03T16:43:21.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.821+0000 7f5a1c800700 1 -- 172.21.15.81:0/1913874506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a1406a190 con 0x7f5a141056e0 2024-05-03T16:43:21.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.824+0000 7f5a0ea00700 1 -- 172.21.15.81:0/1913874506 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f5a08009d10 con 0x7f5a141056e0 2024-05-03T16:43:21.825 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:21 smithi081 ceph-mon[28640]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:21.825 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:21.825 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:21.825 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:21.825 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:21.826 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:21.826 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:21.826 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:21 smithi081 ceph-mon[28640]: Deploying daemon mds.i on smithi146 2024-05-03T16:43:21.826 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:21 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] up:boot 2024-05-03T16:43:21.826 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:21 smithi081 ceph-mon[28640]: fsmap 8 up:standby 2024-05-03T16:43:21.826 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-03T16:43:21.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.825+0000 7f5a0ea00700 1 --2- 172.21.15.81:0/1913874506 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f59fc0b2900 0x7f59fc0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:21.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.825+0000 7f5a0ea00700 1 -- 172.21.15.81:0/1913874506 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f5a080e2d60 con 0x7f5a141056e0 2024-05-03T16:43:21.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.825+0000 7f5a19400700 1 --2- 172.21.15.81:0/1913874506 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f59fc0b2900 0x7f59fc0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:21.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.826+0000 7f5a19400700 1 --2- 172.21.15.81:0/1913874506 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f59fc0b2900 0x7f59fc0b4dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5a04005ea0 tx=0x7f5a04005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:21.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:21.828+0000 7f5a0ea00700 1 -- 172.21.15.81:0/1913874506 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f5a08013070 con 0x7f5a141056e0 2024-05-03T16:43:21.851 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:21 smithi146 ceph-mon[32357]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:21.851 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:21.851 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:21.851 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:21.852 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:21.852 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:21.852 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:21.852 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:21 smithi146 ceph-mon[32357]: Deploying daemon mds.i on smithi146 2024-05-03T16:43:21.852 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:21 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] up:boot 2024-05-03T16:43:21.852 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:21 smithi146 ceph-mon[32357]: fsmap 8 up:standby 2024-05-03T16:43:21.852 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-03T16:43:21.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:21 smithi134 ceph-mon[31708]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:21.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:21.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:21.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:21.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:21.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:21.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:21.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:21 smithi134 ceph-mon[31708]: Deploying daemon mds.i on smithi146 2024-05-03T16:43:21.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:21 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] up:boot 2024-05-03T16:43:21.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:21 smithi134 ceph-mon[31708]: fsmap 8 up:standby 2024-05-03T16:43:21.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-03T16:43:22.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:22.109+0000 7f5a1c800700 1 -- 172.21.15.81:0/1913874506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a1402e510 con 0x7f5a141056e0 2024-05-03T16:43:22.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:22.110+0000 7f5a0ea00700 1 -- 172.21.15.81:0/1913874506 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7177 (secure 0 0 0) 0x7f5a080aaf10 con 0x7f5a141056e0 2024-05-03T16:43:22.112 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:43:22.112 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/886382058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":886382058},{"type":"v1","addr":"172.21.15.81:6835","nonce":886382058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3285208793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3285208793},{"type":"v1","addr":"172.21.15.81:6837","nonce":3285208793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1900581381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1900581381},{"type":"v1","addr":"172.21.15.146:6833","nonce":1900581381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3514751933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3514751933},{"type":"v1","addr":"172.21.15.146:6835","nonce":3514751933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/971814714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":971814714},{"type":"v1","addr":"172.21.15.146:6837","nonce":971814714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34400,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/749392804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":749392804},{"type":"v1","addr":"172.21.15.134:6833","nonce":749392804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34418,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3681203129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3681203129},{"type":"v1","addr":"172.21.15.134:6835","nonce":3681203129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34439,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2915415754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2915415754},{"type":"v1","addr":"172.21.15.134:6837","nonce":2915415754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-03T16:43:22.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:22.113+0000 7f5a1c800700 1 -- 172.21.15.81:0/1913874506 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f59fc0b2900 msgr2=0x7f59fc0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:22.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:22.113+0000 7f5a1c800700 1 --2- 172.21.15.81:0/1913874506 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f59fc0b2900 0x7f59fc0b4dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5a04005ea0 tx=0x7f5a04005e30 comp rx=0 tx=0).stop 2024-05-03T16:43:22.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:22.113+0000 7f5a1c800700 1 -- 172.21.15.81:0/1913874506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a141056e0 msgr2=0x7f5a141a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:22.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:22.113+0000 7f5a1c800700 1 --2- 172.21.15.81:0/1913874506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a141056e0 0x7f5a141a18c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800b650 tx=0x7f5a0800bfc0 comp rx=0 tx=0).stop 2024-05-03T16:43:22.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:22.113+0000 7f5a1c800700 1 -- 172.21.15.81:0/1913874506 shutdown_connections 2024-05-03T16:43:22.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:22.113+0000 7f5a1c800700 1 --2- 172.21.15.81:0/1913874506 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f59fc0b2900 0x7f59fc0b4dc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:22.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:22.113+0000 7f5a1c800700 1 --2- 172.21.15.81:0/1913874506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a1410b6e0 0x7f5a1419ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:22.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:22.113+0000 7f5a1c800700 1 --2- 172.21.15.81:0/1913874506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a141056e0 0x7f5a141a18c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:22.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:22.113+0000 7f5a1c800700 1 --2- 172.21.15.81:0/1913874506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a141060a0 0x7f5a141a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:22.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:22.113+0000 7f5a1c800700 1 -- 172.21.15.81:0/1913874506 >> 172.21.15.81:0/1913874506 conn(0x7f5a141011d0 msgr2=0x7f5a14101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:22.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:22.114+0000 7f5a1c800700 1 -- 172.21.15.81:0/1913874506 shutdown_connections 2024-05-03T16:43:22.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:22.114+0000 7f5a1c800700 1 -- 172.21.15.81:0/1913874506 wait complete. 2024-05-03T16:43:22.116 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-05-03T16:43:22.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:22 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/1913874506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:22.925 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:22 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1913874506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:22.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:22 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/1913874506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:23.786 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:23 smithi146 ceph-mon[32357]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:23.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:23 smithi134 ceph-mon[31708]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:23.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:23 smithi081 ceph-mon[28640]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:24.063 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 16:43:23 smithi146 systemd[1]: Starting Ceph mds.i for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T16:43:24.495 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 16:43:24 smithi146 podman[63322]: 2024-05-03 16:43:24.05677805 +0000 UTC m=+0.037299692 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T16:43:24.496 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 16:43:24 smithi146 podman[63322]: 2024-05-03 16:43:24.221487154 +0000 UTC m=+0.202008859 container create d32a27fdb6570463e206e1d1a55012844d92ead0bd8d6cdcea762d1fc2236ddc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-i, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T16:43:24.496 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 16:43:24 smithi146 podman[63322]: 2024-05-03 16:43:24.492749275 +0000 UTC m=+0.473270957 container init d32a27fdb6570463e206e1d1a55012844d92ead0bd8d6cdcea762d1fc2236ddc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-i, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-03T16:43:24.813 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 16:43:24 smithi146 podman[63322]: 2024-05-03 16:43:24.503525557 +0000 UTC m=+0.484047262 container start d32a27fdb6570463e206e1d1a55012844d92ead0bd8d6cdcea762d1fc2236ddc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-i, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T16:43:24.813 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 16:43:24 smithi146 ceph-mds[63340]: -- 172.21.15.146:0/3821213750 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55adc1933a40 con 0x55adc1906c00 2024-05-03T16:43:24.813 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 16:43:24 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-i[63336]: starting mds.i at 2024-05-03T16:43:24.813 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 16:43:24 smithi146 bash[63322]: d32a27fdb6570463e206e1d1a55012844d92ead0bd8d6cdcea762d1fc2236ddc 2024-05-03T16:43:24.813 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 16:43:24 smithi146 systemd[1]: Started Ceph mds.i for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:43:24.990 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T16:43:25.416 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:43:25.896 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:25 smithi081 ceph-mon[28640]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:25.896 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:25 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] up:boot 2024-05-03T16:43:25.896 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:25 smithi081 ceph-mon[28640]: fsmap 9 up:standby 2024-05-03T16:43:25.896 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:25 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-03T16:43:25.896 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:25 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:25.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:25 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:25.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:25 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:25.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:25 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:25.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:25 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:25.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:25 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:25.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:25 smithi081 ceph-mon[28640]: Deploying daemon mds.g on smithi081 2024-05-03T16:43:25.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:25 smithi134 ceph-mon[31708]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:25.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:25 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] up:boot 2024-05-03T16:43:25.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:25 smithi134 ceph-mon[31708]: fsmap 9 up:standby 2024-05-03T16:43:25.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:25 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-03T16:43:25.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:25 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:25.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:25 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:25.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:25 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:25.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:25 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:25.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:25 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:25.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:25 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:25.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:25 smithi134 ceph-mon[31708]: Deploying daemon mds.g on smithi081 2024-05-03T16:43:26.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:25 smithi146 ceph-mon[32357]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:26.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:25 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] up:boot 2024-05-03T16:43:26.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:25 smithi146 ceph-mon[32357]: fsmap 9 up:standby 2024-05-03T16:43:26.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:25 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-03T16:43:26.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:25 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:26.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:25 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:26.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:25 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:26.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:25 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:26.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:25 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:26.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:25 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:26.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:25 smithi146 ceph-mon[32357]: Deploying daemon mds.g on smithi081 2024-05-03T16:43:27.682 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:27 smithi081 ceph-mon[28640]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.751+0000 7f936fc00700 1 -- 172.21.15.81:0/3499949530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368108850 msgr2=0x7f93681103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.751+0000 7f936fc00700 1 --2- 172.21.15.81:0/3499949530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368108850 0x7f93681103d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f936000b0d0 tx=0x7f936000b3e0 comp rx=0 tx=0).stop 2024-05-03T16:43:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.751+0000 7f936fc00700 1 -- 172.21.15.81:0/3499949530 shutdown_connections 2024-05-03T16:43:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.751+0000 7f936fc00700 1 --2- 172.21.15.81:0/3499949530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368108850 0x7f93681103d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.751+0000 7f936fc00700 1 --2- 172.21.15.81:0/3499949530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9368103750 0x7f9368103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.751+0000 7f936fc00700 1 --2- 172.21.15.81:0/3499949530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9368104100 0x7f9368108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.751+0000 7f936fc00700 1 -- 172.21.15.81:0/3499949530 >> 172.21.15.81:0/3499949530 conn(0x7f936807a600 msgr2=0x7f936807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.751+0000 7f936fc00700 1 -- 172.21.15.81:0/3499949530 shutdown_connections 2024-05-03T16:43:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.751+0000 7f936fc00700 1 -- 172.21.15.81:0/3499949530 wait complete. 2024-05-03T16:43:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.752+0000 7f936fc00700 1 Processor -- start 2024-05-03T16:43:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.752+0000 7f936fc00700 1 -- start start 2024-05-03T16:43:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.753+0000 7f936fc00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9368103750 0x7f936819f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.753+0000 7f936fc00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9368104100 0x7f936819fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.753+0000 7f936fc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368108850 0x7f93681996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.753+0000 7f936fc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9368113520 con 0x7f9368108850 2024-05-03T16:43:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.753+0000 7f936fc00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f93681133a0 con 0x7f9368104100 2024-05-03T16:43:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.753+0000 7f936fc00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f93681136a0 con 0x7f9368103750 2024-05-03T16:43:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.753+0000 7f936dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368108850 0x7f93681996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.753+0000 7f936dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368108850 0x7f93681996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46254/0 (socket says 172.21.15.81:46254) 2024-05-03T16:43:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.753+0000 7f936dc00700 1 -- 172.21.15.81:0/3658304123 learned_addr learned my addr 172.21.15.81:0/3658304123 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:43:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.753+0000 7f936d200700 1 --2- 172.21.15.81:0/3658304123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9368103750 0x7f936819f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.753+0000 7f9367e00700 1 --2- 172.21.15.81:0/3658304123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9368104100 0x7f936819fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.754+0000 7f936dc00700 1 -- 172.21.15.81:0/3658304123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9368103750 msgr2=0x7f936819f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.754+0000 7f936dc00700 1 --2- 172.21.15.81:0/3658304123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9368103750 0x7f936819f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.754+0000 7f936dc00700 1 -- 172.21.15.81:0/3658304123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9368104100 msgr2=0x7f936819fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.754+0000 7f936dc00700 1 --2- 172.21.15.81:0/3658304123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9368104100 0x7f936819fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.754+0000 7f936dc00700 1 -- 172.21.15.81:0/3658304123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9368199fc0 con 0x7f9368108850 2024-05-03T16:43:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.754+0000 7f936dc00700 1 --2- 172.21.15.81:0/3658304123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368108850 0x7f93681996e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9360007d10 tx=0x7f9360007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:27.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.754+0000 7f9365600700 1 -- 172.21.15.81:0/3658304123 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936001f020 con 0x7f9368108850 2024-05-03T16:43:27.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.754+0000 7f9365600700 1 -- 172.21.15.81:0/3658304123 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9360003e10 con 0x7f9368108850 2024-05-03T16:43:27.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.754+0000 7f9365600700 1 -- 172.21.15.81:0/3658304123 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936001bab0 con 0x7f9368108850 2024-05-03T16:43:27.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.754+0000 7f936fc00700 1 -- 172.21.15.81:0/3658304123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f936819a250 con 0x7f9368108850 2024-05-03T16:43:27.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.755+0000 7f936fc00700 1 -- 172.21.15.81:0/3658304123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93681a6590 con 0x7f9368108850 2024-05-03T16:43:27.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.756+0000 7f936fc00700 1 -- 172.21.15.81:0/3658304123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f936819a5c0 con 0x7f9368108850 2024-05-03T16:43:27.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.758+0000 7f9365600700 1 -- 172.21.15.81:0/3658304123 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9360022020 con 0x7f9368108850 2024-05-03T16:43:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.760+0000 7f9365600700 1 --2- 172.21.15.81:0/3658304123 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f93500b2880 0x7f93500b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:27.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.760+0000 7f9365600700 1 -- 172.21.15.81:0/3658304123 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f936000f020 con 0x7f9368108850 2024-05-03T16:43:27.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.760+0000 7f936d200700 1 --2- 172.21.15.81:0/3658304123 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f93500b2880 0x7f93500b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:27.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.760+0000 7f936d200700 1 --2- 172.21.15.81:0/3658304123 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f93500b2880 0x7f93500b4d40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f935c005ea0 tx=0x7f935c005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:27.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:27.762+0000 7f9365600700 1 -- 172.21.15.81:0/3658304123 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f936819a5c0 con 0x7f9368108850 2024-05-03T16:43:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:27 smithi134 ceph-mon[31708]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:28.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:28.043+0000 7f936fc00700 1 -- 172.21.15.81:0/3658304123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f936819ac10 con 0x7f9368108850 2024-05-03T16:43:28.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:28.044+0000 7f9365600700 1 -- 172.21.15.81:0/3658304123 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8007 (secure 0 0 0) 0x7f93600abcf0 con 0x7f9368108850 2024-05-03T16:43:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:43:28.047 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/886382058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":886382058},{"type":"v1","addr":"172.21.15.81:6835","nonce":886382058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3285208793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3285208793},{"type":"v1","addr":"172.21.15.81:6837","nonce":3285208793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1900581381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1900581381},{"type":"v1","addr":"172.21.15.146:6833","nonce":1900581381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3514751933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3514751933},{"type":"v1","addr":"172.21.15.146:6835","nonce":3514751933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/971814714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":971814714},{"type":"v1","addr":"172.21.15.146:6837","nonce":971814714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24481,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6839/3770312555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":3770312555},{"type":"v1","addr":"172.21.15.146:6839","nonce":3770312555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34400,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/749392804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":749392804},{"type":"v1","addr":"172.21.15.134:6833","nonce":749392804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34418,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3681203129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3681203129},{"type":"v1","addr":"172.21.15.134:6835","nonce":3681203129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34439,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2915415754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2915415754},{"type":"v1","addr":"172.21.15.134:6837","nonce":2915415754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-03T16:43:28.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:28.047+0000 7f936fc00700 1 -- 172.21.15.81:0/3658304123 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f93500b2880 msgr2=0x7f93500b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:28.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:28.047+0000 7f936fc00700 1 --2- 172.21.15.81:0/3658304123 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f93500b2880 0x7f93500b4d40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f935c005ea0 tx=0x7f935c005e30 comp rx=0 tx=0).stop 2024-05-03T16:43:28.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:28.047+0000 7f936fc00700 1 -- 172.21.15.81:0/3658304123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368108850 msgr2=0x7f93681996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:28.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:28.047+0000 7f936fc00700 1 --2- 172.21.15.81:0/3658304123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368108850 0x7f93681996e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9360007d10 tx=0x7f9360007df0 comp rx=0 tx=0).stop 2024-05-03T16:43:28.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:28.047+0000 7f936fc00700 1 -- 172.21.15.81:0/3658304123 shutdown_connections 2024-05-03T16:43:28.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:28.047+0000 7f936fc00700 1 --2- 172.21.15.81:0/3658304123 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f93500b2880 0x7f93500b4d40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:28.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:28.047+0000 7f936fc00700 1 --2- 172.21.15.81:0/3658304123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9368103750 0x7f936819f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:28.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:28.047+0000 7f936fc00700 1 --2- 172.21.15.81:0/3658304123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368108850 0x7f93681996e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:28.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:28.047+0000 7f936fc00700 1 --2- 172.21.15.81:0/3658304123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9368104100 0x7f936819fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:28.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:28.047+0000 7f936fc00700 1 -- 172.21.15.81:0/3658304123 >> 172.21.15.81:0/3658304123 conn(0x7f936807a600 msgr2=0x7f9368101500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:28.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:28.047+0000 7f936fc00700 1 -- 172.21.15.81:0/3658304123 shutdown_connections 2024-05-03T16:43:28.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:28.048+0000 7f936fc00700 1 -- 172.21.15.81:0/3658304123 wait complete. 2024-05-03T16:43:28.051 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 10 2024-05-03T16:43:28.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:27 smithi146 ceph-mon[32357]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:28.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:28 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3658304123' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:28.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:28 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3658304123' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:29.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:28 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3658304123' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:29.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:29 smithi081 ceph-mon[28640]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:29.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:29 smithi134 ceph-mon[31708]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:30.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:29 smithi146 ceph-mon[32357]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:30.241 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 03 16:43:29 smithi081 podman[67924]: 2024-05-03 16:43:29.996529781 +0000 UTC m=+0.162729071 container create 3bdb1f3b5babb64386034d0233f8de7dbc0f46f20e46305e2a2c884998b24bc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-03T16:43:30.740 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 03 16:43:30 smithi081 podman[67924]: 2024-05-03 16:43:30.301751765 +0000 UTC m=+0.467951039 container init 3bdb1f3b5babb64386034d0233f8de7dbc0f46f20e46305e2a2c884998b24bc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T16:43:30.741 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 03 16:43:30 smithi081 podman[67924]: 2024-05-03 16:43:30.314011581 +0000 UTC m=+0.480210851 container start 3bdb1f3b5babb64386034d0233f8de7dbc0f46f20e46305e2a2c884998b24bc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-g, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS) 2024-05-03T16:43:30.741 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 03 16:43:30 smithi081 ceph-mds[67943]: -- 172.21.15.81:0/1776676464 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f678ffda40 con 0x55f678fd0800 2024-05-03T16:43:30.741 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 03 16:43:30 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-g[67939]: starting mds.g at 2024-05-03T16:43:30.741 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 03 16:43:30 smithi081 bash[67924]: 3bdb1f3b5babb64386034d0233f8de7dbc0f46f20e46305e2a2c884998b24bc3 2024-05-03T16:43:30.741 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 03 16:43:30 smithi081 systemd[1]: Started Ceph mds.g for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:43:31.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T16:43:31.799 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:31 smithi081 ceph-mon[28640]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:31.800 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:31.800 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:31.800 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:31.800 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:31.800 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:31.800 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:31.800 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:31 smithi081 ceph-mon[28640]: Deploying daemon mds.a on smithi081 2024-05-03T16:43:31.800 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:31 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.81:6838/3710454674,v1:172.21.15.81:6839/3710454674] up:boot 2024-05-03T16:43:31.800 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:31 smithi081 ceph-mon[28640]: fsmap 10 up:standby 2024-05-03T16:43:31.800 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-03T16:43:31.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:31 smithi146 ceph-mon[32357]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:31.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:31.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:31.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:31.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:31.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:31.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:31.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:31 smithi146 ceph-mon[32357]: Deploying daemon mds.a on smithi081 2024-05-03T16:43:31.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:31 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.81:6838/3710454674,v1:172.21.15.81:6839/3710454674] up:boot 2024-05-03T16:43:31.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:31 smithi146 ceph-mon[32357]: fsmap 10 up:standby 2024-05-03T16:43:31.814 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-03T16:43:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:31 smithi134 ceph-mon[31708]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:31.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:31 smithi134 ceph-mon[31708]: Deploying daemon mds.a on smithi081 2024-05-03T16:43:31.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:31 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.81:6838/3710454674,v1:172.21.15.81:6839/3710454674] up:boot 2024-05-03T16:43:31.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:31 smithi134 ceph-mon[31708]: fsmap 10 up:standby 2024-05-03T16:43:31.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-03T16:43:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:43:33.633 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:33 smithi081 ceph-mon[28640]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:33.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:33 smithi146 ceph-mon[32357]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:33.947 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 16:43:33 smithi081 systemd[1]: Starting Ceph mds.a for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T16:43:33.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:33 smithi134 ceph-mon[31708]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:34.792 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 16:43:34 smithi081 podman[68329]: 2024-05-03 16:43:34.403159168 +0000 UTC m=+0.034568636 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T16:43:34.792 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 16:43:34 smithi081 podman[68329]: 2024-05-03 16:43:34.569674892 +0000 UTC m=+0.201084400 container create ddddc0371d22bc94b001c3e3ee7c5abb4d075135f3055d579a198e068c6ed8e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-03T16:43:35.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.303+0000 7f3dff200700 1 -- 172.21.15.81:0/3403248553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3df810a3a0 msgr2=0x7f3df8116840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:35.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.303+0000 7f3dff200700 1 --2- 172.21.15.81:0/3403248553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3df810a3a0 0x7f3df8116840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3df400b0a0 tx=0x7f3df400b3b0 comp rx=0 tx=0).stop 2024-05-03T16:43:35.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.303+0000 7f3dff200700 1 -- 172.21.15.81:0/3403248553 shutdown_connections 2024-05-03T16:43:35.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.303+0000 7f3dff200700 1 --2- 172.21.15.81:0/3403248553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3df810a3a0 0x7f3df8116840 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:35.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.303+0000 7f3dff200700 1 --2- 172.21.15.81:0/3403248553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df810e8b0 0x7f3df810ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:35.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.303+0000 7f3dff200700 1 --2- 172.21.15.81:0/3403248553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df81099e0 0x7f3df8109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:35.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.303+0000 7f3dff200700 1 -- 172.21.15.81:0/3403248553 >> 172.21.15.81:0/3403248553 conn(0x7f3df8079230 msgr2=0x7f3df81082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:35.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.303+0000 7f3dff200700 1 -- 172.21.15.81:0/3403248553 shutdown_connections 2024-05-03T16:43:35.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.303+0000 7f3dff200700 1 -- 172.21.15.81:0/3403248553 wait complete. 2024-05-03T16:43:35.308 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 16:43:35 smithi081 podman[68329]: 2024-05-03 16:43:35.051662433 +0000 UTC m=+0.683071925 container init ddddc0371d22bc94b001c3e3ee7c5abb4d075135f3055d579a198e068c6ed8e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240430) 2024-05-03T16:43:35.308 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 16:43:35 smithi081 podman[68329]: 2024-05-03 16:43:35.062136068 +0000 UTC m=+0.693545535 container start ddddc0371d22bc94b001c3e3ee7c5abb4d075135f3055d579a198e068c6ed8e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-a, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-03T16:43:35.308 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 16:43:35 smithi081 ceph-mds[68370]: -- 172.21.15.81:0/1921527556 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a0efe05a40 con 0x55a0efdd8800 2024-05-03T16:43:35.309 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 16:43:35 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-a[68361]: starting mds.a at 2024-05-03T16:43:35.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.304+0000 7f3dff200700 1 Processor -- start 2024-05-03T16:43:35.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.304+0000 7f3dff200700 1 -- start start 2024-05-03T16:43:35.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.305+0000 7f3dff200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df81099e0 0x7f3df819ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:35.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.305+0000 7f3dff200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3df810a3a0 0x7f3df81a0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:35.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.305+0000 7f3dff200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df810e8b0 0x7f3df81a48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:35.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.305+0000 7f3dff200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3df8119b10 con 0x7f3df810a3a0 2024-05-03T16:43:35.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.305+0000 7f3dff200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3df8119990 con 0x7f3df810e8b0 2024-05-03T16:43:35.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.305+0000 7f3dff200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3df8119c90 con 0x7f3df81099e0 2024-05-03T16:43:35.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.305+0000 7f3dfd400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3df810a3a0 0x7f3df81a0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:35.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.305+0000 7f3dfd400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3df810a3a0 0x7f3df81a0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46294/0 (socket says 172.21.15.81:46294) 2024-05-03T16:43:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.305+0000 7f3dfd400700 1 -- 172.21.15.81:0/2432088909 learned_addr learned my addr 172.21.15.81:0/2432088909 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:43:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.305+0000 7f3dfde00700 1 --2- 172.21.15.81:0/2432088909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df81099e0 0x7f3df819ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.305+0000 7f3dfe800700 1 --2- 172.21.15.81:0/2432088909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df810e8b0 0x7f3df81a48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.306+0000 7f3dfd400700 1 -- 172.21.15.81:0/2432088909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df81099e0 msgr2=0x7f3df819ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.306+0000 7f3dfd400700 1 --2- 172.21.15.81:0/2432088909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df81099e0 0x7f3df819ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.306+0000 7f3dfd400700 1 -- 172.21.15.81:0/2432088909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df810e8b0 msgr2=0x7f3df81a48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:35.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.306+0000 7f3dfd400700 1 --2- 172.21.15.81:0/2432088909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df810e8b0 0x7f3df81a48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:35.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.306+0000 7f3dfd400700 1 -- 172.21.15.81:0/2432088909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df81a4ff0 con 0x7f3df810a3a0 2024-05-03T16:43:35.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.306+0000 7f3dfd400700 1 --2- 172.21.15.81:0/2432088909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3df810a3a0 0x7f3df81a0520 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3de800b530 tx=0x7f3de800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:35.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.306+0000 7f3df2a00700 1 -- 172.21.15.81:0/2432088909 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de8015020 con 0x7f3df810a3a0 2024-05-03T16:43:35.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.306+0000 7f3df2a00700 1 -- 172.21.15.81:0/2432088909 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3de8011cc0 con 0x7f3df810a3a0 2024-05-03T16:43:35.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.306+0000 7f3df2a00700 1 -- 172.21.15.81:0/2432088909 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de8010d30 con 0x7f3df810a3a0 2024-05-03T16:43:35.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.306+0000 7f3dff200700 1 -- 172.21.15.81:0/2432088909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df81a52e0 con 0x7f3df810a3a0 2024-05-03T16:43:35.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.307+0000 7f3dff200700 1 -- 172.21.15.81:0/2432088909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df81acb60 con 0x7f3df810a3a0 2024-05-03T16:43:35.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.308+0000 7f3dff200700 1 -- 172.21.15.81:0/2432088909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3df806a190 con 0x7f3df810a3a0 2024-05-03T16:43:35.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.313+0000 7f3df2a00700 1 -- 172.21.15.81:0/2432088909 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f3de8018020 con 0x7f3df810a3a0 2024-05-03T16:43:35.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.314+0000 7f3df2a00700 1 --2- 172.21.15.81:0/2432088909 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3de00b2880 0x7f3de00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:35.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.315+0000 7f3df2a00700 1 -- 172.21.15.81:0/2432088909 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f3de80e1c70 con 0x7f3df810a3a0 2024-05-03T16:43:35.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.315+0000 7f3dfde00700 1 --2- 172.21.15.81:0/2432088909 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3de00b2880 0x7f3de00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:35.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.315+0000 7f3dfde00700 1 --2- 172.21.15.81:0/2432088909 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3de00b2880 0x7f3de00b4d40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3dec005fd0 tx=0x7f3dec00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:35.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.317+0000 7f3df2a00700 1 -- 172.21.15.81:0/2432088909 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f3de801f020 con 0x7f3df810a3a0 2024-05-03T16:43:35.580 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 16:43:35 smithi081 bash[68329]: ddddc0371d22bc94b001c3e3ee7c5abb4d075135f3055d579a198e068c6ed8e4 2024-05-03T16:43:35.580 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 16:43:35 smithi081 systemd[1]: Started Ceph mds.a for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:43:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.605+0000 7f3dff200700 1 -- 172.21.15.81:0/2432088909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3df81a1340 con 0x7f3df810a3a0 2024-05-03T16:43:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.606+0000 7f3df2a00700 1 -- 172.21.15.81:0/2432088909 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9659 (secure 0 0 0) 0x7f3de80a9d90 con 0x7f3df810a3a0 2024-05-03T16:43:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:43:35.609 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/886382058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":886382058},{"type":"v1","addr":"172.21.15.81:6835","nonce":886382058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3285208793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3285208793},{"type":"v1","addr":"172.21.15.81:6837","nonce":3285208793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/3710454674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3710454674},{"type":"v1","addr":"172.21.15.81:6839","nonce":3710454674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1174252889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1174252889},{"type":"v1","addr":"172.21.15.81:6841","nonce":1174252889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1900581381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1900581381},{"type":"v1","addr":"172.21.15.146:6833","nonce":1900581381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3514751933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3514751933},{"type":"v1","addr":"172.21.15.146:6835","nonce":3514751933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/971814714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":971814714},{"type":"v1","addr":"172.21.15.146:6837","nonce":971814714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24481,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6839/3770312555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":3770312555},{"type":"v1","addr":"172.21.15.146:6839","nonce":3770312555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34400,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/749392804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":749392804},{"type":"v1","addr":"172.21.15.134:6833","nonce":749392804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34418,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3681203129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3681203129},{"type":"v1","addr":"172.21.15.134:6835","nonce":3681203129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34439,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2915415754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2915415754},{"type":"v1","addr":"172.21.15.134:6837","nonce":2915415754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-03T16:43:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.610+0000 7f3dff200700 1 -- 172.21.15.81:0/2432088909 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3de00b2880 msgr2=0x7f3de00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.610+0000 7f3dff200700 1 --2- 172.21.15.81:0/2432088909 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3de00b2880 0x7f3de00b4d40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3dec005fd0 tx=0x7f3dec00a560 comp rx=0 tx=0).stop 2024-05-03T16:43:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.610+0000 7f3dff200700 1 -- 172.21.15.81:0/2432088909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3df810a3a0 msgr2=0x7f3df81a0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.610+0000 7f3dff200700 1 --2- 172.21.15.81:0/2432088909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3df810a3a0 0x7f3df81a0520 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3de800b530 tx=0x7f3de800b8f0 comp rx=0 tx=0).stop 2024-05-03T16:43:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.610+0000 7f3dff200700 1 -- 172.21.15.81:0/2432088909 shutdown_connections 2024-05-03T16:43:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.610+0000 7f3dff200700 1 --2- 172.21.15.81:0/2432088909 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3de00b2880 0x7f3de00b4d40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.610+0000 7f3dff200700 1 --2- 172.21.15.81:0/2432088909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df81099e0 0x7f3df819ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.610+0000 7f3dff200700 1 --2- 172.21.15.81:0/2432088909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df810e8b0 0x7f3df81a48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.610+0000 7f3dff200700 1 --2- 172.21.15.81:0/2432088909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3df810a3a0 0x7f3df81a0520 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.610+0000 7f3dff200700 1 -- 172.21.15.81:0/2432088909 >> 172.21.15.81:0/2432088909 conn(0x7f3df8079230 msgr2=0x7f3df80798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.610+0000 7f3dff200700 1 -- 172.21.15.81:0/2432088909 shutdown_connections 2024-05-03T16:43:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:35.610+0000 7f3dff200700 1 -- 172.21.15.81:0/2432088909 wait complete. 2024-05-03T16:43:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 12 2024-05-03T16:43:35.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:35 smithi134 ceph-mon[31708]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:35.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:35 smithi081 ceph-mon[28640]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:36.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:35 smithi146 ceph-mon[32357]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:36.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:36 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:36.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:36 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.81:6840/1174252889,v1:172.21.15.81:6841/1174252889] up:boot 2024-05-03T16:43:36.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:36 smithi081 ceph-mon[28640]: fsmap 11 up:standby 2024-05-03T16:43:36.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:36 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-03T16:43:36.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:36 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:36.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:36 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2432088909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:36.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:36 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:36.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:36 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:36.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:36 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:36.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:36 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:36.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:36 smithi081 ceph-mon[28640]: Deploying daemon mds.b on smithi134 2024-05-03T16:43:36.841 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:36 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:36.841 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:36 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.81:6840/1174252889,v1:172.21.15.81:6841/1174252889] up:boot 2024-05-03T16:43:36.841 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:36 smithi134 ceph-mon[31708]: fsmap 11 up:standby 2024-05-03T16:43:36.841 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:36 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-03T16:43:36.842 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:36 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:36.842 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:36 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2432088909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:36.842 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:36 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:36.842 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:36 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:36.842 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:36 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:36.842 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:36 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:36.843 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:36 smithi134 ceph-mon[31708]: Deploying daemon mds.b on smithi134 2024-05-03T16:43:37.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:36 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:37.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:36 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.81:6840/1174252889,v1:172.21.15.81:6841/1174252889] up:boot 2024-05-03T16:43:37.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:36 smithi146 ceph-mon[32357]: fsmap 11 up:standby 2024-05-03T16:43:37.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:36 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-03T16:43:37.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:36 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:37.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:36 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2432088909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:37.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:36 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:37.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:36 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T16:43:37.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:36 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T16:43:37.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:36 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:37.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:36 smithi146 ceph-mon[32357]: Deploying daemon mds.b on smithi134 2024-05-03T16:43:37.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:37 smithi134 ceph-mon[31708]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:37.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:37 smithi081 ceph-mon[28640]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:38.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:37 smithi146 ceph-mon[32357]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:38.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T16:43:38.973 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:43:39.086 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 16:43:38 smithi134 systemd[1]: Starting Ceph mds.b for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T16:43:39.350 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 16:43:39 smithi134 podman[62214]: 2024-05-03 16:43:39.083923678 +0000 UTC m=+0.120179929 container create c36d4e01671296f3ff5719f9ab941e895b06a61dad76823ef5e5a568c4b3a640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True) 2024-05-03T16:43:39.350 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 16:43:39 smithi134 podman[62214]: 2024-05-03 16:43:38.995412241 +0000 UTC m=+0.031668473 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T16:43:39.350 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 16:43:39 smithi134 podman[62214]: 2024-05-03 16:43:39.347762418 +0000 UTC m=+0.384018696 container init c36d4e01671296f3ff5719f9ab941e895b06a61dad76823ef5e5a568c4b3a640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-b, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True) 2024-05-03T16:43:39.643 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 16:43:39 smithi134 podman[62214]: 2024-05-03 16:43:39.357884721 +0000 UTC m=+0.394140964 container start c36d4e01671296f3ff5719f9ab941e895b06a61dad76823ef5e5a568c4b3a640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240430) 2024-05-03T16:43:39.643 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 16:43:39 smithi134 ceph-mds[62234]: -- 172.21.15.134:0/4289638973 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5597cf12da40 con 0x5597cf100c00 2024-05-03T16:43:39.643 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 16:43:39 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-b[62229]: starting mds.b at 2024-05-03T16:43:39.643 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 16:43:39 smithi134 bash[62214]: c36d4e01671296f3ff5719f9ab941e895b06a61dad76823ef5e5a568c4b3a640 2024-05-03T16:43:39.643 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 16:43:39 smithi134 systemd[1]: Started Ceph mds.b for 8988869e-096a-11ef-bc97-c7b262605968. 2024-05-03T16:43:39.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:39 smithi081 ceph-mon[28640]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:39.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:39.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:39.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:39.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:39.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:39.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:39 smithi134 ceph-mon[31708]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:39.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:39.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:39.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:39.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:39.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:40.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:39 smithi146 ceph-mon[32357]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:40.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:40.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:40.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:40.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:40.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:40.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:40 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] up:boot 2024-05-03T16:43:40.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:40 smithi134 ceph-mon[31708]: fsmap 12 up:standby 2024-05-03T16:43:40.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:40 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T16:43:40.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:40 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:43:40.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:40 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] up:boot 2024-05-03T16:43:40.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:40 smithi081 ceph-mon[28640]: fsmap 12 up:standby 2024-05-03T16:43:40.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:40 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T16:43:40.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:40 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:43:41.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:40 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] up:boot 2024-05-03T16:43:41.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:40 smithi146 ceph-mon[32357]: fsmap 12 up:standby 2024-05-03T16:43:41.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:40 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T16:43:41.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:40 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:43:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.174+0000 7f3e82600700 1 -- 172.21.15.81:0/471628761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7c109510 msgr2=0x7f3e7c1098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.174+0000 7f3e82600700 1 --2- 172.21.15.81:0/471628761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7c109510 0x7f3e7c1098f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c009990 tx=0x7f3e6c009ca0 comp rx=0 tx=0).stop 2024-05-03T16:43:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.174+0000 7f3e82600700 1 -- 172.21.15.81:0/471628761 shutdown_connections 2024-05-03T16:43:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.174+0000 7f3e82600700 1 --2- 172.21.15.81:0/471628761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e7c06bb40 0x7f3e7c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.174+0000 7f3e82600700 1 --2- 172.21.15.81:0/471628761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7c109510 0x7f3e7c1098f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.174+0000 7f3e82600700 1 --2- 172.21.15.81:0/471628761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e7c06b180 0x7f3e7c06b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.174+0000 7f3e82600700 1 -- 172.21.15.81:0/471628761 >> 172.21.15.81:0/471628761 conn(0x7f3e7c079350 msgr2=0x7f3e7c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.174+0000 7f3e82600700 1 -- 172.21.15.81:0/471628761 shutdown_connections 2024-05-03T16:43:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.174+0000 7f3e82600700 1 -- 172.21.15.81:0/471628761 wait complete. 2024-05-03T16:43:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.175+0000 7f3e82600700 1 Processor -- start 2024-05-03T16:43:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.176+0000 7f3e82600700 1 -- start start 2024-05-03T16:43:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.176+0000 7f3e82600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e7c06b180 0x7f3e7c19f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.176+0000 7f3e82600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7c06bb40 0x7f3e7c19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.176+0000 7f3e82600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e7c109510 0x7f3e7c1998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.176+0000 7f3e82600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c113520 con 0x7f3e7c06bb40 2024-05-03T16:43:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.176+0000 7f3e82600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1133a0 con 0x7f3e7c06b180 2024-05-03T16:43:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.176+0000 7f3e82600700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1136a0 con 0x7f3e7c109510 2024-05-03T16:43:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.176+0000 7f3e7aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7c06bb40 0x7f3e7c19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.176+0000 7f3e7aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7c06bb40 0x7f3e7c19fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42552/0 (socket says 172.21.15.81:42552) 2024-05-03T16:43:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.176+0000 7f3e7aa00700 1 -- 172.21.15.81:0/2483015086 learned_addr learned my addr 172.21.15.81:0/2483015086 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:43:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.177+0000 7f3e7be00700 1 --2- 172.21.15.81:0/2483015086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e7c109510 0x7f3e7c1998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.177+0000 7f3e7b400700 1 --2- 172.21.15.81:0/2483015086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e7c06b180 0x7f3e7c19f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.177+0000 7f3e7aa00700 1 -- 172.21.15.81:0/2483015086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e7c109510 msgr2=0x7f3e7c1998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.177+0000 7f3e7aa00700 1 --2- 172.21.15.81:0/2483015086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e7c109510 0x7f3e7c1998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.177+0000 7f3e7aa00700 1 -- 172.21.15.81:0/2483015086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e7c06b180 msgr2=0x7f3e7c19f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.177+0000 7f3e7aa00700 1 --2- 172.21.15.81:0/2483015086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e7c06b180 0x7f3e7c19f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.177+0000 7f3e7aa00700 1 -- 172.21.15.81:0/2483015086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7c19a000 con 0x7f3e7c06bb40 2024-05-03T16:43:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.177+0000 7f3e7aa00700 1 --2- 172.21.15.81:0/2483015086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7c06bb40 0x7f3e7c19fc20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800c9b0 tx=0x7f3e6800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.177+0000 7f3e73e00700 1 -- 172.21.15.81:0/2483015086 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68007b00 con 0x7f3e7c06bb40 2024-05-03T16:43:41.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.177+0000 7f3e73e00700 1 -- 172.21.15.81:0/2483015086 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e68007ca0 con 0x7f3e7c06bb40 2024-05-03T16:43:41.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.177+0000 7f3e73e00700 1 -- 172.21.15.81:0/2483015086 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68018660 con 0x7f3e7c06bb40 2024-05-03T16:43:41.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.177+0000 7f3e82600700 1 -- 172.21.15.81:0/2483015086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e7c19a2f0 con 0x7f3e7c06bb40 2024-05-03T16:43:41.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.178+0000 7f3e82600700 1 -- 172.21.15.81:0/2483015086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e7c1a65b0 con 0x7f3e7c06bb40 2024-05-03T16:43:41.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.179+0000 7f3e82600700 1 -- 172.21.15.81:0/2483015086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e7c10b9f0 con 0x7f3e7c06bb40 2024-05-03T16:43:41.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.184+0000 7f3e73e00700 1 -- 172.21.15.81:0/2483015086 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f3e6800f450 con 0x7f3e7c06bb40 2024-05-03T16:43:41.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.186+0000 7f3e73e00700 1 --2- 172.21.15.81:0/2483015086 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3e600b2900 0x7f3e600b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:41.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.187+0000 7f3e73e00700 1 -- 172.21.15.81:0/2483015086 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f3e680e2040 con 0x7f3e7c06bb40 2024-05-03T16:43:41.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.187+0000 7f3e7b400700 1 --2- 172.21.15.81:0/2483015086 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3e600b2900 0x7f3e600b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:41.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.187+0000 7f3e7b400700 1 --2- 172.21.15.81:0/2483015086 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3e600b2900 0x7f3e600b4dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00b5c0 tx=0x7f3e6c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.188+0000 7f3e73e00700 1 -- 172.21.15.81:0/2483015086 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f3e68014030 con 0x7f3e7c06bb40 2024-05-03T16:43:41.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.480+0000 7f3e82600700 1 -- 172.21.15.81:0/2483015086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e7c06a190 con 0x7f3e7c06bb40 2024-05-03T16:43:41.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.481+0000 7f3e73e00700 1 -- 172.21.15.81:0/2483015086 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10488 (secure 0 0 0) 0x7f3e680aa310 con 0x7f3e7c06bb40 2024-05-03T16:43:41.484 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:43:41.484 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/886382058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":886382058},{"type":"v1","addr":"172.21.15.81:6835","nonce":886382058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3285208793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3285208793},{"type":"v1","addr":"172.21.15.81:6837","nonce":3285208793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/3710454674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3710454674},{"type":"v1","addr":"172.21.15.81:6839","nonce":3710454674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1174252889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1174252889},{"type":"v1","addr":"172.21.15.81:6841","nonce":1174252889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1900581381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1900581381},{"type":"v1","addr":"172.21.15.146:6833","nonce":1900581381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3514751933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3514751933},{"type":"v1","addr":"172.21.15.146:6835","nonce":3514751933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/971814714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":971814714},{"type":"v1","addr":"172.21.15.146:6837","nonce":971814714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24481,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6839/3770312555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":3770312555},{"type":"v1","addr":"172.21.15.146:6839","nonce":3770312555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34400,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/749392804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":749392804},{"type":"v1","addr":"172.21.15.134:6833","nonce":749392804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34418,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3681203129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3681203129},{"type":"v1","addr":"172.21.15.134:6835","nonce":3681203129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34439,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2915415754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2915415754},{"type":"v1","addr":"172.21.15.134:6837","nonce":2915415754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":34466,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6839/2061491127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2061491127},{"type":"v1","addr":"172.21.15.134:6839","nonce":2061491127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-05-03T16:43:41.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.484+0000 7f3e82600700 1 -- 172.21.15.81:0/2483015086 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3e600b2900 msgr2=0x7f3e600b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.484+0000 7f3e82600700 1 --2- 172.21.15.81:0/2483015086 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3e600b2900 0x7f3e600b4dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00b5c0 tx=0x7f3e6c01a040 comp rx=0 tx=0).stop 2024-05-03T16:43:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.484+0000 7f3e82600700 1 -- 172.21.15.81:0/2483015086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7c06bb40 msgr2=0x7f3e7c19fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.484+0000 7f3e82600700 1 --2- 172.21.15.81:0/2483015086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7c06bb40 0x7f3e7c19fc20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800c9b0 tx=0x7f3e6800cd70 comp rx=0 tx=0).stop 2024-05-03T16:43:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.484+0000 7f3e82600700 1 -- 172.21.15.81:0/2483015086 shutdown_connections 2024-05-03T16:43:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.484+0000 7f3e82600700 1 --2- 172.21.15.81:0/2483015086 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3e600b2900 0x7f3e600b4dc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.484+0000 7f3e82600700 1 --2- 172.21.15.81:0/2483015086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e7c109510 0x7f3e7c1998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.484+0000 7f3e82600700 1 --2- 172.21.15.81:0/2483015086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e7c06b180 0x7f3e7c19f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.484+0000 7f3e82600700 1 --2- 172.21.15.81:0/2483015086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7c06bb40 0x7f3e7c19fc20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.484+0000 7f3e82600700 1 -- 172.21.15.81:0/2483015086 >> 172.21.15.81:0/2483015086 conn(0x7f3e7c079350 msgr2=0x7f3e7c101080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.484+0000 7f3e82600700 1 -- 172.21.15.81:0/2483015086 shutdown_connections 2024-05-03T16:43:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:41.484+0000 7f3e82600700 1 -- 172.21.15.81:0/2483015086 wait complete. 2024-05-03T16:43:41.488 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 13 2024-05-03T16:43:41.735 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:41 smithi081 ceph-mon[28640]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:41.735 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:41 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2483015086' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:41.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:41 smithi134 ceph-mon[31708]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:41.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:41 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2483015086' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:42.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:41 smithi146 ceph-mon[32357]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:42.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:41 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2483015086' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:43:42.963 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-05-03T16:43:43.431 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:43:44.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:43 smithi134 ceph-mon[31708]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:44.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:43 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:44.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:43 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:44.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:43 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:44.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:43 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:44.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:43 smithi081 ceph-mon[28640]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:44.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:43 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:44.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:43 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:44.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:43 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:44.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:43 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:44.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:43 smithi146 ceph-mon[32357]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:44.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:43 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:44.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:43 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:44.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:43 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:44.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:43 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:45.431 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:45 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:45.431 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:45 smithi081 ceph-mon[28640]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:45.431 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:45 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:45.431 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:45 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:45.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:45 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:45.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:45 smithi146 ceph-mon[32357]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:45.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:45 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:45.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:45 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:45.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:45 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:45.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:45 smithi134 ceph-mon[31708]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:45.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:45 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:45.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:45 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:45.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.745+0000 7f48e0a00700 1 -- 172.21.15.81:0/1013955372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc104100 msgr2=0x7f48dc108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:45.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.745+0000 7f48e0a00700 1 --2- 172.21.15.81:0/1013955372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc104100 0x7f48dc108120 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f48c80099c0 tx=0x7f48c8009cd0 comp rx=0 tx=0).stop 2024-05-03T16:43:45.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.745+0000 7f48e0a00700 1 -- 172.21.15.81:0/1013955372 shutdown_connections 2024-05-03T16:43:45.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.745+0000 7f48e0a00700 1 --2- 172.21.15.81:0/1013955372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48dc103750 0x7f48dc103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:45.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.745+0000 7f48e0a00700 1 --2- 172.21.15.81:0/1013955372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48dc108850 0x7f48dc1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:45.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.745+0000 7f48e0a00700 1 --2- 172.21.15.81:0/1013955372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc104100 0x7f48dc108120 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:45.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.745+0000 7f48e0a00700 1 -- 172.21.15.81:0/1013955372 >> 172.21.15.81:0/1013955372 conn(0x7f48dc07a600 msgr2=0x7f48dc07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:45.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.745+0000 7f48e0a00700 1 -- 172.21.15.81:0/1013955372 shutdown_connections 2024-05-03T16:43:45.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.745+0000 7f48e0a00700 1 -- 172.21.15.81:0/1013955372 wait complete. 2024-05-03T16:43:45.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.746+0000 7f48e0a00700 1 Processor -- start 2024-05-03T16:43:45.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.747+0000 7f48e0a00700 1 -- start start 2024-05-03T16:43:45.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.747+0000 7f48e0a00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48dc103750 0x7f48dc1a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:45.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.747+0000 7f48e0a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc104100 0x7f48dc1a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:45.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.747+0000 7f48e0a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48dc108850 0x7f48dc19ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:45.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.747+0000 7f48e0a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc113530 con 0x7f48dc104100 2024-05-03T16:43:45.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.747+0000 7f48e0a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc1133b0 con 0x7f48dc108850 2024-05-03T16:43:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.747+0000 7f48e0a00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc1136b0 con 0x7f48dc103750 2024-05-03T16:43:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.747+0000 7f48d9400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc104100 0x7f48dc1a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.747+0000 7f48d9400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc104100 0x7f48dc1a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42574/0 (socket says 172.21.15.81:42574) 2024-05-03T16:43:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.748+0000 7f48d9400700 1 -- 172.21.15.81:0/4285070736 learned_addr learned my addr 172.21.15.81:0/4285070736 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:43:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.748+0000 7f48d9e00700 1 --2- 172.21.15.81:0/4285070736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48dc103750 0x7f48dc1a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.748+0000 7f48da800700 1 --2- 172.21.15.81:0/4285070736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48dc108850 0x7f48dc19ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.748+0000 7f48d9400700 1 -- 172.21.15.81:0/4285070736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48dc103750 msgr2=0x7f48dc1a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.748+0000 7f48d9400700 1 --2- 172.21.15.81:0/4285070736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48dc103750 0x7f48dc1a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.748+0000 7f48d9400700 1 -- 172.21.15.81:0/4285070736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48dc108850 msgr2=0x7f48dc19ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.748+0000 7f48d9400700 1 --2- 172.21.15.81:0/4285070736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48dc108850 0x7f48dc19ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.748+0000 7f48d9400700 1 -- 172.21.15.81:0/4285070736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48dc19c170 con 0x7f48dc104100 2024-05-03T16:43:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.748+0000 7f48d9400700 1 --2- 172.21.15.81:0/4285070736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc104100 0x7f48dc1a1d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f48c8000c00 tx=0x7f48c800f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.749+0000 7f48d2a00700 1 -- 172.21.15.81:0/4285070736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8027070 con 0x7f48dc104100 2024-05-03T16:43:45.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.749+0000 7f48d2a00700 1 -- 172.21.15.81:0/4285070736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48c800fda0 con 0x7f48dc104100 2024-05-03T16:43:45.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.749+0000 7f48e0a00700 1 -- 172.21.15.81:0/4285070736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48dc19c400 con 0x7f48dc104100 2024-05-03T16:43:45.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.749+0000 7f48d2a00700 1 -- 172.21.15.81:0/4285070736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8022e50 con 0x7f48dc104100 2024-05-03T16:43:45.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.749+0000 7f48e0a00700 1 -- 172.21.15.81:0/4285070736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48dc1a8720 con 0x7f48dc104100 2024-05-03T16:43:45.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.751+0000 7f48e0a00700 1 -- 172.21.15.81:0/4285070736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48bc005330 con 0x7f48dc104100 2024-05-03T16:43:45.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.752+0000 7f48d2a00700 1 -- 172.21.15.81:0/4285070736 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f48c802a070 con 0x7f48dc104100 2024-05-03T16:43:45.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.754+0000 7f48d2a00700 1 --2- 172.21.15.81:0/4285070736 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f48c00b2aa0 0x7f48c00b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:45.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.754+0000 7f48d2a00700 1 -- 172.21.15.81:0/4285070736 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f48c80e27f0 con 0x7f48dc104100 2024-05-03T16:43:45.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.754+0000 7f48d9e00700 1 --2- 172.21.15.81:0/4285070736 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f48c00b2aa0 0x7f48c00b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:45.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.755+0000 7f48d9e00700 1 --2- 172.21.15.81:0/4285070736 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f48c00b2aa0 0x7f48c00b4f60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f48dc19cb50 tx=0x7f48cc00b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:45.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:45.759+0000 7f48d2a00700 1 -- 172.21.15.81:0/4285070736 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f48c8013070 con 0x7f48dc104100 2024-05-03T16:43:46.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:46.019+0000 7f48e0a00700 1 -- 172.21.15.81:0/4285070736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f48bc005620 con 0x7f48dc104100 2024-05-03T16:43:46.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:46.019+0000 7f48d2a00700 1 -- 172.21.15.81:0/4285070736 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) ==== 84+0+65 (secure 0 0 0) 0x7f48c80aa9a0 con 0x7f48dc104100 2024-05-03T16:43:46.022 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:43:46.022 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-05-03T16:43:46.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-03T16:43:46.022 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-05-03T16:43:46.022 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-05-03T16:43:46.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-03T16:43:46.022 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-05-03T16:43:46.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:46.023+0000 7f48e0a00700 1 -- 172.21.15.81:0/4285070736 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f48c00b2aa0 msgr2=0x7f48c00b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:46.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:46.023+0000 7f48e0a00700 1 --2- 172.21.15.81:0/4285070736 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f48c00b2aa0 0x7f48c00b4f60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f48dc19cb50 tx=0x7f48cc00b3c0 comp rx=0 tx=0).stop 2024-05-03T16:43:46.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:46.023+0000 7f48e0a00700 1 -- 172.21.15.81:0/4285070736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc104100 msgr2=0x7f48dc1a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:46.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:46.023+0000 7f48e0a00700 1 --2- 172.21.15.81:0/4285070736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc104100 0x7f48dc1a1d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f48c8000c00 tx=0x7f48c800f460 comp rx=0 tx=0).stop 2024-05-03T16:43:46.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:46.023+0000 7f48e0a00700 1 -- 172.21.15.81:0/4285070736 shutdown_connections 2024-05-03T16:43:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:46.023+0000 7f48e0a00700 1 --2- 172.21.15.81:0/4285070736 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f48c00b2aa0 0x7f48c00b4f60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:46.023+0000 7f48e0a00700 1 --2- 172.21.15.81:0/4285070736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48dc103750 0x7f48dc1a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:46.023+0000 7f48e0a00700 1 --2- 172.21.15.81:0/4285070736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48dc108850 0x7f48dc19ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:46.023+0000 7f48e0a00700 1 --2- 172.21.15.81:0/4285070736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc104100 0x7f48dc1a1d90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:46.023+0000 7f48e0a00700 1 -- 172.21.15.81:0/4285070736 >> 172.21.15.81:0/4285070736 conn(0x7f48dc07a600 msgr2=0x7f48dc101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:46.023+0000 7f48e0a00700 1 -- 172.21.15.81:0/4285070736 shutdown_connections 2024-05-03T16:43:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:46.023+0000 7f48e0a00700 1 -- 172.21.15.81:0/4285070736 wait complete. 2024-05-03T16:43:46.387 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:46 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/4285070736' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-03T16:43:46.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:46 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/4285070736' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-03T16:43:46.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:46 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/4285070736' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-03T16:43:46.853 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-03T16:43:46.853 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-03T16:43:47.306 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:43:47.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:47 smithi146 ceph-mon[32357]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:47.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:47 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:47.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:47 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:43:47.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:47 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:47.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:47 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:43:47.612 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:47 smithi081 ceph-mon[28640]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:47.613 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:47.613 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:43:47.613 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:47.613 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:47 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:43:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:47 smithi134 ceph-mon[31708]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:47 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:47 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:43:47.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:47 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:47.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:47 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:43:49.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:49 smithi081 ceph-mon[28640]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:49.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:49 smithi134 ceph-mon[31708]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:49.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:49 smithi146 ceph-mon[32357]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:50.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.204+0000 7f0c27a00700 1 -- 172.21.15.81:0/1009709463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c20102d60 msgr2=0x7f0c2010f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:50.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.204+0000 7f0c27a00700 1 --2- 172.21.15.81:0/1009709463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c20102d60 0x7f0c2010f250 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800b0a0 tx=0x7f0c1800b3b0 comp rx=0 tx=0).stop 2024-05-03T16:43:50.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.205+0000 7f0c27a00700 1 -- 172.21.15.81:0/1009709463 shutdown_connections 2024-05-03T16:43:50.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.205+0000 7f0c27a00700 1 --2- 172.21.15.81:0/1009709463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c20102d60 0x7f0c2010f250 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:50.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.205+0000 7f0c27a00700 1 --2- 172.21.15.81:0/1009709463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c20108410 0x7f0c201087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:50.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.205+0000 7f0c27a00700 1 --2- 172.21.15.81:0/1009709463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c201023a0 0x7f0c20102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:50.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.205+0000 7f0c27a00700 1 -- 172.21.15.81:0/1009709463 >> 172.21.15.81:0/1009709463 conn(0x7f0c20079350 msgr2=0x7f0c20079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:50.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.205+0000 7f0c27a00700 1 -- 172.21.15.81:0/1009709463 shutdown_connections 2024-05-03T16:43:50.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.205+0000 7f0c27a00700 1 -- 172.21.15.81:0/1009709463 wait complete. 2024-05-03T16:43:50.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.206+0000 7f0c27a00700 1 Processor -- start 2024-05-03T16:43:50.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.206+0000 7f0c27a00700 1 -- start start 2024-05-03T16:43:50.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.207+0000 7f0c27a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c201023a0 0x7f0c201a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:50.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.207+0000 7f0c27a00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c20102d60 0x7f0c201a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:50.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.207+0000 7f0c27a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c20108410 0x7f0c2019b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:50.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.207+0000 7f0c27a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0c201123e0 con 0x7f0c20108410 2024-05-03T16:43:50.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.207+0000 7f0c27a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0c20112260 con 0x7f0c201023a0 2024-05-03T16:43:50.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.207+0000 7f0c27a00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0c20112560 con 0x7f0c20102d60 2024-05-03T16:43:50.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.207+0000 7f0c25a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c20108410 0x7f0c2019b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:50.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.207+0000 7f0c25a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c20108410 0x7f0c2019b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45026/0 (socket says 172.21.15.81:45026) 2024-05-03T16:43:50.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.207+0000 7f0c25a00700 1 -- 172.21.15.81:0/2867883605 learned_addr learned my addr 172.21.15.81:0/2867883605 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:43:50.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.207+0000 7f0c25000700 1 --2- 172.21.15.81:0/2867883605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c201023a0 0x7f0c201a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:50.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.208+0000 7f0c17e00700 1 --2- 172.21.15.81:0/2867883605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c20102d60 0x7f0c201a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:50.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.208+0000 7f0c25a00700 1 -- 172.21.15.81:0/2867883605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c20102d60 msgr2=0x7f0c201a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:50.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.208+0000 7f0c25a00700 1 --2- 172.21.15.81:0/2867883605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c20102d60 0x7f0c201a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:50.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.208+0000 7f0c25a00700 1 -- 172.21.15.81:0/2867883605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c201023a0 msgr2=0x7f0c201a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:50.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.208+0000 7f0c25a00700 1 --2- 172.21.15.81:0/2867883605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c201023a0 0x7f0c201a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:50.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.208+0000 7f0c25a00700 1 -- 172.21.15.81:0/2867883605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2019c0d0 con 0x7f0c20108410 2024-05-03T16:43:50.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.208+0000 7f0c25a00700 1 --2- 172.21.15.81:0/2867883605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c20108410 0x7f0c2019b970 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0c180062a0 tx=0x7f0c18004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:50.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.208+0000 7f0c1e000700 1 -- 172.21.15.81:0/2867883605 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c18021070 con 0x7f0c20108410 2024-05-03T16:43:50.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.208+0000 7f0c1e000700 1 -- 172.21.15.81:0/2867883605 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0c18007d00 con 0x7f0c20108410 2024-05-03T16:43:50.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.208+0000 7f0c27a00700 1 -- 172.21.15.81:0/2867883605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2019c360 con 0x7f0c20108410 2024-05-03T16:43:50.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.209+0000 7f0c1e000700 1 -- 172.21.15.81:0/2867883605 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c18005280 con 0x7f0c20108410 2024-05-03T16:43:50.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.209+0000 7f0c27a00700 1 -- 172.21.15.81:0/2867883605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c201a8680 con 0x7f0c20108410 2024-05-03T16:43:50.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.210+0000 7f0c27a00700 1 -- 172.21.15.81:0/2867883605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c2006a190 con 0x7f0c20108410 2024-05-03T16:43:50.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.212+0000 7f0c1e000700 1 -- 172.21.15.81:0/2867883605 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0c18024070 con 0x7f0c20108410 2024-05-03T16:43:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.215+0000 7f0c1e000700 1 --2- 172.21.15.81:0/2867883605 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0c040b2880 0x7f0c040b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.215+0000 7f0c1e000700 1 -- 172.21.15.81:0/2867883605 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f0c1800f020 con 0x7f0c20108410 2024-05-03T16:43:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.215+0000 7f0c25000700 1 --2- 172.21.15.81:0/2867883605 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0c040b2880 0x7f0c040b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:50.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.216+0000 7f0c25000700 1 --2- 172.21.15.81:0/2867883605 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0c040b2880 0x7f0c040b4d40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0c10005fd0 tx=0x7f0c1000af00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:50.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.220+0000 7f0c1e000700 1 -- 172.21.15.81:0/2867883605 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0c1802b020 con 0x7f0c20108410 2024-05-03T16:43:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.458+0000 7f0c27a00700 1 -- 172.21.15.81:0/2867883605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0c201a8850 con 0x7f0c20108410 2024-05-03T16:43:50.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:50 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:50.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:50 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:50.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:50 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:50.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:50 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:50.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:50 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2867883605' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-03T16:43:50.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.776+0000 7f0c1e000700 1 -- 172.21.15.81:0/2867883605 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) ==== 138+0+0 (secure 0 0 0) 0x7f0c180ab760 con 0x7f0c20108410 2024-05-03T16:43:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.780+0000 7f0c27a00700 1 -- 172.21.15.81:0/2867883605 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0c040b2880 msgr2=0x7f0c040b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.780+0000 7f0c27a00700 1 --2- 172.21.15.81:0/2867883605 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0c040b2880 0x7f0c040b4d40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0c10005fd0 tx=0x7f0c1000af00 comp rx=0 tx=0).stop 2024-05-03T16:43:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.780+0000 7f0c27a00700 1 -- 172.21.15.81:0/2867883605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c20108410 msgr2=0x7f0c2019b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.780+0000 7f0c27a00700 1 --2- 172.21.15.81:0/2867883605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c20108410 0x7f0c2019b970 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0c180062a0 tx=0x7f0c18004ed0 comp rx=0 tx=0).stop 2024-05-03T16:43:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.780+0000 7f0c27a00700 1 -- 172.21.15.81:0/2867883605 shutdown_connections 2024-05-03T16:43:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.781+0000 7f0c27a00700 1 --2- 172.21.15.81:0/2867883605 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0c040b2880 0x7f0c040b4d40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.781+0000 7f0c27a00700 1 --2- 172.21.15.81:0/2867883605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c20108410 0x7f0c2019b970 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.781+0000 7f0c27a00700 1 --2- 172.21.15.81:0/2867883605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c201023a0 0x7f0c201a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.781+0000 7f0c27a00700 1 --2- 172.21.15.81:0/2867883605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c20102d60 0x7f0c201a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.781+0000 7f0c27a00700 1 -- 172.21.15.81:0/2867883605 >> 172.21.15.81:0/2867883605 conn(0x7f0c20079350 msgr2=0x7f0c2006b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.781+0000 7f0c27a00700 1 -- 172.21.15.81:0/2867883605 shutdown_connections 2024-05-03T16:43:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:50.781+0000 7f0c27a00700 1 -- 172.21.15.81:0/2867883605 wait complete. 2024-05-03T16:43:50.785 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-05-03T16:43:50.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:50 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:50.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:50 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:50.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:50 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:50.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:50 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:50.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:50 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2867883605' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-03T16:43:51.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:50 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:51.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:50 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:51.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:50 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:51.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:50 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:51.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:50 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2867883605' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-03T16:43:51.633 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-03T16:43:51.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:51 smithi081 ceph-mon[28640]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:51.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:51 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2867883605' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-03T16:43:51.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:51 smithi081 ceph-mon[28640]: osdmap e74: 12 total, 12 up, 12 in 2024-05-03T16:43:51.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:51 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:51.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:51 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:51.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:51 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:51.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:51 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:43:51.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:51 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:52.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:51 smithi146 ceph-mon[32357]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:52.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:51 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2867883605' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-03T16:43:52.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:51 smithi146 ceph-mon[32357]: osdmap e74: 12 total, 12 up, 12 in 2024-05-03T16:43:52.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:51 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:52.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:51 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:52.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:51 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:52.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:51 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:43:52.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:51 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:52.075 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:43:52.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:51 smithi134 ceph-mon[31708]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:52.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:51 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2867883605' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-03T16:43:52.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:51 smithi134 ceph-mon[31708]: osdmap e74: 12 total, 12 up, 12 in 2024-05-03T16:43:52.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:51 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:52.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:51 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:52.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:51 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:43:52.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:51 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:43:52.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:51 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:43:53.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:52 smithi146 ceph-mon[32357]: osdmap e75: 12 total, 12 up, 12 in 2024-05-03T16:43:53.204 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:52 smithi081 ceph-mon[28640]: osdmap e75: 12 total, 12 up, 12 in 2024-05-03T16:43:53.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:52 smithi134 ceph-mon[31708]: osdmap e75: 12 total, 12 up, 12 in 2024-05-03T16:43:53.884 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:53 smithi081 ceph-mon[28640]: pgmap v359: 33 pgs: 8 creating+peering, 1 active+clean, 24 unknown; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:53.884 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:53 smithi081 ceph-mon[28640]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T16:43:53.884 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:53 smithi081 ceph-mon[28640]: osdmap e76: 12 total, 12 up, 12 in 2024-05-03T16:43:54.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:53 smithi146 ceph-mon[32357]: pgmap v359: 33 pgs: 8 creating+peering, 1 active+clean, 24 unknown; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:54.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:53 smithi146 ceph-mon[32357]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T16:43:54.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:53 smithi146 ceph-mon[32357]: osdmap e76: 12 total, 12 up, 12 in 2024-05-03T16:43:54.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:53 smithi134 ceph-mon[31708]: pgmap v359: 33 pgs: 8 creating+peering, 1 active+clean, 24 unknown; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:54.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:53 smithi134 ceph-mon[31708]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T16:43:54.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:53 smithi134 ceph-mon[31708]: osdmap e76: 12 total, 12 up, 12 in 2024-05-03T16:43:54.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.448+0000 7f1c93400700 1 -- 172.21.15.81:0/944731450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c8c106080 msgr2=0x7f1c8c112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:54.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.448+0000 7f1c93400700 1 --2- 172.21.15.81:0/944731450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c8c106080 0x7f1c8c112590 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400b0a0 tx=0x7f1c8400b3b0 comp rx=0 tx=0).stop 2024-05-03T16:43:54.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.448+0000 7f1c93400700 1 -- 172.21.15.81:0/944731450 shutdown_connections 2024-05-03T16:43:54.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.448+0000 7f1c93400700 1 --2- 172.21.15.81:0/944731450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c8c10b6c0 0x7f1c8c10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:54.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.448+0000 7f1c93400700 1 --2- 172.21.15.81:0/944731450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c8c106080 0x7f1c8c112590 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:54.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.448+0000 7f1c93400700 1 --2- 172.21.15.81:0/944731450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c8c1056c0 0x7f1c8c105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:54.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.448+0000 7f1c93400700 1 -- 172.21.15.81:0/944731450 >> 172.21.15.81:0/944731450 conn(0x7f1c8c1011b0 msgr2=0x7f1c8c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:54.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.448+0000 7f1c93400700 1 -- 172.21.15.81:0/944731450 shutdown_connections 2024-05-03T16:43:54.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.448+0000 7f1c93400700 1 -- 172.21.15.81:0/944731450 wait complete. 2024-05-03T16:43:54.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.449+0000 7f1c93400700 1 Processor -- start 2024-05-03T16:43:54.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.450+0000 7f1c93400700 1 -- start start 2024-05-03T16:43:54.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.450+0000 7f1c93400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c8c1056c0 0x7f1c8c1a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:54.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.450+0000 7f1c93400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c8c106080 0x7f1c8c1a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:54.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.450+0000 7f1c93400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c8c10b6c0 0x7f1c8c19ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:54.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.450+0000 7f1c93400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8c115800 con 0x7f1c8c1056c0 2024-05-03T16:43:54.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.450+0000 7f1c93400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8c115680 con 0x7f1c8c10b6c0 2024-05-03T16:43:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.450+0000 7f1c93400700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8c115980 con 0x7f1c8c106080 2024-05-03T16:43:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.451+0000 7f1c90a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c8c1056c0 0x7f1c8c1a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.451+0000 7f1c90a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c8c1056c0 0x7f1c8c1a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45046/0 (socket says 172.21.15.81:45046) 2024-05-03T16:43:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.451+0000 7f1c90a00700 1 -- 172.21.15.81:0/234027838 learned_addr learned my addr 172.21.15.81:0/234027838 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:43:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.451+0000 7f1c8be00700 1 --2- 172.21.15.81:0/234027838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c8c106080 0x7f1c8c1a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.451+0000 7f1c91400700 1 --2- 172.21.15.81:0/234027838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c8c10b6c0 0x7f1c8c19ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.451+0000 7f1c90a00700 1 -- 172.21.15.81:0/234027838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c8c106080 msgr2=0x7f1c8c1a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.451+0000 7f1c90a00700 1 --2- 172.21.15.81:0/234027838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c8c106080 0x7f1c8c1a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.451+0000 7f1c90a00700 1 -- 172.21.15.81:0/234027838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c8c10b6c0 msgr2=0x7f1c8c19ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.451+0000 7f1c90a00700 1 --2- 172.21.15.81:0/234027838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c8c10b6c0 0x7f1c8c19ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.451+0000 7f1c90a00700 1 -- 172.21.15.81:0/234027838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c8c19c1a0 con 0x7f1c8c1056c0 2024-05-03T16:43:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.452+0000 7f1c90a00700 1 --2- 172.21.15.81:0/234027838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c8c1056c0 0x7f1c8c1a1880 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1c8000d980 tx=0x7f1c8000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.452+0000 7f1c89600700 1 -- 172.21.15.81:0/234027838 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c80017070 con 0x7f1c8c1056c0 2024-05-03T16:43:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.452+0000 7f1c89600700 1 -- 172.21.15.81:0/234027838 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c80004830 con 0x7f1c8c1056c0 2024-05-03T16:43:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.452+0000 7f1c89600700 1 -- 172.21.15.81:0/234027838 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c800053a0 con 0x7f1c8c1056c0 2024-05-03T16:43:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.452+0000 7f1c93400700 1 -- 172.21.15.81:0/234027838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c8c19c490 con 0x7f1c8c1056c0 2024-05-03T16:43:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.452+0000 7f1c93400700 1 -- 172.21.15.81:0/234027838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c8c1a8750 con 0x7f1c8c1056c0 2024-05-03T16:43:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.453+0000 7f1c93400700 1 -- 172.21.15.81:0/234027838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c8c06a190 con 0x7f1c8c1056c0 2024-05-03T16:43:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.456+0000 7f1c89600700 1 -- 172.21.15.81:0/234027838 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f1c800049e0 con 0x7f1c8c1056c0 2024-05-03T16:43:54.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.457+0000 7f1c89600700 1 --2- 172.21.15.81:0/234027838 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f1c740b2900 0x7f1c740b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.457+0000 7f1c89600700 1 -- 172.21.15.81:0/234027838 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7497+0+0 (secure 0 0 0) 0x7f1c800e2250 con 0x7f1c8c1056c0 2024-05-03T16:43:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.457+0000 7f1c8be00700 1 --2- 172.21.15.81:0/234027838 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f1c740b2900 0x7f1c740b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.458+0000 7f1c8be00700 1 --2- 172.21.15.81:0/234027838 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f1c740b2900 0x7f1c740b4dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1c78005ea0 tx=0x7f1c78005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.460+0000 7f1c89600700 1 -- 172.21.15.81:0/234027838 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f1c80020020 con 0x7f1c8c1056c0 2024-05-03T16:43:54.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.694+0000 7f1c93400700 1 -- 172.21.15.81:0/234027838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f1c8c02e510 con 0x7f1c8c1056c0 2024-05-03T16:43:54.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.886+0000 7f1c89600700 1 -- 172.21.15.81:0/234027838 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v77) ==== 171+0+0 (secure 0 0 0) 0x7f1c800aa280 con 0x7f1c8c1056c0 2024-05-03T16:43:54.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.891+0000 7f1c93400700 1 -- 172.21.15.81:0/234027838 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f1c740b2900 msgr2=0x7f1c740b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:54.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.891+0000 7f1c93400700 1 --2- 172.21.15.81:0/234027838 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f1c740b2900 0x7f1c740b4dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1c78005ea0 tx=0x7f1c78005e30 comp rx=0 tx=0).stop 2024-05-03T16:43:54.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.891+0000 7f1c93400700 1 -- 172.21.15.81:0/234027838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c8c1056c0 msgr2=0x7f1c8c1a1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:54.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.891+0000 7f1c93400700 1 --2- 172.21.15.81:0/234027838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c8c1056c0 0x7f1c8c1a1880 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1c8000d980 tx=0x7f1c8000dd40 comp rx=0 tx=0).stop 2024-05-03T16:43:54.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.891+0000 7f1c93400700 1 -- 172.21.15.81:0/234027838 shutdown_connections 2024-05-03T16:43:54.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.891+0000 7f1c93400700 1 --2- 172.21.15.81:0/234027838 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f1c740b2900 0x7f1c740b4dc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:54.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.891+0000 7f1c93400700 1 --2- 172.21.15.81:0/234027838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c8c10b6c0 0x7f1c8c19ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:54.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.891+0000 7f1c93400700 1 --2- 172.21.15.81:0/234027838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c8c1056c0 0x7f1c8c1a1880 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:54.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.891+0000 7f1c93400700 1 --2- 172.21.15.81:0/234027838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c8c106080 0x7f1c8c1a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:54.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.891+0000 7f1c93400700 1 -- 172.21.15.81:0/234027838 >> 172.21.15.81:0/234027838 conn(0x7f1c8c1011b0 msgr2=0x7f1c8c1016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:54.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.891+0000 7f1c93400700 1 -- 172.21.15.81:0/234027838 shutdown_connections 2024-05-03T16:43:54.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:54.892+0000 7f1c93400700 1 -- 172.21.15.81:0/234027838 wait complete. 2024-05-03T16:43:54.895 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-05-03T16:43:55.145 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:54 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/234027838' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-03T16:43:55.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:54 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/234027838' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-03T16:43:55.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:54 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/234027838' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-03T16:43:55.768 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-03T16:43:55.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:55 smithi081 ceph-mon[28640]: pgmap v361: 33 pgs: 8 creating+peering, 10 active+clean, 15 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:55.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:55 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/234027838' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-03T16:43:55.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:55 smithi081 ceph-mon[28640]: osdmap e77: 12 total, 12 up, 12 in 2024-05-03T16:43:56.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:55 smithi134 ceph-mon[31708]: pgmap v361: 33 pgs: 8 creating+peering, 10 active+clean, 15 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:56.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:55 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/234027838' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-03T16:43:56.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:55 smithi134 ceph-mon[31708]: osdmap e77: 12 total, 12 up, 12 in 2024-05-03T16:43:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:43:56.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:55 smithi146 ceph-mon[32357]: pgmap v361: 33 pgs: 8 creating+peering, 10 active+clean, 15 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:56.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:55 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/234027838' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-03T16:43:56.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:55 smithi146 ceph-mon[32357]: osdmap e77: 12 total, 12 up, 12 in 2024-05-03T16:43:56.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:56 smithi081 ceph-mon[28640]: osdmap e78: 12 total, 12 up, 12 in 2024-05-03T16:43:57.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:56 smithi134 ceph-mon[31708]: osdmap e78: 12 total, 12 up, 12 in 2024-05-03T16:43:57.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:56 smithi146 ceph-mon[32357]: osdmap e78: 12 total, 12 up, 12 in 2024-05-03T16:43:58.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:57 smithi134 ceph-mon[31708]: pgmap v364: 97 pgs: 25 creating+peering, 37 active+clean, 35 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:58.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:57 smithi134 ceph-mon[31708]: osdmap e79: 12 total, 12 up, 12 in 2024-05-03T16:43:58.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:57 smithi081 ceph-mon[28640]: pgmap v364: 97 pgs: 25 creating+peering, 37 active+clean, 35 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:58.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:57 smithi081 ceph-mon[28640]: osdmap e79: 12 total, 12 up, 12 in 2024-05-03T16:43:58.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:57 smithi146 ceph-mon[32357]: pgmap v364: 97 pgs: 25 creating+peering, 37 active+clean, 35 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:43:58.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:57 smithi146 ceph-mon[32357]: osdmap e79: 12 total, 12 up, 12 in 2024-05-03T16:43:58.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.442+0000 7f0da3200700 1 -- 172.21.15.81:0/656455022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d9c101a90 msgr2=0x7f0d9c101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:58.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.442+0000 7f0da3200700 1 --2- 172.21.15.81:0/656455022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d9c101a90 0x7f0d9c101f10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009990 tx=0x7f0d84009ca0 comp rx=0 tx=0).stop 2024-05-03T16:43:58.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.442+0000 7f0da3200700 1 -- 172.21.15.81:0/656455022 shutdown_connections 2024-05-03T16:43:58.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.442+0000 7f0da3200700 1 --2- 172.21.15.81:0/656455022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d9c102450 0x7f0d9c110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:58.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.442+0000 7f0da3200700 1 --2- 172.21.15.81:0/656455022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d9c109520 0x7f0d9c109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:58.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.442+0000 7f0da3200700 1 --2- 172.21.15.81:0/656455022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d9c101a90 0x7f0d9c101f10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:58.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.442+0000 7f0da3200700 1 -- 172.21.15.81:0/656455022 >> 172.21.15.81:0/656455022 conn(0x7f0d9c078a10 msgr2=0x7f0d9c0ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:58.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.443+0000 7f0da3200700 1 -- 172.21.15.81:0/656455022 shutdown_connections 2024-05-03T16:43:58.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.443+0000 7f0da3200700 1 -- 172.21.15.81:0/656455022 wait complete. 2024-05-03T16:43:58.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.444+0000 7f0da3200700 1 Processor -- start 2024-05-03T16:43:58.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.444+0000 7f0da3200700 1 -- start start 2024-05-03T16:43:58.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.445+0000 7f0da3200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d9c101a90 0x7f0d9c19f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:58.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.445+0000 7f0da3200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d9c102450 0x7f0d9c19fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:58.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.445+0000 7f0da3200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d9c109520 0x7f0d9c199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:58.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.445+0000 7f0da3200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c113550 con 0x7f0d9c109520 2024-05-03T16:43:58.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.445+0000 7f0da3200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c1133d0 con 0x7f0d9c102450 2024-05-03T16:43:58.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.445+0000 7f0da3200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c1136d0 con 0x7f0d9c101a90 2024-05-03T16:43:58.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.445+0000 7f0da1200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d9c109520 0x7f0d9c199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:58.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.445+0000 7f0da1200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d9c109520 0x7f0d9c199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34162/0 (socket says 172.21.15.81:34162) 2024-05-03T16:43:58.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.445+0000 7f0da1200700 1 -- 172.21.15.81:0/1297960015 learned_addr learned my addr 172.21.15.81:0/1297960015 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:43:58.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.445+0000 7f0d9b400700 1 --2- 172.21.15.81:0/1297960015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d9c102450 0x7f0d9c19fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:58.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.445+0000 7f0d9be00700 1 --2- 172.21.15.81:0/1297960015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d9c101a90 0x7f0d9c19f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:58.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.446+0000 7f0da1200700 1 -- 172.21.15.81:0/1297960015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d9c101a90 msgr2=0x7f0d9c19f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:58.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.446+0000 7f0da1200700 1 --2- 172.21.15.81:0/1297960015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d9c101a90 0x7f0d9c19f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:58.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.446+0000 7f0da1200700 1 -- 172.21.15.81:0/1297960015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d9c102450 msgr2=0x7f0d9c19fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:58.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.446+0000 7f0da1200700 1 --2- 172.21.15.81:0/1297960015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d9c102450 0x7f0d9c19fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:58.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.446+0000 7f0da1200700 1 -- 172.21.15.81:0/1297960015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c199ff0 con 0x7f0d9c109520 2024-05-03T16:43:58.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.446+0000 7f0da1200700 1 --2- 172.21.15.81:0/1297960015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d9c109520 0x7f0d9c199890 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400ada0 tx=0x7f0d9400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:58.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.446+0000 7f0d98c00700 1 -- 172.21.15.81:0/1297960015 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94017020 con 0x7f0d9c109520 2024-05-03T16:43:58.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.446+0000 7f0d98c00700 1 -- 172.21.15.81:0/1297960015 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d9400ce10 con 0x7f0d9c109520 2024-05-03T16:43:58.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.446+0000 7f0da3200700 1 -- 172.21.15.81:0/1297960015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9c19a2e0 con 0x7f0d9c109520 2024-05-03T16:43:58.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.446+0000 7f0d98c00700 1 -- 172.21.15.81:0/1297960015 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94005440 con 0x7f0d9c109520 2024-05-03T16:43:58.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.446+0000 7f0da3200700 1 -- 172.21.15.81:0/1297960015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9c1a65a0 con 0x7f0d9c109520 2024-05-03T16:43:58.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.447+0000 7f0da3200700 1 -- 172.21.15.81:0/1297960015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d9c06a190 con 0x7f0d9c109520 2024-05-03T16:43:58.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.450+0000 7f0d98c00700 1 -- 172.21.15.81:0/1297960015 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0d94004ad0 con 0x7f0d9c109520 2024-05-03T16:43:58.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.451+0000 7f0d98c00700 1 --2- 172.21.15.81:0/1297960015 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0d800b2880 0x7f0d800b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:43:58.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.452+0000 7f0d98c00700 1 -- 172.21.15.81:0/1297960015 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7f0d940e1ea0 con 0x7f0d9c109520 2024-05-03T16:43:58.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.452+0000 7f0d9be00700 1 --2- 172.21.15.81:0/1297960015 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0d800b2880 0x7f0d800b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:43:58.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.452+0000 7f0d9be00700 1 --2- 172.21.15.81:0/1297960015 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0d800b2880 0x7f0d800b4d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c005fd0 tx=0x7f0d8c00af00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:43:58.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.455+0000 7f0d98c00700 1 -- 172.21.15.81:0/1297960015 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0d94021020 con 0x7f0d9c109520 2024-05-03T16:43:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.733+0000 7f0da3200700 1 -- 172.21.15.81:0/1297960015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0d9c02e6d0 con 0x7f0d9c109520 2024-05-03T16:43:58.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.935+0000 7f0d98c00700 1 -- 172.21.15.81:0/1297960015 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f0d940a9d60 con 0x7f0d9c109520 2024-05-03T16:43:58.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.939+0000 7f0da3200700 1 -- 172.21.15.81:0/1297960015 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0d800b2880 msgr2=0x7f0d800b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:58.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.939+0000 7f0da3200700 1 --2- 172.21.15.81:0/1297960015 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0d800b2880 0x7f0d800b4d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c005fd0 tx=0x7f0d8c00af00 comp rx=0 tx=0).stop 2024-05-03T16:43:58.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.939+0000 7f0da3200700 1 -- 172.21.15.81:0/1297960015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d9c109520 msgr2=0x7f0d9c199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:43:58.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.939+0000 7f0da3200700 1 --2- 172.21.15.81:0/1297960015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d9c109520 0x7f0d9c199890 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400ada0 tx=0x7f0d9400c330 comp rx=0 tx=0).stop 2024-05-03T16:43:58.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.939+0000 7f0da3200700 1 -- 172.21.15.81:0/1297960015 shutdown_connections 2024-05-03T16:43:58.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.939+0000 7f0da3200700 1 --2- 172.21.15.81:0/1297960015 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0d800b2880 0x7f0d800b4d40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:58.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.939+0000 7f0da3200700 1 --2- 172.21.15.81:0/1297960015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d9c101a90 0x7f0d9c19f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:58.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.939+0000 7f0da3200700 1 --2- 172.21.15.81:0/1297960015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d9c109520 0x7f0d9c199890 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:58.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.939+0000 7f0da3200700 1 --2- 172.21.15.81:0/1297960015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d9c102450 0x7f0d9c19fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:43:58.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.939+0000 7f0da3200700 1 -- 172.21.15.81:0/1297960015 >> 172.21.15.81:0/1297960015 conn(0x7f0d9c078a10 msgr2=0x7f0d9c100260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:43:58.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.939+0000 7f0da3200700 1 -- 172.21.15.81:0/1297960015 shutdown_connections 2024-05-03T16:43:58.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:43:58.939+0000 7f0da3200700 1 -- 172.21.15.81:0/1297960015 wait complete. 2024-05-03T16:43:58.942 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 2 and data pool 3 2024-05-03T16:43:58.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:58 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1297960015' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-03T16:43:58.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:58 smithi081 ceph-mon[28640]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-03T16:43:58.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:58 smithi081 ceph-mon[28640]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T16:43:59.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:58 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/1297960015' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-03T16:43:59.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:58 smithi134 ceph-mon[31708]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-03T16:43:59.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:58 smithi134 ceph-mon[31708]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T16:43:59.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:58 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/1297960015' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-03T16:43:59.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:58 smithi146 ceph-mon[32357]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-03T16:43:59.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:58 smithi146 ceph-mon[32357]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T16:43:59.909 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-03T16:43:59.909 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-03T16:44:00.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:59 smithi134 ceph-mon[31708]: pgmap v366: 97 pgs: 25 creating+peering, 64 active+clean, 8 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:00.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:59 smithi134 ceph-mon[31708]: osdmap e80: 12 total, 12 up, 12 in 2024-05-03T16:44:00.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:59 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/1297960015' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-03T16:44:00.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:59 smithi134 ceph-mon[31708]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-03T16:44:00.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:43:59 smithi134 ceph-mon[31708]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-03T16:44:00.242 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:59 smithi081 ceph-mon[28640]: pgmap v366: 97 pgs: 25 creating+peering, 64 active+clean, 8 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:00.242 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:59 smithi081 ceph-mon[28640]: osdmap e80: 12 total, 12 up, 12 in 2024-05-03T16:44:00.242 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:59 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1297960015' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-03T16:44:00.242 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:59 smithi081 ceph-mon[28640]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-03T16:44:00.242 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:43:59 smithi081 ceph-mon[28640]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-03T16:44:00.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:59 smithi146 ceph-mon[32357]: pgmap v366: 97 pgs: 25 creating+peering, 64 active+clean, 8 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:00.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:59 smithi146 ceph-mon[32357]: osdmap e80: 12 total, 12 up, 12 in 2024-05-03T16:44:00.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:59 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/1297960015' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-03T16:44:00.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:59 smithi146 ceph-mon[32357]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-03T16:44:00.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:43:59 smithi146 ceph-mon[32357]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-03T16:44:00.358 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:44:01.133 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:00 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] up:active 2024-05-03T16:44:01.133 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:00 smithi081 ceph-mon[28640]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T16:44:01.133 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:00 smithi081 ceph-mon[28640]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T16:44:01.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:00 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] up:active 2024-05-03T16:44:01.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:00 smithi134 ceph-mon[31708]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T16:44:01.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:00 smithi134 ceph-mon[31708]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T16:44:01.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:00 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] up:active 2024-05-03T16:44:01.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:00 smithi146 ceph-mon[32357]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T16:44:01.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:00 smithi146 ceph-mon[32357]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T16:44:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:01 smithi134 ceph-mon[31708]: pgmap v368: 97 pgs: 17 creating+peering, 80 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1 op/s 2024-05-03T16:44:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:01 smithi134 ceph-mon[31708]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-03T16:44:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:01 smithi134 ceph-mon[31708]: Cluster is now healthy 2024-05-03T16:44:02.231 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:01 smithi081 ceph-mon[28640]: pgmap v368: 97 pgs: 17 creating+peering, 80 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1 op/s 2024-05-03T16:44:02.232 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:01 smithi081 ceph-mon[28640]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-03T16:44:02.232 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:01 smithi081 ceph-mon[28640]: Cluster is now healthy 2024-05-03T16:44:02.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:01 smithi146 ceph-mon[32357]: pgmap v368: 97 pgs: 17 creating+peering, 80 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1 op/s 2024-05-03T16:44:02.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:01 smithi146 ceph-mon[32357]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-03T16:44:02.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:01 smithi146 ceph-mon[32357]: Cluster is now healthy 2024-05-03T16:44:02.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.768+0000 7f4433600700 1 -- 172.21.15.81:0/596261373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c075ff0 msgr2=0x7f442c10f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:02.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.768+0000 7f4433600700 1 --2- 172.21.15.81:0/596261373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c075ff0 0x7f442c10f9c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4418009990 tx=0x7f4418009ca0 comp rx=0 tx=0).stop 2024-05-03T16:44:02.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.768+0000 7f4433600700 1 -- 172.21.15.81:0/596261373 shutdown_connections 2024-05-03T16:44:02.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.768+0000 7f4433600700 1 --2- 172.21.15.81:0/596261373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f442c0756d0 0x7f442c075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:02.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.768+0000 7f4433600700 1 --2- 172.21.15.81:0/596261373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f442c10ff00 0x7f442c1122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:02.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.768+0000 7f4433600700 1 --2- 172.21.15.81:0/596261373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c075ff0 0x7f442c10f9c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:02.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.768+0000 7f4433600700 1 -- 172.21.15.81:0/596261373 >> 172.21.15.81:0/596261373 conn(0x7f442c07a600 msgr2=0x7f442c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:02.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.768+0000 7f4433600700 1 -- 172.21.15.81:0/596261373 shutdown_connections 2024-05-03T16:44:02.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.768+0000 7f4433600700 1 -- 172.21.15.81:0/596261373 wait complete. 2024-05-03T16:44:02.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.769+0000 7f4433600700 1 Processor -- start 2024-05-03T16:44:02.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.769+0000 7f4433600700 1 -- start start 2024-05-03T16:44:02.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.770+0000 7f4433600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f442c0756d0 0x7f442c1a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:02.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.770+0000 7f4433600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c075ff0 0x7f442c1a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:02.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.770+0000 7f4433600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f442c10ff00 0x7f442c19ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:02.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.770+0000 7f4433600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f442c115750 con 0x7f442c075ff0 2024-05-03T16:44:02.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.770+0000 7f4433600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f442c1155d0 con 0x7f442c10ff00 2024-05-03T16:44:02.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.770+0000 7f4433600700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f442c1158d0 con 0x7f442c0756d0 2024-05-03T16:44:02.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.770+0000 7f442be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c075ff0 0x7f442c1a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:02.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.770+0000 7f442be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c075ff0 0x7f442c1a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34174/0 (socket says 172.21.15.81:34174) 2024-05-03T16:44:02.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.770+0000 7f442be00700 1 -- 172.21.15.81:0/2319478360 learned_addr learned my addr 172.21.15.81:0/2319478360 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:44:02.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.770+0000 7f4430c00700 1 --2- 172.21.15.81:0/2319478360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f442c0756d0 0x7f442c1a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:02.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.771+0000 7f4431600700 1 --2- 172.21.15.81:0/2319478360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f442c10ff00 0x7f442c19ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:02.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.771+0000 7f442be00700 1 -- 172.21.15.81:0/2319478360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f442c0756d0 msgr2=0x7f442c1a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:02.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.771+0000 7f442be00700 1 --2- 172.21.15.81:0/2319478360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f442c0756d0 0x7f442c1a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:02.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.771+0000 7f442be00700 1 -- 172.21.15.81:0/2319478360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f442c10ff00 msgr2=0x7f442c19ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:02.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.771+0000 7f442be00700 1 --2- 172.21.15.81:0/2319478360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f442c10ff00 0x7f442c19ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:02.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.771+0000 7f442be00700 1 -- 172.21.15.81:0/2319478360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442c19c1b0 con 0x7f442c075ff0 2024-05-03T16:44:02.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.771+0000 7f4430c00700 1 --2- 172.21.15.81:0/2319478360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f442c0756d0 0x7f442c1a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:44:02.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.771+0000 7f442be00700 1 --2- 172.21.15.81:0/2319478360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c075ff0 0x7f442c1a1d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4418006010 tx=0x7f4418005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:02.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.771+0000 7f4429600700 1 -- 172.21.15.81:0/2319478360 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4418027070 con 0x7f442c075ff0 2024-05-03T16:44:02.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.771+0000 7f4429600700 1 -- 172.21.15.81:0/2319478360 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f441800fb90 con 0x7f442c075ff0 2024-05-03T16:44:02.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.771+0000 7f4429600700 1 -- 172.21.15.81:0/2319478360 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44180173f0 con 0x7f442c075ff0 2024-05-03T16:44:02.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.771+0000 7f4433600700 1 -- 172.21.15.81:0/2319478360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442c19c440 con 0x7f442c075ff0 2024-05-03T16:44:02.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.772+0000 7f4433600700 1 -- 172.21.15.81:0/2319478360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f442c1a8710 con 0x7f442c075ff0 2024-05-03T16:44:02.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.773+0000 7f4433600700 1 -- 172.21.15.81:0/2319478360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f442c076d90 con 0x7f442c075ff0 2024-05-03T16:44:02.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.775+0000 7f4429600700 1 -- 172.21.15.81:0/2319478360 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f441802a070 con 0x7f442c075ff0 2024-05-03T16:44:02.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.776+0000 7f4429600700 1 --2- 172.21.15.81:0/2319478360 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f44140b2900 0x7f44140b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:02.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.777+0000 7f4429600700 1 -- 172.21.15.81:0/2319478360 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f44180e3340 con 0x7f442c075ff0 2024-05-03T16:44:02.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.777+0000 7f4430c00700 1 --2- 172.21.15.81:0/2319478360 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f44140b2900 0x7f44140b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:02.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.777+0000 7f4430c00700 1 --2- 172.21.15.81:0/2319478360 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f44140b2900 0x7f44140b4dc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f442c07ae00 tx=0x7f4420009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:02.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:02.779+0000 7f4429600700 1 -- 172.21.15.81:0/2319478360 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4418013070 con 0x7f442c075ff0 2024-05-03T16:44:03.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:03.022+0000 7f4433600700 1 -- 172.21.15.81:0/2319478360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f442c02e510 con 0x7f442c075ff0 2024-05-03T16:44:03.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:03.978+0000 7f4429600700 1 -- 172.21.15.81:0/2319478360 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v81) ==== 157+0+0 (secure 0 0 0) 0x7f44180ab1a0 con 0x7f442c075ff0 2024-05-03T16:44:03.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:03.983+0000 7f4433600700 1 -- 172.21.15.81:0/2319478360 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f44140b2900 msgr2=0x7f44140b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:03.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:03.983+0000 7f4433600700 1 --2- 172.21.15.81:0/2319478360 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f44140b2900 0x7f44140b4dc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f442c07ae00 tx=0x7f4420009260 comp rx=0 tx=0).stop 2024-05-03T16:44:03.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:03.983+0000 7f4433600700 1 -- 172.21.15.81:0/2319478360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c075ff0 msgr2=0x7f442c1a1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:03.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:03.983+0000 7f4433600700 1 --2- 172.21.15.81:0/2319478360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c075ff0 0x7f442c1a1d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4418006010 tx=0x7f4418005e80 comp rx=0 tx=0).stop 2024-05-03T16:44:03.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:03.984+0000 7f4433600700 1 -- 172.21.15.81:0/2319478360 shutdown_connections 2024-05-03T16:44:03.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:03.984+0000 7f4433600700 1 --2- 172.21.15.81:0/2319478360 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f44140b2900 0x7f44140b4dc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:03.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:03.984+0000 7f4433600700 1 --2- 172.21.15.81:0/2319478360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f442c0756d0 0x7f442c1a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:03.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:03.984+0000 7f4433600700 1 --2- 172.21.15.81:0/2319478360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f442c10ff00 0x7f442c19ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:03.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:03.984+0000 7f4433600700 1 --2- 172.21.15.81:0/2319478360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c075ff0 0x7f442c1a1d80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:03.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:03.984+0000 7f4433600700 1 -- 172.21.15.81:0/2319478360 >> 172.21.15.81:0/2319478360 conn(0x7f442c07a600 msgr2=0x7f442c100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:03.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:03.984+0000 7f4433600700 1 -- 172.21.15.81:0/2319478360 shutdown_connections 2024-05-03T16:44:03.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:03.984+0000 7f4433600700 1 -- 172.21.15.81:0/2319478360 wait complete. 2024-05-03T16:44:04.179 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:03 smithi081 ceph-mon[28640]: pgmap v369: 97 pgs: 97 active+clean; 578 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 964 B/s wr, 5 op/s 2024-05-03T16:44:04.179 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:03 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2319478360' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-03T16:44:04.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:03 smithi146 ceph-mon[32357]: pgmap v369: 97 pgs: 97 active+clean; 578 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 964 B/s wr, 5 op/s 2024-05-03T16:44:04.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:03 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2319478360' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-03T16:44:04.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:03 smithi134 ceph-mon[31708]: pgmap v369: 97 pgs: 97 active+clean; 578 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 964 B/s wr, 5 op/s 2024-05-03T16:44:04.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:03 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2319478360' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-03T16:44:04.948 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-03T16:44:04.966 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 16:44:04 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-b[62229]: 2024-05-03T16:44:04.671+0000 7f4c9ac00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-03T16:44:05.138 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:04 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2319478360' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-03T16:44:05.139 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:04 smithi081 ceph-mon[28640]: osdmap e81: 12 total, 12 up, 12 in 2024-05-03T16:44:05.139 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-05-03T16:44:05.139 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-05-03T16:44:05.139 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-05-03T16:44:05.139 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2024-05-03T16:44:05.139 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-05-03T16:44:05.139 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-05-03T16:44:05.139 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-05-03T16:44:05.139 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-05-03T16:44:05.139 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-05-03T16:44:05.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:04 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2319478360' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-03T16:44:05.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:04 smithi146 ceph-mon[32357]: osdmap e81: 12 total, 12 up, 12 in 2024-05-03T16:44:05.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:04 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-05-03T16:44:05.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:04 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-05-03T16:44:05.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:04 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-05-03T16:44:05.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:04 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2024-05-03T16:44:05.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:04 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-05-03T16:44:05.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:04 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-05-03T16:44:05.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:04 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-05-03T16:44:05.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:04 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-05-03T16:44:05.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:04 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-05-03T16:44:05.387 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:44:05.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:04 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2319478360' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-03T16:44:05.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:04 smithi134 ceph-mon[31708]: osdmap e81: 12 total, 12 up, 12 in 2024-05-03T16:44:05.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:04 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-05-03T16:44:05.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:04 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-05-03T16:44:05.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:04 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-05-03T16:44:05.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:04 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2024-05-03T16:44:05.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:04 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-05-03T16:44:05.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:04 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-05-03T16:44:05.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:04 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-05-03T16:44:05.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:04 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-05-03T16:44:05.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:04 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-05-03T16:44:06.041 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:06 smithi081 ceph-mon[28640]: pgmap v371: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-05-03T16:44:06.041 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:06 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-05-03T16:44:06.041 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:06 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-05-03T16:44:06.041 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:06 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-05-03T16:44:06.041 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:06 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2024-05-03T16:44:06.041 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:06 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-05-03T16:44:06.042 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:06 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-05-03T16:44:06.042 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:06 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-05-03T16:44:06.042 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:06 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-05-03T16:44:06.042 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:06 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-05-03T16:44:06.042 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:06 smithi081 ceph-mon[28640]: osdmap e82: 12 total, 12 up, 12 in 2024-05-03T16:44:06.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:06 smithi146 ceph-mon[32357]: pgmap v371: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-05-03T16:44:06.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:06 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-05-03T16:44:06.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:06 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-05-03T16:44:06.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:06 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-05-03T16:44:06.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:06 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2024-05-03T16:44:06.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:06 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-05-03T16:44:06.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:06 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-05-03T16:44:06.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:06 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-05-03T16:44:06.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:06 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-05-03T16:44:06.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:06 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-05-03T16:44:06.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:06 smithi146 ceph-mon[32357]: osdmap e82: 12 total, 12 up, 12 in 2024-05-03T16:44:06.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:06 smithi134 ceph-mon[31708]: pgmap v371: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-05-03T16:44:06.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:06 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-05-03T16:44:06.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:06 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-05-03T16:44:06.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:06 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-05-03T16:44:06.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:06 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2024-05-03T16:44:06.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:06 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-05-03T16:44:06.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:06 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-05-03T16:44:06.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:06 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-05-03T16:44:06.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:06 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-05-03T16:44:06.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:06 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-05-03T16:44:06.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:06 smithi134 ceph-mon[31708]: osdmap e82: 12 total, 12 up, 12 in 2024-05-03T16:44:07.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:07 smithi134 ceph-mon[31708]: osdmap e83: 12 total, 12 up, 12 in 2024-05-03T16:44:07.223 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:07 smithi081 ceph-mon[28640]: osdmap e83: 12 total, 12 up, 12 in 2024-05-03T16:44:07.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:07 smithi146 ceph-mon[32357]: osdmap e83: 12 total, 12 up, 12 in 2024-05-03T16:44:07.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.792+0000 7f1355c00700 1 -- 172.21.15.81:0/2857521657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135006b3e0 msgr2=0x7f135006b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.792+0000 7f1355c00700 1 --2- 172.21.15.81:0/2857521657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135006b3e0 0x7f135006b7c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f134000b0d0 tx=0x7f134000b3e0 comp rx=0 tx=0).stop 2024-05-03T16:44:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.792+0000 7f1355c00700 1 -- 172.21.15.81:0/2857521657 shutdown_connections 2024-05-03T16:44:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.792+0000 7f1355c00700 1 --2- 172.21.15.81:0/2857521657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1350108860 0x7f13501103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.792+0000 7f1355c00700 1 --2- 172.21.15.81:0/2857521657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135006b3e0 0x7f135006b7c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.792+0000 7f1355c00700 1 --2- 172.21.15.81:0/2857521657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f135006bd90 0x7f1350108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.792+0000 7f1355c00700 1 -- 172.21.15.81:0/2857521657 >> 172.21.15.81:0/2857521657 conn(0x7f1350079340 msgr2=0x7f1350079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.792+0000 7f1355c00700 1 -- 172.21.15.81:0/2857521657 shutdown_connections 2024-05-03T16:44:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.792+0000 7f1355c00700 1 -- 172.21.15.81:0/2857521657 wait complete. 2024-05-03T16:44:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.794+0000 7f1355c00700 1 Processor -- start 2024-05-03T16:44:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.794+0000 7f1355c00700 1 -- start start 2024-05-03T16:44:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.794+0000 7f1355c00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f135006b3e0 0x7f1350102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.794+0000 7f1355c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f135006bd90 0x7f13501029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.794+0000 7f1355c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1350108860 0x7f1350102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.794+0000 7f1355c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1350113530 con 0x7f1350108860 2024-05-03T16:44:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.794+0000 7f1355c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f13501133b0 con 0x7f135006bd90 2024-05-03T16:44:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.794+0000 7f1355c00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f13501136b0 con 0x7f135006b3e0 2024-05-03T16:44:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.794+0000 7f134f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1350108860 0x7f1350102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.795+0000 7f134f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1350108860 0x7f1350102ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59424/0 (socket says 172.21.15.81:59424) 2024-05-03T16:44:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.795+0000 7f134f400700 1 -- 172.21.15.81:0/59126611 learned_addr learned my addr 172.21.15.81:0/59126611 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:44:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.795+0000 7f134ea00700 1 --2- 172.21.15.81:0/59126611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f135006b3e0 0x7f1350102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.795+0000 7f1346000700 1 --2- 172.21.15.81:0/59126611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f135006bd90 0x7f13501029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.795+0000 7f134f400700 1 -- 172.21.15.81:0/59126611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f135006b3e0 msgr2=0x7f1350102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.795+0000 7f134f400700 1 --2- 172.21.15.81:0/59126611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f135006b3e0 0x7f1350102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.795+0000 7f134f400700 1 -- 172.21.15.81:0/59126611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f135006bd90 msgr2=0x7f13501029b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.795+0000 7f134f400700 1 --2- 172.21.15.81:0/59126611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f135006bd90 0x7f13501029b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.795+0000 7f134f400700 1 -- 172.21.15.81:0/59126611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13501a7ec0 con 0x7f1350108860 2024-05-03T16:44:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.795+0000 7f134ea00700 1 --2- 172.21.15.81:0/59126611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f135006b3e0 0x7f1350102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:44:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.795+0000 7f134f400700 1 --2- 172.21.15.81:0/59126611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1350108860 0x7f1350102ef0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f134800c970 tx=0x7f134800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.796+0000 7f1347e00700 1 -- 172.21.15.81:0/59126611 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1348007b00 con 0x7f1350108860 2024-05-03T16:44:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.796+0000 7f1355c00700 1 -- 172.21.15.81:0/59126611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13501a81b0 con 0x7f1350108860 2024-05-03T16:44:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.796+0000 7f1347e00700 1 -- 172.21.15.81:0/59126611 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1348004cc0 con 0x7f1350108860 2024-05-03T16:44:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.796+0000 7f1347e00700 1 -- 172.21.15.81:0/59126611 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13480054c0 con 0x7f1350108860 2024-05-03T16:44:07.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.796+0000 7f1355c00700 1 -- 172.21.15.81:0/59126611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13501a86f0 con 0x7f1350108860 2024-05-03T16:44:07.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.797+0000 7f1355c00700 1 -- 172.21.15.81:0/59126611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f135010baa0 con 0x7f1350108860 2024-05-03T16:44:07.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.801+0000 7f1347e00700 1 -- 172.21.15.81:0/59126611 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f1348004750 con 0x7f1350108860 2024-05-03T16:44:07.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.803+0000 7f1347e00700 1 --2- 172.21.15.81:0/59126611 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f13340b29b0 0x7f13340b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:07.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.803+0000 7f1347e00700 1 -- 172.21.15.81:0/59126611 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8538+0+0 (secure 0 0 0) 0x7f13480e22f0 con 0x7f1350108860 2024-05-03T16:44:07.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.803+0000 7f134ea00700 1 --2- 172.21.15.81:0/59126611 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f13340b29b0 0x7f13340b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:07.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.804+0000 7f134ea00700 1 --2- 172.21.15.81:0/59126611 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f13340b29b0 0x7f13340b4e70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1340009e60 tx=0x7f134000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:07.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:07.805+0000 7f1347e00700 1 -- 172.21.15.81:0/59126611 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f1348014030 con 0x7f1350108860 2024-05-03T16:44:08.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:08.047+0000 7f1355c00700 1 -- 172.21.15.81:0/59126611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f135010b480 con 0x7f1350108860 2024-05-03T16:44:08.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:08 smithi146 ceph-mon[32357]: pgmap v374: 97 pgs: 2 peering, 95 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-05-03T16:44:08.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:08 smithi134 ceph-mon[31708]: pgmap v374: 97 pgs: 2 peering, 95 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-05-03T16:44:08.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:08 smithi081 ceph-mon[28640]: pgmap v374: 97 pgs: 2 peering, 95 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-05-03T16:44:09.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:09 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/59126611' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-03T16:44:09.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:09 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/59126611' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-03T16:44:09.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:09 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/59126611' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-03T16:44:10.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:10.046+0000 7f1347e00700 1 -- 172.21.15.81:0/59126611 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v85) ==== 228+0+0 (secure 0 0 0) 0x7f13480a9f00 con 0x7f1350108860 2024-05-03T16:44:10.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:10.050+0000 7f1355c00700 1 -- 172.21.15.81:0/59126611 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f13340b29b0 msgr2=0x7f13340b4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:10.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:10.050+0000 7f1355c00700 1 --2- 172.21.15.81:0/59126611 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f13340b29b0 0x7f13340b4e70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1340009e60 tx=0x7f134000b040 comp rx=0 tx=0).stop 2024-05-03T16:44:10.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:10.050+0000 7f1355c00700 1 -- 172.21.15.81:0/59126611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1350108860 msgr2=0x7f1350102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:10.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:10.050+0000 7f1355c00700 1 --2- 172.21.15.81:0/59126611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1350108860 0x7f1350102ef0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f134800c970 tx=0x7f134800cd30 comp rx=0 tx=0).stop 2024-05-03T16:44:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:10.051+0000 7f1355c00700 1 -- 172.21.15.81:0/59126611 shutdown_connections 2024-05-03T16:44:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:10.051+0000 7f1355c00700 1 --2- 172.21.15.81:0/59126611 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f13340b29b0 0x7f13340b4e70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:10.051+0000 7f1355c00700 1 --2- 172.21.15.81:0/59126611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f135006b3e0 0x7f1350102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:10.051+0000 7f1355c00700 1 --2- 172.21.15.81:0/59126611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1350108860 0x7f1350102ef0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:10.051+0000 7f1355c00700 1 --2- 172.21.15.81:0/59126611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f135006bd90 0x7f13501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:10.051+0000 7f1355c00700 1 -- 172.21.15.81:0/59126611 >> 172.21.15.81:0/59126611 conn(0x7f1350079340 msgr2=0x7f13501005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:10.051+0000 7f1355c00700 1 -- 172.21.15.81:0/59126611 shutdown_connections 2024-05-03T16:44:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:10.051+0000 7f1355c00700 1 -- 172.21.15.81:0/59126611 wait complete. 2024-05-03T16:44:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data_ec' created 2024-05-03T16:44:10.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:10 smithi134 ceph-mon[31708]: pgmap v375: 97 pgs: 2 peering, 95 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 1 op/s; 102 B/s, 1 keys/s, 0 objects/s recovering 2024-05-03T16:44:10.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:10 smithi134 ceph-mon[31708]: osdmap e84: 12 total, 12 up, 12 in 2024-05-03T16:44:10.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:10 smithi081 ceph-mon[28640]: pgmap v375: 97 pgs: 2 peering, 95 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 1 op/s; 102 B/s, 1 keys/s, 0 objects/s recovering 2024-05-03T16:44:10.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:10 smithi081 ceph-mon[28640]: osdmap e84: 12 total, 12 up, 12 in 2024-05-03T16:44:10.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:10 smithi146 ceph-mon[32357]: pgmap v375: 97 pgs: 2 peering, 95 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 1 op/s; 102 B/s, 1 keys/s, 0 objects/s recovering 2024-05-03T16:44:10.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:10 smithi146 ceph-mon[32357]: osdmap e84: 12 total, 12 up, 12 in 2024-05-03T16:44:11.145 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-03T16:44:11.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:11 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/59126611' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-03T16:44:11.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:11 smithi134 ceph-mon[31708]: osdmap e85: 12 total, 12 up, 12 in 2024-05-03T16:44:11.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:11 smithi134 ceph-mon[31708]: osdmap e86: 12 total, 12 up, 12 in 2024-05-03T16:44:11.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:11 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/59126611' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-03T16:44:11.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:11 smithi081 ceph-mon[28640]: osdmap e85: 12 total, 12 up, 12 in 2024-05-03T16:44:11.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:11 smithi081 ceph-mon[28640]: osdmap e86: 12 total, 12 up, 12 in 2024-05-03T16:44:11.553 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:44:11.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:11 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/59126611' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-03T16:44:11.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:11 smithi146 ceph-mon[32357]: osdmap e85: 12 total, 12 up, 12 in 2024-05-03T16:44:11.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:11 smithi146 ceph-mon[32357]: osdmap e86: 12 total, 12 up, 12 in 2024-05-03T16:44:12.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:12 smithi134 ceph-mon[31708]: pgmap v378: 129 pgs: 32 unknown, 2 peering, 95 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 116 B/s, 1 keys/s, 0 objects/s recovering 2024-05-03T16:44:12.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:12 smithi134 ceph-mon[31708]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T16:44:12.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:12 smithi081 ceph-mon[28640]: pgmap v378: 129 pgs: 32 unknown, 2 peering, 95 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 116 B/s, 1 keys/s, 0 objects/s recovering 2024-05-03T16:44:12.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:12 smithi081 ceph-mon[28640]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T16:44:12.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:12 smithi146 ceph-mon[32357]: pgmap v378: 129 pgs: 32 unknown, 2 peering, 95 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 116 B/s, 1 keys/s, 0 objects/s recovering 2024-05-03T16:44:12.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:12 smithi146 ceph-mon[32357]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T16:44:13.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:13 smithi081 ceph-mon[28640]: osdmap e87: 12 total, 12 up, 12 in 2024-05-03T16:44:13.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:13 smithi081 ceph-mon[28640]: pgmap v381: 129 pgs: 7 creating+peering, 22 unknown, 100 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:13.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:13 smithi134 ceph-mon[31708]: osdmap e87: 12 total, 12 up, 12 in 2024-05-03T16:44:13.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:13 smithi134 ceph-mon[31708]: pgmap v381: 129 pgs: 7 creating+peering, 22 unknown, 100 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:13.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:13 smithi146 ceph-mon[32357]: osdmap e87: 12 total, 12 up, 12 in 2024-05-03T16:44:13.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:13 smithi146 ceph-mon[32357]: pgmap v381: 129 pgs: 7 creating+peering, 22 unknown, 100 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.761+0000 7f8d7be00700 1 -- 172.21.15.81:0/437524840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d7c1143e0 msgr2=0x7f8d7c1167d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.761+0000 7f8d7be00700 1 --2- 172.21.15.81:0/437524840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d7c1143e0 0x7f8d7c1167d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8d74009990 tx=0x7f8d74009ca0 comp rx=0 tx=0).stop 2024-05-03T16:44:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.761+0000 7f8d7be00700 1 -- 172.21.15.81:0/437524840 shutdown_connections 2024-05-03T16:44:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.761+0000 7f8d7be00700 1 --2- 172.21.15.81:0/437524840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d7c1143e0 0x7f8d7c1167d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.761+0000 7f8d7be00700 1 --2- 172.21.15.81:0/437524840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d7c075840 0x7f8d7c075c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.761+0000 7f8d7be00700 1 --2- 172.21.15.81:0/437524840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d7c076160 0x7f8d7c113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.761+0000 7f8d7be00700 1 -- 172.21.15.81:0/437524840 >> 172.21.15.81:0/437524840 conn(0x7f8d7c0fef20 msgr2=0x7f8d7c101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.761+0000 7f8d7be00700 1 -- 172.21.15.81:0/437524840 shutdown_connections 2024-05-03T16:44:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.761+0000 7f8d7be00700 1 -- 172.21.15.81:0/437524840 wait complete. 2024-05-03T16:44:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.762+0000 7f8d7be00700 1 Processor -- start 2024-05-03T16:44:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.763+0000 7f8d7be00700 1 -- start start 2024-05-03T16:44:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.763+0000 7f8d7be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d7c075840 0x7f8d7c19ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.763+0000 7f8d7be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d7c076160 0x7f8d7c1a0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.763+0000 7f8d7be00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d7c1143e0 0x7f8d7c1a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.763+0000 7f8d7be00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c119a90 con 0x7f8d7c075840 2024-05-03T16:44:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.763+0000 7f8d7be00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c119910 con 0x7f8d7c076160 2024-05-03T16:44:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.763+0000 7f8d7be00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c119c10 con 0x7f8d7c1143e0 2024-05-03T16:44:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.763+0000 7f8d7aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d7c075840 0x7f8d7c19ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.763+0000 7f8d7aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d7c075840 0x7f8d7c19ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59450/0 (socket says 172.21.15.81:59450) 2024-05-03T16:44:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.763+0000 7f8d7aa00700 1 -- 172.21.15.81:0/2497305369 learned_addr learned my addr 172.21.15.81:0/2497305369 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:44:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.764+0000 7f8d7b400700 1 --2- 172.21.15.81:0/2497305369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d7c1143e0 0x7f8d7c1a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.764+0000 7f8d72000700 1 --2- 172.21.15.81:0/2497305369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d7c076160 0x7f8d7c1a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.764+0000 7f8d7aa00700 1 -- 172.21.15.81:0/2497305369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d7c1143e0 msgr2=0x7f8d7c1a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.764+0000 7f8d7aa00700 1 --2- 172.21.15.81:0/2497305369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d7c1143e0 0x7f8d7c1a47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.764+0000 7f8d7aa00700 1 -- 172.21.15.81:0/2497305369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d7c076160 msgr2=0x7f8d7c1a0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.764+0000 7f8d7aa00700 1 --2- 172.21.15.81:0/2497305369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d7c076160 0x7f8d7c1a0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.764+0000 7f8d7aa00700 1 -- 172.21.15.81:0/2497305369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7c1a4f00 con 0x7f8d7c075840 2024-05-03T16:44:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.764+0000 7f8d7aa00700 1 --2- 172.21.15.81:0/2497305369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d7c075840 0x7f8d7c19ff40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00d950 tx=0x7f8d6c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.764+0000 7f8d73e00700 1 -- 172.21.15.81:0/2497305369 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c016070 con 0x7f8d7c075840 2024-05-03T16:44:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.765+0000 7f8d73e00700 1 -- 172.21.15.81:0/2497305369 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d6c010460 con 0x7f8d7c075840 2024-05-03T16:44:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.765+0000 7f8d7be00700 1 -- 172.21.15.81:0/2497305369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d7c1a51f0 con 0x7f8d7c075840 2024-05-03T16:44:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.765+0000 7f8d73e00700 1 -- 172.21.15.81:0/2497305369 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c00f620 con 0x7f8d7c075840 2024-05-03T16:44:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.765+0000 7f8d7be00700 1 -- 172.21.15.81:0/2497305369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d7c1aca70 con 0x7f8d7c075840 2024-05-03T16:44:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.766+0000 7f8d7be00700 1 -- 172.21.15.81:0/2497305369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d7c06a190 con 0x7f8d7c075840 2024-05-03T16:44:13.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.768+0000 7f8d73e00700 1 -- 172.21.15.81:0/2497305369 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f8d6c019070 con 0x7f8d7c075840 2024-05-03T16:44:13.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.770+0000 7f8d73e00700 1 --2- 172.21.15.81:0/2497305369 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8d600b2880 0x7f8d600b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:13.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.770+0000 7f8d73e00700 1 -- 172.21.15.81:0/2497305369 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9031+0+0 (secure 0 0 0) 0x7f8d6c0e21a0 con 0x7f8d7c075840 2024-05-03T16:44:13.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.770+0000 7f8d72000700 1 --2- 172.21.15.81:0/2497305369 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8d600b2880 0x7f8d600b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.771+0000 7f8d72000700 1 --2- 172.21.15.81:0/2497305369 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8d600b2880 0x7f8d600b4d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c1071d0 tx=0x7f8d64009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:13.773+0000 7f8d73e00700 1 -- 172.21.15.81:0/2497305369 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8d6c0a9b40 con 0x7f8d7c075840 2024-05-03T16:44:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:14.003+0000 7f8d7be00700 1 -- 172.21.15.81:0/2497305369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f8d7c02e510 con 0x7f8d7c075840 2024-05-03T16:44:14.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:14.111+0000 7f8d73e00700 1 -- 172.21.15.81:0/2497305369 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v88) ==== 169+0+0 (secure 0 0 0) 0x7f8d6c0a9440 con 0x7f8d7c075840 2024-05-03T16:44:14.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:14.115+0000 7f8d7be00700 1 -- 172.21.15.81:0/2497305369 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8d600b2880 msgr2=0x7f8d600b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:14.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:14.115+0000 7f8d7be00700 1 --2- 172.21.15.81:0/2497305369 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8d600b2880 0x7f8d600b4d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c1071d0 tx=0x7f8d64009040 comp rx=0 tx=0).stop 2024-05-03T16:44:14.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:14.115+0000 7f8d7be00700 1 -- 172.21.15.81:0/2497305369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d7c075840 msgr2=0x7f8d7c19ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:14.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:14.115+0000 7f8d7be00700 1 --2- 172.21.15.81:0/2497305369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d7c075840 0x7f8d7c19ff40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00d950 tx=0x7f8d6c00dd10 comp rx=0 tx=0).stop 2024-05-03T16:44:14.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:14.115+0000 7f8d7be00700 1 -- 172.21.15.81:0/2497305369 shutdown_connections 2024-05-03T16:44:14.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:14.115+0000 7f8d7be00700 1 --2- 172.21.15.81:0/2497305369 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8d600b2880 0x7f8d600b4d40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:14.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:14.115+0000 7f8d7be00700 1 --2- 172.21.15.81:0/2497305369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d7c1143e0 0x7f8d7c1a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:14.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:14.115+0000 7f8d7be00700 1 --2- 172.21.15.81:0/2497305369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d7c075840 0x7f8d7c19ff40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:14.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:14.115+0000 7f8d7be00700 1 --2- 172.21.15.81:0/2497305369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d7c076160 0x7f8d7c1a0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:14.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:14.115+0000 7f8d7be00700 1 -- 172.21.15.81:0/2497305369 >> 172.21.15.81:0/2497305369 conn(0x7f8d7c0fef20 msgr2=0x7f8d7c0ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:14.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:14.116+0000 7f8d7be00700 1 -- 172.21.15.81:0/2497305369 shutdown_connections 2024-05-03T16:44:14.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:14.116+0000 7f8d7be00700 1 -- 172.21.15.81:0/2497305369 wait complete. 2024-05-03T16:44:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:set pool 4 allow_ec_overwrites to true 2024-05-03T16:44:14.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:14 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2497305369' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-03T16:44:14.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:14 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2497305369' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-03T16:44:14.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:14 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2497305369' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-03T16:44:15.150 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-03T16:44:15.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:15 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2497305369' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-03T16:44:15.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:15 smithi134 ceph-mon[31708]: osdmap e88: 12 total, 12 up, 12 in 2024-05-03T16:44:15.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:15 smithi134 ceph-mon[31708]: pgmap v383: 129 pgs: 7 creating+peering, 11 unknown, 111 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:15.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:15 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2497305369' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-03T16:44:15.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:15 smithi081 ceph-mon[28640]: osdmap e88: 12 total, 12 up, 12 in 2024-05-03T16:44:15.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:15 smithi081 ceph-mon[28640]: pgmap v383: 129 pgs: 7 creating+peering, 11 unknown, 111 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:15.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:15 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2497305369' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-03T16:44:15.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:15 smithi146 ceph-mon[32357]: osdmap e88: 12 total, 12 up, 12 in 2024-05-03T16:44:15.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:15 smithi146 ceph-mon[32357]: pgmap v383: 129 pgs: 7 creating+peering, 11 unknown, 111 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:44:17.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:17 smithi081 ceph-mon[28640]: pgmap v384: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:17.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:17 smithi134 ceph-mon[31708]: pgmap v384: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:17.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:17 smithi146 ceph-mon[32357]: pgmap v384: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.058+0000 7fba6b000700 1 -- 172.21.15.81:0/7294986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba6410fed0 msgr2=0x7fba641122c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.058+0000 7fba6b000700 1 --2- 172.21.15.81:0/7294986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba6410fed0 0x7fba641122c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00b0a0 tx=0x7fba5c00b3b0 comp rx=0 tx=0).stop 2024-05-03T16:44:18.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.059+0000 7fba6b000700 1 -- 172.21.15.81:0/7294986 shutdown_connections 2024-05-03T16:44:18.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.059+0000 7fba6b000700 1 --2- 172.21.15.81:0/7294986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba640756d0 0x7fba64075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:18.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.059+0000 7fba6b000700 1 --2- 172.21.15.81:0/7294986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba6410fed0 0x7fba641122c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:18.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.059+0000 7fba6b000700 1 --2- 172.21.15.81:0/7294986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba64075ff0 0x7fba6410f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:18.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.059+0000 7fba6b000700 1 -- 172.21.15.81:0/7294986 >> 172.21.15.81:0/7294986 conn(0x7fba6407a650 msgr2=0x7fba6407aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:18.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.059+0000 7fba6b000700 1 -- 172.21.15.81:0/7294986 shutdown_connections 2024-05-03T16:44:18.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.059+0000 7fba6b000700 1 -- 172.21.15.81:0/7294986 wait complete. 2024-05-03T16:44:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.060+0000 7fba6b000700 1 Processor -- start 2024-05-03T16:44:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.060+0000 7fba6b000700 1 -- start start 2024-05-03T16:44:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.060+0000 7fba6b000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba640756d0 0x7fba6419bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.060+0000 7fba6b000700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba64075ff0 0x7fba6419c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.060+0000 7fba6b000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba6410fed0 0x7fba641a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.060+0000 7fba6b000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fba641157e0 con 0x7fba640756d0 2024-05-03T16:44:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.060+0000 7fba6b000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fba64115660 con 0x7fba6410fed0 2024-05-03T16:44:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.060+0000 7fba6b000700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fba64115960 con 0x7fba64075ff0 2024-05-03T16:44:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.061+0000 7fba63e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba640756d0 0x7fba6419bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.061+0000 7fba63e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba640756d0 0x7fba6419bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38772/0 (socket says 172.21.15.81:38772) 2024-05-03T16:44:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.061+0000 7fba63e00700 1 -- 172.21.15.81:0/3743655244 learned_addr learned my addr 172.21.15.81:0/3743655244 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:44:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.061+0000 7fba63e00700 1 -- 172.21.15.81:0/3743655244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba64075ff0 msgr2=0x7fba6419c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.061+0000 7fba69000700 1 --2- 172.21.15.81:0/3743655244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba6410fed0 0x7fba641a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.061+0000 7fba63400700 1 --2- 172.21.15.81:0/3743655244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba64075ff0 0x7fba6419c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.061+0000 7fba63e00700 1 --2- 172.21.15.81:0/3743655244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba64075ff0 0x7fba6419c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.061+0000 7fba63e00700 1 -- 172.21.15.81:0/3743655244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba6410fed0 msgr2=0x7fba641a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.061+0000 7fba63e00700 1 --2- 172.21.15.81:0/3743655244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba6410fed0 0x7fba641a0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.061+0000 7fba63e00700 1 -- 172.21.15.81:0/3743655244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba641a0d50 con 0x7fba640756d0 2024-05-03T16:44:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.061+0000 7fba63e00700 1 --2- 172.21.15.81:0/3743655244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba640756d0 0x7fba6419bd90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fba5400d980 tx=0x7fba5400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.062+0000 7fba60c00700 1 -- 172.21.15.81:0/3743655244 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba54017070 con 0x7fba640756d0 2024-05-03T16:44:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.062+0000 7fba6b000700 1 -- 172.21.15.81:0/3743655244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba641a0fe0 con 0x7fba640756d0 2024-05-03T16:44:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.062+0000 7fba60c00700 1 -- 172.21.15.81:0/3743655244 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba54004830 con 0x7fba640756d0 2024-05-03T16:44:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.062+0000 7fba60c00700 1 -- 172.21.15.81:0/3743655244 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba540053a0 con 0x7fba640756d0 2024-05-03T16:44:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.062+0000 7fba6b000700 1 -- 172.21.15.81:0/3743655244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba641a88c0 con 0x7fba640756d0 2024-05-03T16:44:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.063+0000 7fba6b000700 1 -- 172.21.15.81:0/3743655244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba6406a190 con 0x7fba640756d0 2024-05-03T16:44:18.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.067+0000 7fba60c00700 1 -- 172.21.15.81:0/3743655244 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fba540049e0 con 0x7fba640756d0 2024-05-03T16:44:18.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.068+0000 7fba60c00700 1 --2- 172.21.15.81:0/3743655244 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fba480b2880 0x7fba480b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.069+0000 7fba60c00700 1 -- 172.21.15.81:0/3743655244 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9031+0+0 (secure 0 0 0) 0x7fba540e2920 con 0x7fba640756d0 2024-05-03T16:44:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.069+0000 7fba63400700 1 --2- 172.21.15.81:0/3743655244 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fba480b2880 0x7fba480b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.070+0000 7fba63400700 1 --2- 172.21.15.81:0/3743655244 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fba480b2880 0x7fba480b4d40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fba50005fd0 tx=0x7fba50005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:18.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.071+0000 7fba60c00700 1 -- 172.21.15.81:0/3743655244 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fba54020020 con 0x7fba640756d0 2024-05-03T16:44:18.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:18.353+0000 7fba6b000700 1 -- 172.21.15.81:0/3743655244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fba6402e510 con 0x7fba640756d0 2024-05-03T16:44:19.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:19.353+0000 7fba60c00700 1 -- 172.21.15.81:0/3743655244 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7fba540aa2c0 con 0x7fba640756d0 2024-05-03T16:44:19.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:19.358+0000 7fba6b000700 1 -- 172.21.15.81:0/3743655244 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fba480b2880 msgr2=0x7fba480b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:19.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:19.358+0000 7fba6b000700 1 --2- 172.21.15.81:0/3743655244 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fba480b2880 0x7fba480b4d40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fba50005fd0 tx=0x7fba50005ee0 comp rx=0 tx=0).stop 2024-05-03T16:44:19.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:19.358+0000 7fba6b000700 1 -- 172.21.15.81:0/3743655244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba640756d0 msgr2=0x7fba6419bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:19.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:19.358+0000 7fba6b000700 1 --2- 172.21.15.81:0/3743655244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba640756d0 0x7fba6419bd90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fba5400d980 tx=0x7fba5400dd40 comp rx=0 tx=0).stop 2024-05-03T16:44:19.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:19.358+0000 7fba6b000700 1 -- 172.21.15.81:0/3743655244 shutdown_connections 2024-05-03T16:44:19.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:19.358+0000 7fba6b000700 1 --2- 172.21.15.81:0/3743655244 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fba480b2880 0x7fba480b4d40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:19.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:19.358+0000 7fba6b000700 1 --2- 172.21.15.81:0/3743655244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba6410fed0 0x7fba641a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:19.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:19.358+0000 7fba6b000700 1 --2- 172.21.15.81:0/3743655244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba640756d0 0x7fba6419bd90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:19.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:19.358+0000 7fba6b000700 1 --2- 172.21.15.81:0/3743655244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba64075ff0 0x7fba6419c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:19.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:19.358+0000 7fba6b000700 1 -- 172.21.15.81:0/3743655244 >> 172.21.15.81:0/3743655244 conn(0x7fba6407a650 msgr2=0x7fba64100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:19.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:19.358+0000 7fba6b000700 1 -- 172.21.15.81:0/3743655244 shutdown_connections 2024-05-03T16:44:19.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:19.359+0000 7fba6b000700 1 -- 172.21.15.81:0/3743655244 wait complete. 2024-05-03T16:44:19.362 INFO:teuthology.orchestra.run.smithi081.stderr:added data pool 4 to fsmap 2024-05-03T16:44:19.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:19 smithi134 ceph-mon[31708]: pgmap v385: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:19.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:19 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3743655244' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-03T16:44:19.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:19 smithi081 ceph-mon[28640]: pgmap v385: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:19.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:19 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3743655244' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-03T16:44:19.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:19 smithi146 ceph-mon[32357]: pgmap v385: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:19.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:19 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3743655244' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-03T16:44:20.319 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T16:44:20.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:20 smithi134 ceph-mon[31708]: osdmap e89: 12 total, 12 up, 12 in 2024-05-03T16:44:20.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:20 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3743655244' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-03T16:44:20.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:20 smithi134 ceph-mon[31708]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T16:44:20.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:20 smithi081 ceph-mon[28640]: osdmap e89: 12 total, 12 up, 12 in 2024-05-03T16:44:20.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:20 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3743655244' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-03T16:44:20.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:20 smithi081 ceph-mon[28640]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T16:44:20.763 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:44:20.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:20 smithi146 ceph-mon[32357]: osdmap e89: 12 total, 12 up, 12 in 2024-05-03T16:44:20.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:20 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3743655244' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-03T16:44:20.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:20 smithi146 ceph-mon[32357]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T16:44:21.714 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:21 smithi146 ceph-mon[32357]: pgmap v387: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:21.715 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:21 smithi146 ceph-mon[32357]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-03T16:44:21.715 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:21 smithi146 ceph-mon[32357]: Cluster is now healthy 2024-05-03T16:44:21.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:21 smithi134 ceph-mon[31708]: pgmap v387: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:21.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:21 smithi134 ceph-mon[31708]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-03T16:44:21.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:21 smithi134 ceph-mon[31708]: Cluster is now healthy 2024-05-03T16:44:21.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:21 smithi081 ceph-mon[28640]: pgmap v387: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:21.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:21 smithi081 ceph-mon[28640]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-03T16:44:21.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:21 smithi081 ceph-mon[28640]: Cluster is now healthy 2024-05-03T16:44:23.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.201+0000 7fcaabe00700 1 -- 172.21.15.81:0/2485606439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa4109ad0 msgr2=0x7fcaa4109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:23.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.201+0000 7fcaabe00700 1 --2- 172.21.15.81:0/2485606439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa4109ad0 0x7fcaa4109f50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fca90009990 tx=0x7fca90009ca0 comp rx=0 tx=0).stop 2024-05-03T16:44:23.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.201+0000 7fcaabe00700 1 -- 172.21.15.81:0/2485606439 shutdown_connections 2024-05-03T16:44:23.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.201+0000 7fcaabe00700 1 --2- 172.21.15.81:0/2485606439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaa410fb60 0x7fcaa410ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:23.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.201+0000 7fcaabe00700 1 --2- 172.21.15.81:0/2485606439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa410a490 0x7fcaa41169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:23.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.201+0000 7fcaabe00700 1 --2- 172.21.15.81:0/2485606439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa4109ad0 0x7fcaa4109f50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:23.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.201+0000 7fcaabe00700 1 -- 172.21.15.81:0/2485606439 >> 172.21.15.81:0/2485606439 conn(0x7fcaa4076c70 msgr2=0x7fcaa41082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:23.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.201+0000 7fcaabe00700 1 -- 172.21.15.81:0/2485606439 shutdown_connections 2024-05-03T16:44:23.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.201+0000 7fcaabe00700 1 -- 172.21.15.81:0/2485606439 wait complete. 2024-05-03T16:44:23.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.202+0000 7fcaabe00700 1 Processor -- start 2024-05-03T16:44:23.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.202+0000 7fcaabe00700 1 -- start start 2024-05-03T16:44:23.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.203+0000 7fcaabe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa4109ad0 0x7fcaa41a0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:23.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.203+0000 7fcaabe00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaa410a490 0x7fcaa41a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:23.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.203+0000 7fcaabe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa410fb60 0x7fcaa41a48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:23.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.203+0000 7fcaabe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa4119bb0 con 0x7fcaa410fb60 2024-05-03T16:44:23.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.203+0000 7fcaabe00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa4119a30 con 0x7fcaa4109ad0 2024-05-03T16:44:23.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.203+0000 7fcaabe00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa4119d30 con 0x7fcaa410a490 2024-05-03T16:44:23.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.203+0000 7fcaa9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa410fb60 0x7fcaa41a48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:23.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.203+0000 7fcaa9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa410fb60 0x7fcaa41a48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38794/0 (socket says 172.21.15.81:38794) 2024-05-03T16:44:23.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.203+0000 7fcaa9e00700 1 -- 172.21.15.81:0/432992415 learned_addr learned my addr 172.21.15.81:0/432992415 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:44:23.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.203+0000 7fcaa9400700 1 --2- 172.21.15.81:0/432992415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa4109ad0 0x7fcaa41a0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:23.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.203+0000 7fcaa8a00700 1 --2- 172.21.15.81:0/432992415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaa410a490 0x7fcaa41a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:23.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.204+0000 7fcaa9e00700 1 -- 172.21.15.81:0/432992415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaa410a490 msgr2=0x7fcaa41a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:23.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.204+0000 7fcaa9e00700 1 --2- 172.21.15.81:0/432992415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaa410a490 0x7fcaa41a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:23.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.204+0000 7fcaa9e00700 1 -- 172.21.15.81:0/432992415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa4109ad0 msgr2=0x7fcaa41a0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:23.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.204+0000 7fcaa9e00700 1 --2- 172.21.15.81:0/432992415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa4109ad0 0x7fcaa41a0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:23.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.204+0000 7fcaa9e00700 1 -- 172.21.15.81:0/432992415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa41a5000 con 0x7fcaa410fb60 2024-05-03T16:44:23.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.204+0000 7fcaa9e00700 1 --2- 172.21.15.81:0/432992415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa410fb60 0x7fcaa41a48c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fca9c007d70 tx=0x7fca9c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:23.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.204+0000 7fcaa2000700 1 -- 172.21.15.81:0/432992415 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c016020 con 0x7fcaa410fb60 2024-05-03T16:44:23.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.204+0000 7fcaabe00700 1 -- 172.21.15.81:0/432992415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa41a52f0 con 0x7fcaa410fb60 2024-05-03T16:44:23.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.204+0000 7fcaa2000700 1 -- 172.21.15.81:0/432992415 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca9c00ad40 con 0x7fcaa410fb60 2024-05-03T16:44:23.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.204+0000 7fcaa2000700 1 -- 172.21.15.81:0/432992415 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c0115e0 con 0x7fcaa410fb60 2024-05-03T16:44:23.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.204+0000 7fcaabe00700 1 -- 172.21.15.81:0/432992415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa41acb70 con 0x7fcaa410fb60 2024-05-03T16:44:23.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.206+0000 7fcaabe00700 1 -- 172.21.15.81:0/432992415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa406a190 con 0x7fcaa410fb60 2024-05-03T16:44:23.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.208+0000 7fcaa2000700 1 -- 172.21.15.81:0/432992415 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fca9c019020 con 0x7fcaa410fb60 2024-05-03T16:44:23.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.209+0000 7fcaa2000700 1 --2- 172.21.15.81:0/432992415 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fca8c0b2880 0x7fca8c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:23.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.210+0000 7fcaa2000700 1 -- 172.21.15.81:0/432992415 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9063+0+0 (secure 0 0 0) 0x7fca9c0e25b0 con 0x7fcaa410fb60 2024-05-03T16:44:23.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.210+0000 7fcaa9400700 1 --2- 172.21.15.81:0/432992415 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fca8c0b2880 0x7fca8c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:23.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.210+0000 7fcaa9400700 1 --2- 172.21.15.81:0/432992415 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fca8c0b2880 0x7fca8c0b4d40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fca98005fd0 tx=0x7fca9800af20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.213+0000 7fcaa2000700 1 -- 172.21.15.81:0/432992415 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fca9c020020 con 0x7fcaa410fb60 2024-05-03T16:44:23.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.496+0000 7fcaabe00700 1 -- 172.21.15.81:0/432992415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcaa41a1350 con 0x7fcaa410fb60 2024-05-03T16:44:23.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.498+0000 7fcaa2000700 1 -- 172.21.15.81:0/432992415 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11806 (secure 0 0 0) 0x7fca9c0a9f30 con 0x7fcaa410fb60 2024-05-03T16:44:23.501 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:44:23.501 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/886382058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":886382058},{"type":"v1","addr":"172.21.15.81:6835","nonce":886382058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3285208793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3285208793},{"type":"v1","addr":"172.21.15.81:6837","nonce":3285208793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/3710454674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3710454674},{"type":"v1","addr":"172.21.15.81:6839","nonce":3710454674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1174252889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1174252889},{"type":"v1","addr":"172.21.15.81:6841","nonce":1174252889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1900581381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1900581381},{"type":"v1","addr":"172.21.15.146:6833","nonce":1900581381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3514751933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3514751933},{"type":"v1","addr":"172.21.15.146:6835","nonce":3514751933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/971814714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":971814714},{"type":"v1","addr":"172.21.15.146:6837","nonce":971814714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24481,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6839/3770312555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":3770312555},{"type":"v1","addr":"172.21.15.146:6839","nonce":3770312555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34400,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/749392804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":749392804},{"type":"v1","addr":"172.21.15.134:6833","nonce":749392804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34418,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3681203129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3681203129},{"type":"v1","addr":"172.21.15.134:6835","nonce":3681203129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34439,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2915415754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2915415754},{"type":"v1","addr":"172.21.15.134:6837","nonce":2915415754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-03T16:43:58.734681+0000","modified":"2024-05-03T16:44:18.356731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34466":{"gid":34466,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2061491127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2061491127},{"type":"v1","addr":"172.21.15.134:6839","nonce":2061491127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34466,"qdb_cluster":[34466]},"id":1}]} 2024-05-03T16:44:23.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.501+0000 7fcaabe00700 1 -- 172.21.15.81:0/432992415 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fca8c0b2880 msgr2=0x7fca8c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:23.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.502+0000 7fcaabe00700 1 --2- 172.21.15.81:0/432992415 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fca8c0b2880 0x7fca8c0b4d40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fca98005fd0 tx=0x7fca9800af20 comp rx=0 tx=0).stop 2024-05-03T16:44:23.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.502+0000 7fcaabe00700 1 -- 172.21.15.81:0/432992415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa410fb60 msgr2=0x7fcaa41a48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:23.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.502+0000 7fcaabe00700 1 --2- 172.21.15.81:0/432992415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa410fb60 0x7fcaa41a48c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fca9c007d70 tx=0x7fca9c00a340 comp rx=0 tx=0).stop 2024-05-03T16:44:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.502+0000 7fcaabe00700 1 -- 172.21.15.81:0/432992415 shutdown_connections 2024-05-03T16:44:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.502+0000 7fcaabe00700 1 --2- 172.21.15.81:0/432992415 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fca8c0b2880 0x7fca8c0b4d40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.502+0000 7fcaabe00700 1 --2- 172.21.15.81:0/432992415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa410fb60 0x7fcaa41a48c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.502+0000 7fcaabe00700 1 --2- 172.21.15.81:0/432992415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa4109ad0 0x7fcaa41a0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.502+0000 7fcaabe00700 1 --2- 172.21.15.81:0/432992415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaa410a490 0x7fcaa41a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.502+0000 7fcaabe00700 1 -- 172.21.15.81:0/432992415 >> 172.21.15.81:0/432992415 conn(0x7fcaa4076c70 msgr2=0x7fcaa4077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.502+0000 7fcaabe00700 1 -- 172.21.15.81:0/432992415 shutdown_connections 2024-05-03T16:44:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:23.502+0000 7fcaabe00700 1 -- 172.21.15.81:0/432992415 wait complete. 2024-05-03T16:44:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2024-05-03T16:44:23.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:23 smithi134 ceph-mon[31708]: pgmap v388: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:23.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:23 smithi081 ceph-mon[28640]: pgmap v388: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:23.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:23 smithi146 ceph-mon[32357]: pgmap v388: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:24.504 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T16:44:24.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:24 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/432992415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:44:24.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:24 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/432992415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:44:24.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:24 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/432992415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:44:24.972 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:44:25.386 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:25 smithi081 ceph-mon[28640]: pgmap v389: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:25.620 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:25 smithi134 ceph-mon[31708]: pgmap v389: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:25.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:25 smithi146 ceph-mon[32357]: pgmap v389: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:27.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.440+0000 7fb60f000700 1 -- 172.21.15.81:0/3373478418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb608106080 msgr2=0x7fb608112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:27.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.440+0000 7fb60f000700 1 --2- 172.21.15.81:0/3373478418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb608106080 0x7fb608112590 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb60000b0a0 tx=0x7fb60000b3b0 comp rx=0 tx=0).stop 2024-05-03T16:44:27.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.440+0000 7fb60f000700 1 -- 172.21.15.81:0/3373478418 shutdown_connections 2024-05-03T16:44:27.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.440+0000 7fb60f000700 1 --2- 172.21.15.81:0/3373478418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb608106080 0x7fb608112590 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:27.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.440+0000 7fb60f000700 1 --2- 172.21.15.81:0/3373478418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb60810b6c0 0x7fb60810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:27.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.440+0000 7fb60f000700 1 --2- 172.21.15.81:0/3373478418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6081056c0 0x7fb608105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:27.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.440+0000 7fb60f000700 1 -- 172.21.15.81:0/3373478418 >> 172.21.15.81:0/3373478418 conn(0x7fb6081011b0 msgr2=0x7fb6081035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:27.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.440+0000 7fb60f000700 1 -- 172.21.15.81:0/3373478418 shutdown_connections 2024-05-03T16:44:27.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.440+0000 7fb60f000700 1 -- 172.21.15.81:0/3373478418 wait complete. 2024-05-03T16:44:27.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.441+0000 7fb60f000700 1 Processor -- start 2024-05-03T16:44:27.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.441+0000 7fb60f000700 1 -- start start 2024-05-03T16:44:27.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.442+0000 7fb60f000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6081056c0 0x7fb6081a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:27.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.442+0000 7fb60f000700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb608106080 0x7fb6081a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:27.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.442+0000 7fb60f000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb60810b6c0 0x7fb60819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:27.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.442+0000 7fb60f000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb6081157b0 con 0x7fb60810b6c0 2024-05-03T16:44:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.442+0000 7fb60f000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb608115630 con 0x7fb6081056c0 2024-05-03T16:44:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.442+0000 7fb60f000700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb608115930 con 0x7fb608106080 2024-05-03T16:44:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.442+0000 7fb60d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb60810b6c0 0x7fb60819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.442+0000 7fb60d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb60810b6c0 0x7fb60819b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48420/0 (socket says 172.21.15.81:48420) 2024-05-03T16:44:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.442+0000 7fb60d000700 1 -- 172.21.15.81:0/1469018436 learned_addr learned my addr 172.21.15.81:0/1469018436 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:44:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.442+0000 7fb607e00700 1 --2- 172.21.15.81:0/1469018436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6081056c0 0x7fb6081a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.442+0000 7fb607400700 1 --2- 172.21.15.81:0/1469018436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb608106080 0x7fb6081a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.443+0000 7fb60d000700 1 -- 172.21.15.81:0/1469018436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb608106080 msgr2=0x7fb6081a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.443+0000 7fb60d000700 1 --2- 172.21.15.81:0/1469018436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb608106080 0x7fb6081a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.443+0000 7fb60d000700 1 -- 172.21.15.81:0/1469018436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6081056c0 msgr2=0x7fb6081a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.443+0000 7fb60d000700 1 --2- 172.21.15.81:0/1469018436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6081056c0 0x7fb6081a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.443+0000 7fb60d000700 1 -- 172.21.15.81:0/1469018436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60819c150 con 0x7fb60810b6c0 2024-05-03T16:44:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.443+0000 7fb60d000700 1 --2- 172.21.15.81:0/1469018436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb60810b6c0 0x7fb60819b9f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb600004dc0 tx=0x7fb600004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:27.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.443+0000 7fb604c00700 1 -- 172.21.15.81:0/1469018436 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb600021020 con 0x7fb60810b6c0 2024-05-03T16:44:27.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.443+0000 7fb604c00700 1 -- 172.21.15.81:0/1469018436 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb600007cf0 con 0x7fb60810b6c0 2024-05-03T16:44:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.443+0000 7fb60f000700 1 -- 172.21.15.81:0/1469018436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60819c3e0 con 0x7fb60810b6c0 2024-05-03T16:44:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.443+0000 7fb604c00700 1 -- 172.21.15.81:0/1469018436 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb600005370 con 0x7fb60810b6c0 2024-05-03T16:44:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.444+0000 7fb60f000700 1 -- 172.21.15.81:0/1469018436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6081a8700 con 0x7fb60810b6c0 2024-05-03T16:44:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.445+0000 7fb60f000700 1 -- 172.21.15.81:0/1469018436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb608106e00 con 0x7fb60810b6c0 2024-05-03T16:44:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.447+0000 7fb604c00700 1 -- 172.21.15.81:0/1469018436 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fb600024020 con 0x7fb60810b6c0 2024-05-03T16:44:27.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.448+0000 7fb604c00700 1 --2- 172.21.15.81:0/1469018436 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb5ec0b2880 0x7fb5ec0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:27.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.449+0000 7fb604c00700 1 -- 172.21.15.81:0/1469018436 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9063+0+0 (secure 0 0 0) 0x7fb60000f020 con 0x7fb60810b6c0 2024-05-03T16:44:27.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.449+0000 7fb607e00700 1 --2- 172.21.15.81:0/1469018436 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb5ec0b2880 0x7fb5ec0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:27.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.449+0000 7fb607e00700 1 --2- 172.21.15.81:0/1469018436 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb5ec0b2880 0x7fb5ec0b4d40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8005fd0 tx=0x7fb5f800af00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:27.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.453+0000 7fb604c00700 1 -- 172.21.15.81:0/1469018436 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb6000074e0 con 0x7fb60810b6c0 2024-05-03T16:44:27.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:27 smithi134 ceph-mon[31708]: pgmap v390: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:27.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.684+0000 7fb60f000700 1 -- 172.21.15.81:0/1469018436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb60802e510 con 0x7fb60810b6c0 2024-05-03T16:44:27.687 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:27 smithi081 ceph-mon[28640]: pgmap v390: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:27.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.690+0000 7fb604c00700 1 -- 172.21.15.81:0/1469018436 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24580 (secure 0 0 0) 0x7fb6000ab380 con 0x7fb60810b6c0 2024-05-03T16:44:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:44:27.693 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":89,"fsid":"8988869e-096a-11ef-bc97-c7b262605968","created":"2024-05-03T16:32:56.440204+0000","modified":"2024-05-03T16:44:18.356188+0000","last_up_change":"2024-05-03T16:42:31.768974+0000","last_in_change":"2024-05-03T16:42:06.989688+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T16:37:18.271939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T16:43:50.469793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T16:43:54.708564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T16:44:09.064474+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"957b05dc-dfb9-4561-8800-b7ec0aba679d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6803","nonce":1639968055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6805","nonce":1639968055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6809","nonce":1639968055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6807","nonce":1639968055}]},"public_addr":"172.21.15.81:6803/1639968055","cluster_addr":"172.21.15.81:6805/1639968055","heartbeat_back_addr":"172.21.15.81:6809/1639968055","heartbeat_front_addr":"172.21.15.81:6807/1639968055","state":["exists","up"]},{"osd":1,"uuid":"3bb199cd-b4d0-4c67-b98f-2106336dd57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6801","nonce":1928503491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6803","nonce":1928503491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6807","nonce":1928503491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6805","nonce":1928503491}]},"public_addr":"172.21.15.134:6801/1928503491","cluster_addr":"172.21.15.134:6803/1928503491","heartbeat_back_addr":"172.21.15.134:6807/1928503491","heartbeat_front_addr":"172.21.15.134:6805/1928503491","state":["exists","up"]},{"osd":2,"uuid":"79ec9995-50e8-4eaf-935a-39a479925734","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6801","nonce":1233108455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6803","nonce":1233108455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6807","nonce":1233108455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6805","nonce":1233108455}]},"public_addr":"172.21.15.146:6801/1233108455","cluster_addr":"172.21.15.146:6803/1233108455","heartbeat_back_addr":"172.21.15.146:6807/1233108455","heartbeat_front_addr":"172.21.15.146:6805/1233108455","state":["exists","up"]},{"osd":3,"uuid":"2d38f4e7-73c3-4e70-9f87-d44da28db452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6811","nonce":4128709465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6813","nonce":4128709465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6817","nonce":4128709465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6815","nonce":4128709465}]},"public_addr":"172.21.15.81:6811/4128709465","cluster_addr":"172.21.15.81:6813/4128709465","heartbeat_back_addr":"172.21.15.81:6817/4128709465","heartbeat_front_addr":"172.21.15.81:6815/4128709465","state":["exists","up"]},{"osd":4,"uuid":"3837a136-a25b-4cb9-aa82-084b477c67d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6809","nonce":1498616220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6811","nonce":1498616220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6815","nonce":1498616220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6813","nonce":1498616220}]},"public_addr":"172.21.15.134:6809/1498616220","cluster_addr":"172.21.15.134:6811/1498616220","heartbeat_back_addr":"172.21.15.134:6815/1498616220","heartbeat_front_addr":"172.21.15.134:6813/1498616220","state":["exists","up"]},{"osd":5,"uuid":"2e783d2e-c181-41a9-97de-f17705a201bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6809","nonce":1276988922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6811","nonce":1276988922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6815","nonce":1276988922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6813","nonce":1276988922}]},"public_addr":"172.21.15.146:6809/1276988922","cluster_addr":"172.21.15.146:6811/1276988922","heartbeat_back_addr":"172.21.15.146:6815/1276988922","heartbeat_front_addr":"172.21.15.146:6813/1276988922","state":["exists","up"]},{"osd":6,"uuid":"6faebdbf-7820-42e5-b07c-15db11f278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6819","nonce":3319125020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6821","nonce":3319125020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6825","nonce":3319125020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6823","nonce":3319125020}]},"public_addr":"172.21.15.81:6819/3319125020","cluster_addr":"172.21.15.81:6821/3319125020","heartbeat_back_addr":"172.21.15.81:6825/3319125020","heartbeat_front_addr":"172.21.15.81:6823/3319125020","state":["exists","up"]},{"osd":7,"uuid":"ec4b6b84-6c5f-4d07-a747-06610b2cd345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6817","nonce":3241993481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6819","nonce":3241993481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6823","nonce":3241993481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6821","nonce":3241993481}]},"public_addr":"172.21.15.134:6817/3241993481","cluster_addr":"172.21.15.134:6819/3241993481","heartbeat_back_addr":"172.21.15.134:6823/3241993481","heartbeat_front_addr":"172.21.15.134:6821/3241993481","state":["exists","up"]},{"osd":8,"uuid":"02b1b0fd-837c-4c29-bedb-54fa2ee7531d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6817","nonce":2423161684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6819","nonce":2423161684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6823","nonce":2423161684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6821","nonce":2423161684}]},"public_addr":"172.21.15.146:6817/2423161684","cluster_addr":"172.21.15.146:6819/2423161684","heartbeat_back_addr":"172.21.15.146:6823/2423161684","heartbeat_front_addr":"172.21.15.146:6821/2423161684","state":["exists","up"]},{"osd":9,"uuid":"46713a8e-743d-44d5-babe-c01d3179afcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6827","nonce":873909886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6829","nonce":873909886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6833","nonce":873909886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6831","nonce":873909886}]},"public_addr":"172.21.15.81:6827/873909886","cluster_addr":"172.21.15.81:6829/873909886","heartbeat_back_addr":"172.21.15.81:6833/873909886","heartbeat_front_addr":"172.21.15.81:6831/873909886","state":["exists","up"]},{"osd":10,"uuid":"12fcae89-30af-436b-a513-3998303da93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6825","nonce":1183629038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6827","nonce":1183629038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6831","nonce":1183629038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6829","nonce":1183629038}]},"public_addr":"172.21.15.134:6825/1183629038","cluster_addr":"172.21.15.134:6827/1183629038","heartbeat_back_addr":"172.21.15.134:6831/1183629038","heartbeat_front_addr":"172.21.15.134:6829/1183629038","state":["exists","up"]},{"osd":11,"uuid":"a543f42c-61da-4a93-b16b-a2891a4ef873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6825","nonce":2627233639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6827","nonce":2627233639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6831","nonce":2627233639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6829","nonce":2627233639}]},"public_addr":"172.21.15.146:6825/2627233639","cluster_addr":"172.21.15.146:6827/2627233639","heartbeat_back_addr":"172.21.15.146:6831/2627233639","heartbeat_front_addr":"172.21.15.146:6829/2627233639","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:08.411954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:41.459869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:15.068172+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:49.711273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:23.231811+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:57.917964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:39:32.982397+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:07.434610+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:43.606108+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:19.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:54.917284+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:42:30.525217+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6801/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/2237510960":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6801/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/3199433706":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1689714816":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/2777950369":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/1982866220":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1112375028":"2024-05-04T16:33:30.274051+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T16:44:27.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.693+0000 7fb60f000700 1 -- 172.21.15.81:0/1469018436 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb5ec0b2880 msgr2=0x7fb5ec0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:27.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.693+0000 7fb60f000700 1 --2- 172.21.15.81:0/1469018436 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb5ec0b2880 0x7fb5ec0b4d40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8005fd0 tx=0x7fb5f800af00 comp rx=0 tx=0).stop 2024-05-03T16:44:27.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.693+0000 7fb60f000700 1 -- 172.21.15.81:0/1469018436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb60810b6c0 msgr2=0x7fb60819b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:27.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.693+0000 7fb60f000700 1 --2- 172.21.15.81:0/1469018436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb60810b6c0 0x7fb60819b9f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb600004dc0 tx=0x7fb600004ea0 comp rx=0 tx=0).stop 2024-05-03T16:44:27.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.694+0000 7fb60f000700 1 -- 172.21.15.81:0/1469018436 shutdown_connections 2024-05-03T16:44:27.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.694+0000 7fb60f000700 1 --2- 172.21.15.81:0/1469018436 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb5ec0b2880 0x7fb5ec0b4d40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:27.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.694+0000 7fb60f000700 1 --2- 172.21.15.81:0/1469018436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb60810b6c0 0x7fb60819b9f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:27.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.694+0000 7fb60f000700 1 --2- 172.21.15.81:0/1469018436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6081056c0 0x7fb6081a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:27.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.694+0000 7fb60f000700 1 --2- 172.21.15.81:0/1469018436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb608106080 0x7fb6081a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:27.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.694+0000 7fb60f000700 1 -- 172.21.15.81:0/1469018436 >> 172.21.15.81:0/1469018436 conn(0x7fb6081011b0 msgr2=0x7fb608101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:27.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.694+0000 7fb60f000700 1 -- 172.21.15.81:0/1469018436 shutdown_connections 2024-05-03T16:44:27.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:27.694+0000 7fb60f000700 1 -- 172.21.15.81:0/1469018436 wait complete. 2024-05-03T16:44:27.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:27 smithi146 ceph-mon[32357]: pgmap v390: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:28.598 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T16:44:28.674 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:28 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1469018436' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:44:28.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:28 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/1469018436' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:44:28.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:28 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/1469018436' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:44:29.042 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:44:29.447 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:29 smithi081 ceph-mon[28640]: pgmap v391: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:29.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:29 smithi134 ceph-mon[31708]: pgmap v391: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:29.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:29 smithi146 ceph-mon[32357]: pgmap v391: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:31.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:31 smithi081 ceph-mon[28640]: pgmap v392: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:31.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.579+0000 7f0f13200700 1 -- 172.21.15.81:0/466949648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f140761f0 msgr2=0x7f0f1410f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:31.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.579+0000 7f0f13200700 1 --2- 172.21.15.81:0/466949648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f140761f0 0x7f0f1410f6d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0f00009990 tx=0x7f0f00009ca0 comp rx=0 tx=0).stop 2024-05-03T16:44:31.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.579+0000 7f0f13200700 1 -- 172.21.15.81:0/466949648 shutdown_connections 2024-05-03T16:44:31.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.579+0000 7f0f13200700 1 --2- 172.21.15.81:0/466949648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f140758d0 0x7f0f14075cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:31.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.579+0000 7f0f13200700 1 --2- 172.21.15.81:0/466949648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f1410fc10 0x7f0f14112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:31.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.579+0000 7f0f13200700 1 --2- 172.21.15.81:0/466949648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f140761f0 0x7f0f1410f6d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:31.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.579+0000 7f0f13200700 1 -- 172.21.15.81:0/466949648 >> 172.21.15.81:0/466949648 conn(0x7f0f140fef20 msgr2=0x7f0f14101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:31.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.579+0000 7f0f13200700 1 -- 172.21.15.81:0/466949648 shutdown_connections 2024-05-03T16:44:31.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.579+0000 7f0f13200700 1 -- 172.21.15.81:0/466949648 wait complete. 2024-05-03T16:44:31.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.580+0000 7f0f13200700 1 Processor -- start 2024-05-03T16:44:31.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.580+0000 7f0f13200700 1 -- start start 2024-05-03T16:44:31.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.581+0000 7f0f13200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f140758d0 0x7f0f141a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:31.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.581+0000 7f0f13200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f140761f0 0x7f0f141a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:31.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.581+0000 7f0f13200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f1410fc10 0x7f0f1419ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:31.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.581+0000 7f0f13200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0f141156c0 con 0x7f0f1410fc10 2024-05-03T16:44:31.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.581+0000 7f0f13200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0f14115540 con 0x7f0f140758d0 2024-05-03T16:44:31.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.581+0000 7f0f13200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0f14115840 con 0x7f0f140761f0 2024-05-03T16:44:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.581+0000 7f0f12800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f1410fc10 0x7f0f1419ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.581+0000 7f0f12800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f1410fc10 0x7f0f1419ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48450/0 (socket says 172.21.15.81:48450) 2024-05-03T16:44:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.581+0000 7f0f12800700 1 -- 172.21.15.81:0/950857686 learned_addr learned my addr 172.21.15.81:0/950857686 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:44:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.581+0000 7f0f11e00700 1 --2- 172.21.15.81:0/950857686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f140758d0 0x7f0f141a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.581+0000 7f0f11400700 1 --2- 172.21.15.81:0/950857686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f140761f0 0x7f0f141a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.582+0000 7f0f12800700 1 -- 172.21.15.81:0/950857686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f140761f0 msgr2=0x7f0f141a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.582+0000 7f0f12800700 1 --2- 172.21.15.81:0/950857686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f140761f0 0x7f0f141a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.582+0000 7f0f12800700 1 -- 172.21.15.81:0/950857686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f140758d0 msgr2=0x7f0f141a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.582+0000 7f0f12800700 1 --2- 172.21.15.81:0/950857686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f140758d0 0x7f0f141a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.582+0000 7f0f12800700 1 -- 172.21.15.81:0/950857686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1419c180 con 0x7f0f1410fc10 2024-05-03T16:44:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.582+0000 7f0f12800700 1 --2- 172.21.15.81:0/950857686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f1410fc10 0x7f0f1419ba20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c007d70 tx=0x7f0f0c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.582+0000 7f0f0aa00700 1 -- 172.21.15.81:0/950857686 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c016020 con 0x7f0f1410fc10 2024-05-03T16:44:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.582+0000 7f0f0aa00700 1 -- 172.21.15.81:0/950857686 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f0c00ad40 con 0x7f0f1410fc10 2024-05-03T16:44:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.582+0000 7f0f13200700 1 -- 172.21.15.81:0/950857686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1419c470 con 0x7f0f1410fc10 2024-05-03T16:44:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.582+0000 7f0f0aa00700 1 -- 172.21.15.81:0/950857686 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c0115e0 con 0x7f0f1410fc10 2024-05-03T16:44:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.583+0000 7f0f13200700 1 -- 172.21.15.81:0/950857686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f141a86e0 con 0x7f0f1410fc10 2024-05-03T16:44:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.584+0000 7f0f13200700 1 -- 172.21.15.81:0/950857686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f1406a190 con 0x7f0f1410fc10 2024-05-03T16:44:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.586+0000 7f0f0aa00700 1 -- 172.21.15.81:0/950857686 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0f0c019020 con 0x7f0f1410fc10 2024-05-03T16:44:31.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.588+0000 7f0f0aa00700 1 --2- 172.21.15.81:0/950857686 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0ef80b2880 0x7f0ef80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:31.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.589+0000 7f0f0aa00700 1 -- 172.21.15.81:0/950857686 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9063+0+0 (secure 0 0 0) 0x7f0f0c0e2550 con 0x7f0f1410fc10 2024-05-03T16:44:31.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.589+0000 7f0f11e00700 1 --2- 172.21.15.81:0/950857686 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0ef80b2880 0x7f0ef80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:31.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.589+0000 7f0f11e00700 1 --2- 172.21.15.81:0/950857686 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0ef80b2880 0x7f0ef80b4d40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0f14112190 tx=0x7f0f04009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:31.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.593+0000 7f0f0aa00700 1 -- 172.21.15.81:0/950857686 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0f0c020020 con 0x7f0f1410fc10 2024-05-03T16:44:31.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:31 smithi134 ceph-mon[31708]: pgmap v392: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:31.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:31 smithi146 ceph-mon[32357]: pgmap v392: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:31.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.831+0000 7f0f13200700 1 -- 172.21.15.81:0/950857686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f1419cf00 con 0x7f0f1410fc10 2024-05-03T16:44:31.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.833+0000 7f0f0aa00700 1 -- 172.21.15.81:0/950857686 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24580 (secure 0 0 0) 0x7f0f0c0a9ed0 con 0x7f0f1410fc10 2024-05-03T16:44:31.836 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:44:31.837 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":89,"fsid":"8988869e-096a-11ef-bc97-c7b262605968","created":"2024-05-03T16:32:56.440204+0000","modified":"2024-05-03T16:44:18.356188+0000","last_up_change":"2024-05-03T16:42:31.768974+0000","last_in_change":"2024-05-03T16:42:06.989688+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T16:37:18.271939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T16:43:50.469793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T16:43:54.708564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T16:44:09.064474+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"957b05dc-dfb9-4561-8800-b7ec0aba679d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6803","nonce":1639968055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6805","nonce":1639968055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6809","nonce":1639968055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6807","nonce":1639968055}]},"public_addr":"172.21.15.81:6803/1639968055","cluster_addr":"172.21.15.81:6805/1639968055","heartbeat_back_addr":"172.21.15.81:6809/1639968055","heartbeat_front_addr":"172.21.15.81:6807/1639968055","state":["exists","up"]},{"osd":1,"uuid":"3bb199cd-b4d0-4c67-b98f-2106336dd57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6801","nonce":1928503491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6803","nonce":1928503491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6807","nonce":1928503491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6805","nonce":1928503491}]},"public_addr":"172.21.15.134:6801/1928503491","cluster_addr":"172.21.15.134:6803/1928503491","heartbeat_back_addr":"172.21.15.134:6807/1928503491","heartbeat_front_addr":"172.21.15.134:6805/1928503491","state":["exists","up"]},{"osd":2,"uuid":"79ec9995-50e8-4eaf-935a-39a479925734","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6801","nonce":1233108455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6803","nonce":1233108455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6807","nonce":1233108455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6805","nonce":1233108455}]},"public_addr":"172.21.15.146:6801/1233108455","cluster_addr":"172.21.15.146:6803/1233108455","heartbeat_back_addr":"172.21.15.146:6807/1233108455","heartbeat_front_addr":"172.21.15.146:6805/1233108455","state":["exists","up"]},{"osd":3,"uuid":"2d38f4e7-73c3-4e70-9f87-d44da28db452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6811","nonce":4128709465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6813","nonce":4128709465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6817","nonce":4128709465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6815","nonce":4128709465}]},"public_addr":"172.21.15.81:6811/4128709465","cluster_addr":"172.21.15.81:6813/4128709465","heartbeat_back_addr":"172.21.15.81:6817/4128709465","heartbeat_front_addr":"172.21.15.81:6815/4128709465","state":["exists","up"]},{"osd":4,"uuid":"3837a136-a25b-4cb9-aa82-084b477c67d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6809","nonce":1498616220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6811","nonce":1498616220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6815","nonce":1498616220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6813","nonce":1498616220}]},"public_addr":"172.21.15.134:6809/1498616220","cluster_addr":"172.21.15.134:6811/1498616220","heartbeat_back_addr":"172.21.15.134:6815/1498616220","heartbeat_front_addr":"172.21.15.134:6813/1498616220","state":["exists","up"]},{"osd":5,"uuid":"2e783d2e-c181-41a9-97de-f17705a201bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6809","nonce":1276988922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6811","nonce":1276988922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6815","nonce":1276988922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6813","nonce":1276988922}]},"public_addr":"172.21.15.146:6809/1276988922","cluster_addr":"172.21.15.146:6811/1276988922","heartbeat_back_addr":"172.21.15.146:6815/1276988922","heartbeat_front_addr":"172.21.15.146:6813/1276988922","state":["exists","up"]},{"osd":6,"uuid":"6faebdbf-7820-42e5-b07c-15db11f278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6819","nonce":3319125020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6821","nonce":3319125020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6825","nonce":3319125020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6823","nonce":3319125020}]},"public_addr":"172.21.15.81:6819/3319125020","cluster_addr":"172.21.15.81:6821/3319125020","heartbeat_back_addr":"172.21.15.81:6825/3319125020","heartbeat_front_addr":"172.21.15.81:6823/3319125020","state":["exists","up"]},{"osd":7,"uuid":"ec4b6b84-6c5f-4d07-a747-06610b2cd345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6817","nonce":3241993481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6819","nonce":3241993481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6823","nonce":3241993481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6821","nonce":3241993481}]},"public_addr":"172.21.15.134:6817/3241993481","cluster_addr":"172.21.15.134:6819/3241993481","heartbeat_back_addr":"172.21.15.134:6823/3241993481","heartbeat_front_addr":"172.21.15.134:6821/3241993481","state":["exists","up"]},{"osd":8,"uuid":"02b1b0fd-837c-4c29-bedb-54fa2ee7531d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6817","nonce":2423161684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6819","nonce":2423161684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6823","nonce":2423161684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6821","nonce":2423161684}]},"public_addr":"172.21.15.146:6817/2423161684","cluster_addr":"172.21.15.146:6819/2423161684","heartbeat_back_addr":"172.21.15.146:6823/2423161684","heartbeat_front_addr":"172.21.15.146:6821/2423161684","state":["exists","up"]},{"osd":9,"uuid":"46713a8e-743d-44d5-babe-c01d3179afcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6827","nonce":873909886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6829","nonce":873909886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6833","nonce":873909886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6831","nonce":873909886}]},"public_addr":"172.21.15.81:6827/873909886","cluster_addr":"172.21.15.81:6829/873909886","heartbeat_back_addr":"172.21.15.81:6833/873909886","heartbeat_front_addr":"172.21.15.81:6831/873909886","state":["exists","up"]},{"osd":10,"uuid":"12fcae89-30af-436b-a513-3998303da93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6825","nonce":1183629038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6827","nonce":1183629038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6831","nonce":1183629038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6829","nonce":1183629038}]},"public_addr":"172.21.15.134:6825/1183629038","cluster_addr":"172.21.15.134:6827/1183629038","heartbeat_back_addr":"172.21.15.134:6831/1183629038","heartbeat_front_addr":"172.21.15.134:6829/1183629038","state":["exists","up"]},{"osd":11,"uuid":"a543f42c-61da-4a93-b16b-a2891a4ef873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6825","nonce":2627233639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6827","nonce":2627233639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6831","nonce":2627233639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6829","nonce":2627233639}]},"public_addr":"172.21.15.146:6825/2627233639","cluster_addr":"172.21.15.146:6827/2627233639","heartbeat_back_addr":"172.21.15.146:6831/2627233639","heartbeat_front_addr":"172.21.15.146:6829/2627233639","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:08.411954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:41.459869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:15.068172+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:49.711273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:23.231811+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:57.917964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:39:32.982397+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:07.434610+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:43.606108+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:19.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:54.917284+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:42:30.525217+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6801/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/2237510960":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6801/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/3199433706":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1689714816":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/2777950369":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/1982866220":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1112375028":"2024-05-04T16:33:30.274051+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T16:44:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.837+0000 7f0f13200700 1 -- 172.21.15.81:0/950857686 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0ef80b2880 msgr2=0x7f0ef80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.837+0000 7f0f13200700 1 --2- 172.21.15.81:0/950857686 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0ef80b2880 0x7f0ef80b4d40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0f14112190 tx=0x7f0f04009190 comp rx=0 tx=0).stop 2024-05-03T16:44:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.837+0000 7f0f13200700 1 -- 172.21.15.81:0/950857686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f1410fc10 msgr2=0x7f0f1419ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.837+0000 7f0f13200700 1 --2- 172.21.15.81:0/950857686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f1410fc10 0x7f0f1419ba20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c007d70 tx=0x7f0f0c00a340 comp rx=0 tx=0).stop 2024-05-03T16:44:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.837+0000 7f0f13200700 1 -- 172.21.15.81:0/950857686 shutdown_connections 2024-05-03T16:44:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.837+0000 7f0f13200700 1 --2- 172.21.15.81:0/950857686 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f0ef80b2880 0x7f0ef80b4d40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.837+0000 7f0f13200700 1 --2- 172.21.15.81:0/950857686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f1410fc10 0x7f0f1419ba20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.837+0000 7f0f13200700 1 --2- 172.21.15.81:0/950857686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f140758d0 0x7f0f141a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.837+0000 7f0f13200700 1 --2- 172.21.15.81:0/950857686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f140761f0 0x7f0f141a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.837+0000 7f0f13200700 1 -- 172.21.15.81:0/950857686 >> 172.21.15.81:0/950857686 conn(0x7f0f140fef20 msgr2=0x7f0f140ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.837+0000 7f0f13200700 1 -- 172.21.15.81:0/950857686 shutdown_connections 2024-05-03T16:44:31.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:31.838+0000 7f0f13200700 1 -- 172.21.15.81:0/950857686 wait complete. 2024-05-03T16:44:32.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:32 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/950857686' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:44:32.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:32 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/950857686' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:44:32.775 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T16:44:32.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:32 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/950857686' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:44:33.194 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:44:33.612 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:33 smithi081 ceph-mon[28640]: pgmap v393: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:33.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:33 smithi134 ceph-mon[31708]: pgmap v393: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:33.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:33 smithi146 ceph-mon[32357]: pgmap v393: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:35.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:35 smithi081 ceph-mon[28640]: pgmap v394: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:35.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.684+0000 7f716e600700 1 -- 172.21.15.81:0/309487412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7168114330 msgr2=0x7f7168116720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:35.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.684+0000 7f716e600700 1 --2- 172.21.15.81:0/309487412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7168114330 0x7f7168116720 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f716000b0a0 tx=0x7f716000b3b0 comp rx=0 tx=0).stop 2024-05-03T16:44:35.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.684+0000 7f716e600700 1 -- 172.21.15.81:0/309487412 shutdown_connections 2024-05-03T16:44:35.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.684+0000 7f716e600700 1 --2- 172.21.15.81:0/309487412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71680779d0 0x7f7168077db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:35.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.684+0000 7f716e600700 1 --2- 172.21.15.81:0/309487412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7168114330 0x7f7168116720 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:35.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.684+0000 7f716e600700 1 --2- 172.21.15.81:0/309487412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71680782f0 0x7f7168113df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:35.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.684+0000 7f716e600700 1 -- 172.21.15.81:0/309487412 >> 172.21.15.81:0/309487412 conn(0x7f7168101180 msgr2=0x7f71681035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:35.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.684+0000 7f716e600700 1 -- 172.21.15.81:0/309487412 shutdown_connections 2024-05-03T16:44:35.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.684+0000 7f716e600700 1 -- 172.21.15.81:0/309487412 wait complete. 2024-05-03T16:44:35.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.686+0000 7f716e600700 1 Processor -- start 2024-05-03T16:44:35.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.686+0000 7f716e600700 1 -- start start 2024-05-03T16:44:35.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.686+0000 7f716e600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71680779d0 0x7f71681a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:35.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.686+0000 7f716e600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71680782f0 0x7f71681a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:35.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.686+0000 7f716e600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7168114330 0x7f71681a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:35.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.686+0000 7f716e600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7168119b70 con 0x7f71680782f0 2024-05-03T16:44:35.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.686+0000 7f716e600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f71681199f0 con 0x7f7168114330 2024-05-03T16:44:35.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.686+0000 7f716e600700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7168119cf0 con 0x7f71680779d0 2024-05-03T16:44:35.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.687+0000 7f7166a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71680782f0 0x7f71681a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:35.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.687+0000 7f7166a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71680782f0 0x7f71681a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48466/0 (socket says 172.21.15.81:48466) 2024-05-03T16:44:35.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.687+0000 7f7166a00700 1 -- 172.21.15.81:0/2809935983 learned_addr learned my addr 172.21.15.81:0/2809935983 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:44:35.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.687+0000 7f7167400700 1 --2- 172.21.15.81:0/2809935983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71680779d0 0x7f71681a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:35.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.687+0000 7f7167e00700 1 --2- 172.21.15.81:0/2809935983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7168114330 0x7f71681a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:35.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.687+0000 7f7166a00700 1 -- 172.21.15.81:0/2809935983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71680779d0 msgr2=0x7f71681a00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:35.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.687+0000 7f7166a00700 1 --2- 172.21.15.81:0/2809935983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71680779d0 0x7f71681a00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:35.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.687+0000 7f7166a00700 1 -- 172.21.15.81:0/2809935983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7168114330 msgr2=0x7f71681a4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:35.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.687+0000 7f7166a00700 1 --2- 172.21.15.81:0/2809935983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7168114330 0x7f71681a4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:35.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.687+0000 7f7166a00700 1 -- 172.21.15.81:0/2809935983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71681a50d0 con 0x7f71680782f0 2024-05-03T16:44:35.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.688+0000 7f7166a00700 1 --2- 172.21.15.81:0/2809935983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71680782f0 0x7f71681a0600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f715400c920 tx=0x7f715400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:35.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.688+0000 7f715fe00700 1 -- 172.21.15.81:0/2809935983 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154007b00 con 0x7f71680782f0 2024-05-03T16:44:35.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.688+0000 7f715fe00700 1 -- 172.21.15.81:0/2809935983 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7154004cc0 con 0x7f71680782f0 2024-05-03T16:44:35.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.688+0000 7f716e600700 1 -- 172.21.15.81:0/2809935983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71681a53c0 con 0x7f71680782f0 2024-05-03T16:44:35.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.688+0000 7f715fe00700 1 -- 172.21.15.81:0/2809935983 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71540054f0 con 0x7f71680782f0 2024-05-03T16:44:35.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.688+0000 7f716e600700 1 -- 172.21.15.81:0/2809935983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71681acc40 con 0x7f71680782f0 2024-05-03T16:44:35.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.689+0000 7f716e600700 1 -- 172.21.15.81:0/2809935983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f716806a190 con 0x7f71680782f0 2024-05-03T16:44:35.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.694+0000 7f715fe00700 1 -- 172.21.15.81:0/2809935983 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7154007ca0 con 0x7f71680782f0 2024-05-03T16:44:35.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.696+0000 7f715fe00700 1 --2- 172.21.15.81:0/2809935983 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f714c0b2900 0x7f714c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:35.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.696+0000 7f715fe00700 1 -- 172.21.15.81:0/2809935983 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9063+0+0 (secure 0 0 0) 0x7f71540e24c0 con 0x7f71680782f0 2024-05-03T16:44:35.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.696+0000 7f7167400700 1 --2- 172.21.15.81:0/2809935983 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f714c0b2900 0x7f714c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:35.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.697+0000 7f7167400700 1 --2- 172.21.15.81:0/2809935983 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f714c0b2900 0x7f714c0b4dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7158005fd0 tx=0x7f715800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:35.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.698+0000 7f715fe00700 1 -- 172.21.15.81:0/2809935983 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f7154014030 con 0x7f71680782f0 2024-05-03T16:44:35.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:35 smithi134 ceph-mon[31708]: pgmap v394: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:35.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:35 smithi146 ceph-mon[32357]: pgmap v394: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.986+0000 7f716e600700 1 -- 172.21.15.81:0/2809935983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f716802e510 con 0x7f71680782f0 2024-05-03T16:44:35.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.989+0000 7f715fe00700 1 -- 172.21.15.81:0/2809935983 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11806 (secure 0 0 0) 0x7f71540a9ec0 con 0x7f71680782f0 2024-05-03T16:44:35.991 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:44:35.991 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/886382058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":886382058},{"type":"v1","addr":"172.21.15.81:6835","nonce":886382058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3285208793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3285208793},{"type":"v1","addr":"172.21.15.81:6837","nonce":3285208793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/3710454674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3710454674},{"type":"v1","addr":"172.21.15.81:6839","nonce":3710454674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1174252889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1174252889},{"type":"v1","addr":"172.21.15.81:6841","nonce":1174252889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1900581381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1900581381},{"type":"v1","addr":"172.21.15.146:6833","nonce":1900581381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3514751933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3514751933},{"type":"v1","addr":"172.21.15.146:6835","nonce":3514751933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/971814714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":971814714},{"type":"v1","addr":"172.21.15.146:6837","nonce":971814714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24481,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6839/3770312555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":3770312555},{"type":"v1","addr":"172.21.15.146:6839","nonce":3770312555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34400,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/749392804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":749392804},{"type":"v1","addr":"172.21.15.134:6833","nonce":749392804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34418,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3681203129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3681203129},{"type":"v1","addr":"172.21.15.134:6835","nonce":3681203129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34439,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2915415754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2915415754},{"type":"v1","addr":"172.21.15.134:6837","nonce":2915415754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-03T16:43:58.734681+0000","modified":"2024-05-03T16:44:18.356731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34466":{"gid":34466,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2061491127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2061491127},{"type":"v1","addr":"172.21.15.134:6839","nonce":2061491127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34466,"qdb_cluster":[34466]},"id":1}]} 2024-05-03T16:44:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.992+0000 7f716e600700 1 -- 172.21.15.81:0/2809935983 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f714c0b2900 msgr2=0x7f714c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.992+0000 7f716e600700 1 --2- 172.21.15.81:0/2809935983 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f714c0b2900 0x7f714c0b4dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7158005fd0 tx=0x7f715800a560 comp rx=0 tx=0).stop 2024-05-03T16:44:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.992+0000 7f716e600700 1 -- 172.21.15.81:0/2809935983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71680782f0 msgr2=0x7f71681a0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.992+0000 7f716e600700 1 --2- 172.21.15.81:0/2809935983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71680782f0 0x7f71681a0600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f715400c920 tx=0x7f715400cce0 comp rx=0 tx=0).stop 2024-05-03T16:44:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.992+0000 7f716e600700 1 -- 172.21.15.81:0/2809935983 shutdown_connections 2024-05-03T16:44:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.992+0000 7f716e600700 1 --2- 172.21.15.81:0/2809935983 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f714c0b2900 0x7f714c0b4dc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.992+0000 7f716e600700 1 --2- 172.21.15.81:0/2809935983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71680779d0 0x7f71681a00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.992+0000 7f716e600700 1 --2- 172.21.15.81:0/2809935983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7168114330 0x7f71681a4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.992+0000 7f716e600700 1 --2- 172.21.15.81:0/2809935983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71680782f0 0x7f71681a0600 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.992+0000 7f716e600700 1 -- 172.21.15.81:0/2809935983 >> 172.21.15.81:0/2809935983 conn(0x7f7168101180 msgr2=0x7f7168103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.992+0000 7f716e600700 1 -- 172.21.15.81:0/2809935983 shutdown_connections 2024-05-03T16:44:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:35.992+0000 7f716e600700 1 -- 172.21.15.81:0/2809935983 wait complete. 2024-05-03T16:44:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2024-05-03T16:44:36.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:36 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2809935983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:44:36.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:36 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2809935983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:44:36.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:36 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2809935983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:44:36.881 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T16:44:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:44:37.688 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:37 smithi081 ceph-mon[28640]: pgmap v395: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:37.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:37 smithi134 ceph-mon[31708]: pgmap v395: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:37.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:37 smithi146 ceph-mon[32357]: pgmap v395: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:39.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.689+0000 7f5057600700 1 -- 172.21.15.81:0/1097026506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5050108850 msgr2=0x7f50501103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:39.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.689+0000 7f5057600700 1 --2- 172.21.15.81:0/1097026506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5050108850 0x7f50501103d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f504800b0d0 tx=0x7f504800b3e0 comp rx=0 tx=0).stop 2024-05-03T16:44:39.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.690+0000 7f5057600700 1 -- 172.21.15.81:0/1097026506 shutdown_connections 2024-05-03T16:44:39.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.690+0000 7f5057600700 1 --2- 172.21.15.81:0/1097026506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5050103750 0x7f5050103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:39.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.690+0000 7f5057600700 1 --2- 172.21.15.81:0/1097026506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5050108850 0x7f50501103d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:39.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.690+0000 7f5057600700 1 --2- 172.21.15.81:0/1097026506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5050104100 0x7f5050108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:39.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.690+0000 7f5057600700 1 -- 172.21.15.81:0/1097026506 >> 172.21.15.81:0/1097026506 conn(0x7f505007a600 msgr2=0x7f505007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:39.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.690+0000 7f5057600700 1 -- 172.21.15.81:0/1097026506 shutdown_connections 2024-05-03T16:44:39.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.690+0000 7f5057600700 1 -- 172.21.15.81:0/1097026506 wait complete. 2024-05-03T16:44:39.693 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:39 smithi081 ceph-mon[28640]: pgmap v396: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:39.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.691+0000 7f5057600700 1 Processor -- start 2024-05-03T16:44:39.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.691+0000 7f5057600700 1 -- start start 2024-05-03T16:44:39.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.691+0000 7f5057600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5050103750 0x7f50501a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:39.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.691+0000 7f5057600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5050104100 0x7f50501a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:39.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.692+0000 7f5057600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5050108850 0x7f505019ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:39.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.692+0000 7f5057600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5050113540 con 0x7f5050103750 2024-05-03T16:44:39.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.692+0000 7f5057600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f50501133c0 con 0x7f5050108850 2024-05-03T16:44:39.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.692+0000 7f5057600700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f50501136c0 con 0x7f5050104100 2024-05-03T16:44:39.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.692+0000 7f5054c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5050103750 0x7f50501a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:39.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.692+0000 7f5054c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5050103750 0x7f50501a1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49856/0 (socket says 172.21.15.81:49856) 2024-05-03T16:44:39.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.692+0000 7f5054c00700 1 -- 172.21.15.81:0/937972000 learned_addr learned my addr 172.21.15.81:0/937972000 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:44:39.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.692+0000 7f504fe00700 1 --2- 172.21.15.81:0/937972000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5050104100 0x7f50501a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:39.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.692+0000 7f5055600700 1 --2- 172.21.15.81:0/937972000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5050108850 0x7f505019ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:39.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.692+0000 7f5054c00700 1 -- 172.21.15.81:0/937972000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5050104100 msgr2=0x7f50501a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:39.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.692+0000 7f5054c00700 1 --2- 172.21.15.81:0/937972000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5050104100 0x7f50501a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:39.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.692+0000 7f5054c00700 1 -- 172.21.15.81:0/937972000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5050108850 msgr2=0x7f505019ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:39.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.692+0000 7f5054c00700 1 --2- 172.21.15.81:0/937972000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5050108850 0x7f505019ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:39.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.692+0000 7f5054c00700 1 -- 172.21.15.81:0/937972000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505019c170 con 0x7f5050103750 2024-05-03T16:44:39.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.693+0000 7f5054c00700 1 --2- 172.21.15.81:0/937972000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5050103750 0x7f50501a1850 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f504400d980 tx=0x7f504400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:39.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.693+0000 7f504d600700 1 -- 172.21.15.81:0/937972000 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044017070 con 0x7f5050103750 2024-05-03T16:44:39.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.693+0000 7f504d600700 1 -- 172.21.15.81:0/937972000 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5044004830 con 0x7f5050103750 2024-05-03T16:44:39.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.693+0000 7f504d600700 1 -- 172.21.15.81:0/937972000 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50440053a0 con 0x7f5050103750 2024-05-03T16:44:39.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.693+0000 7f5057600700 1 -- 172.21.15.81:0/937972000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505019c460 con 0x7f5050103750 2024-05-03T16:44:39.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.693+0000 7f5057600700 1 -- 172.21.15.81:0/937972000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50501a8720 con 0x7f5050103750 2024-05-03T16:44:39.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.695+0000 7f5057600700 1 -- 172.21.15.81:0/937972000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f505006a190 con 0x7f5050103750 2024-05-03T16:44:39.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.698+0000 7f504d600700 1 -- 172.21.15.81:0/937972000 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f50440049e0 con 0x7f5050103750 2024-05-03T16:44:39.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.700+0000 7f504d600700 1 --2- 172.21.15.81:0/937972000 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f50380b2900 0x7f50380b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:39.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.700+0000 7f504d600700 1 -- 172.21.15.81:0/937972000 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9063+0+0 (secure 0 0 0) 0x7f50440e28d0 con 0x7f5050103750 2024-05-03T16:44:39.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.700+0000 7f504fe00700 1 --2- 172.21.15.81:0/937972000 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f50380b2900 0x7f50380b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.701+0000 7f504d600700 1 -- 172.21.15.81:0/937972000 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f5044020020 con 0x7f5050103750 2024-05-03T16:44:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.701+0000 7f504fe00700 1 --2- 172.21.15.81:0/937972000 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f50380b2900 0x7f50380b4dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f503c005950 tx=0x7f503c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:39.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:39 smithi134 ceph-mon[31708]: pgmap v396: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:39.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:39 smithi146 ceph-mon[32357]: pgmap v396: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.939+0000 7f5057600700 1 -- 172.21.15.81:0/937972000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50501a88f0 con 0x7f5050103750 2024-05-03T16:44:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.943+0000 7f504d600700 1 -- 172.21.15.81:0/937972000 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24580 (secure 0 0 0) 0x7f50440aa2d0 con 0x7f5050103750 2024-05-03T16:44:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:44:39.946 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":89,"fsid":"8988869e-096a-11ef-bc97-c7b262605968","created":"2024-05-03T16:32:56.440204+0000","modified":"2024-05-03T16:44:18.356188+0000","last_up_change":"2024-05-03T16:42:31.768974+0000","last_in_change":"2024-05-03T16:42:06.989688+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T16:37:18.271939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T16:43:50.469793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T16:43:54.708564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T16:44:09.064474+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"957b05dc-dfb9-4561-8800-b7ec0aba679d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6803","nonce":1639968055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6805","nonce":1639968055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6809","nonce":1639968055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6807","nonce":1639968055}]},"public_addr":"172.21.15.81:6803/1639968055","cluster_addr":"172.21.15.81:6805/1639968055","heartbeat_back_addr":"172.21.15.81:6809/1639968055","heartbeat_front_addr":"172.21.15.81:6807/1639968055","state":["exists","up"]},{"osd":1,"uuid":"3bb199cd-b4d0-4c67-b98f-2106336dd57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6801","nonce":1928503491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6803","nonce":1928503491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6807","nonce":1928503491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6805","nonce":1928503491}]},"public_addr":"172.21.15.134:6801/1928503491","cluster_addr":"172.21.15.134:6803/1928503491","heartbeat_back_addr":"172.21.15.134:6807/1928503491","heartbeat_front_addr":"172.21.15.134:6805/1928503491","state":["exists","up"]},{"osd":2,"uuid":"79ec9995-50e8-4eaf-935a-39a479925734","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6801","nonce":1233108455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6803","nonce":1233108455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6807","nonce":1233108455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6805","nonce":1233108455}]},"public_addr":"172.21.15.146:6801/1233108455","cluster_addr":"172.21.15.146:6803/1233108455","heartbeat_back_addr":"172.21.15.146:6807/1233108455","heartbeat_front_addr":"172.21.15.146:6805/1233108455","state":["exists","up"]},{"osd":3,"uuid":"2d38f4e7-73c3-4e70-9f87-d44da28db452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6811","nonce":4128709465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6813","nonce":4128709465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6817","nonce":4128709465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6815","nonce":4128709465}]},"public_addr":"172.21.15.81:6811/4128709465","cluster_addr":"172.21.15.81:6813/4128709465","heartbeat_back_addr":"172.21.15.81:6817/4128709465","heartbeat_front_addr":"172.21.15.81:6815/4128709465","state":["exists","up"]},{"osd":4,"uuid":"3837a136-a25b-4cb9-aa82-084b477c67d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6809","nonce":1498616220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6811","nonce":1498616220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6815","nonce":1498616220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6813","nonce":1498616220}]},"public_addr":"172.21.15.134:6809/1498616220","cluster_addr":"172.21.15.134:6811/1498616220","heartbeat_back_addr":"172.21.15.134:6815/1498616220","heartbeat_front_addr":"172.21.15.134:6813/1498616220","state":["exists","up"]},{"osd":5,"uuid":"2e783d2e-c181-41a9-97de-f17705a201bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6809","nonce":1276988922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6811","nonce":1276988922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6815","nonce":1276988922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6813","nonce":1276988922}]},"public_addr":"172.21.15.146:6809/1276988922","cluster_addr":"172.21.15.146:6811/1276988922","heartbeat_back_addr":"172.21.15.146:6815/1276988922","heartbeat_front_addr":"172.21.15.146:6813/1276988922","state":["exists","up"]},{"osd":6,"uuid":"6faebdbf-7820-42e5-b07c-15db11f278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6819","nonce":3319125020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6821","nonce":3319125020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6825","nonce":3319125020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6823","nonce":3319125020}]},"public_addr":"172.21.15.81:6819/3319125020","cluster_addr":"172.21.15.81:6821/3319125020","heartbeat_back_addr":"172.21.15.81:6825/3319125020","heartbeat_front_addr":"172.21.15.81:6823/3319125020","state":["exists","up"]},{"osd":7,"uuid":"ec4b6b84-6c5f-4d07-a747-06610b2cd345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6817","nonce":3241993481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6819","nonce":3241993481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6823","nonce":3241993481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6821","nonce":3241993481}]},"public_addr":"172.21.15.134:6817/3241993481","cluster_addr":"172.21.15.134:6819/3241993481","heartbeat_back_addr":"172.21.15.134:6823/3241993481","heartbeat_front_addr":"172.21.15.134:6821/3241993481","state":["exists","up"]},{"osd":8,"uuid":"02b1b0fd-837c-4c29-bedb-54fa2ee7531d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6817","nonce":2423161684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6819","nonce":2423161684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6823","nonce":2423161684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6821","nonce":2423161684}]},"public_addr":"172.21.15.146:6817/2423161684","cluster_addr":"172.21.15.146:6819/2423161684","heartbeat_back_addr":"172.21.15.146:6823/2423161684","heartbeat_front_addr":"172.21.15.146:6821/2423161684","state":["exists","up"]},{"osd":9,"uuid":"46713a8e-743d-44d5-babe-c01d3179afcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6827","nonce":873909886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6829","nonce":873909886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6833","nonce":873909886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6831","nonce":873909886}]},"public_addr":"172.21.15.81:6827/873909886","cluster_addr":"172.21.15.81:6829/873909886","heartbeat_back_addr":"172.21.15.81:6833/873909886","heartbeat_front_addr":"172.21.15.81:6831/873909886","state":["exists","up"]},{"osd":10,"uuid":"12fcae89-30af-436b-a513-3998303da93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6825","nonce":1183629038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6827","nonce":1183629038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6831","nonce":1183629038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6829","nonce":1183629038}]},"public_addr":"172.21.15.134:6825/1183629038","cluster_addr":"172.21.15.134:6827/1183629038","heartbeat_back_addr":"172.21.15.134:6831/1183629038","heartbeat_front_addr":"172.21.15.134:6829/1183629038","state":["exists","up"]},{"osd":11,"uuid":"a543f42c-61da-4a93-b16b-a2891a4ef873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6825","nonce":2627233639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6827","nonce":2627233639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6831","nonce":2627233639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6829","nonce":2627233639}]},"public_addr":"172.21.15.146:6825/2627233639","cluster_addr":"172.21.15.146:6827/2627233639","heartbeat_back_addr":"172.21.15.146:6831/2627233639","heartbeat_front_addr":"172.21.15.146:6829/2627233639","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:08.411954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:41.459869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:15.068172+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:49.711273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:23.231811+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:57.917964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:39:32.982397+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:07.434610+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:43.606108+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:19.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:54.917284+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:42:30.525217+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6801/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/2237510960":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6801/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/3199433706":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1689714816":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/2777950369":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/1982866220":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1112375028":"2024-05-04T16:33:30.274051+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T16:44:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.946+0000 7f5057600700 1 -- 172.21.15.81:0/937972000 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f50380b2900 msgr2=0x7f50380b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.946+0000 7f5057600700 1 --2- 172.21.15.81:0/937972000 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f50380b2900 0x7f50380b4dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f503c005950 tx=0x7f503c0058e0 comp rx=0 tx=0).stop 2024-05-03T16:44:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.946+0000 7f5057600700 1 -- 172.21.15.81:0/937972000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5050103750 msgr2=0x7f50501a1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.946+0000 7f5057600700 1 --2- 172.21.15.81:0/937972000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5050103750 0x7f50501a1850 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f504400d980 tx=0x7f504400dd40 comp rx=0 tx=0).stop 2024-05-03T16:44:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.947+0000 7f5057600700 1 -- 172.21.15.81:0/937972000 shutdown_connections 2024-05-03T16:44:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.947+0000 7f5057600700 1 --2- 172.21.15.81:0/937972000 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f50380b2900 0x7f50380b4dc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.947+0000 7f5057600700 1 --2- 172.21.15.81:0/937972000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5050108850 0x7f505019ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.947+0000 7f5057600700 1 --2- 172.21.15.81:0/937972000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5050103750 0x7f50501a1850 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.947+0000 7f5057600700 1 --2- 172.21.15.81:0/937972000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5050104100 0x7f50501a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.947+0000 7f5057600700 1 -- 172.21.15.81:0/937972000 >> 172.21.15.81:0/937972000 conn(0x7f505007a600 msgr2=0x7f5050101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.947+0000 7f5057600700 1 -- 172.21.15.81:0/937972000 shutdown_connections 2024-05-03T16:44:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:39.947+0000 7f5057600700 1 -- 172.21.15.81:0/937972000 wait complete. 2024-05-03T16:44:40.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:40 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/937972000' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:44:40.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:40 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/937972000' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:44:40.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:40 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/937972000' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:44:40.865 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-03T16:43:58.734681+0000', 'modified': '2024-05-03T16:44:18.356731+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34466}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34466': {'gid': 34466, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.134:6839/2061491127', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6838', 'nonce': 2061491127}, {'type': 'v1', 'addr': '172.21.15.134:6839', 'nonce': 2061491127}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 34466, 'qdb_cluster': [34466]} 2024-05-03T16:44:40.865 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-03T16:44:40.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-03T16:44:41.314 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:44:41.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:41 smithi134 ceph-mon[31708]: pgmap v397: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:41.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:41 smithi081 ceph-mon[28640]: pgmap v397: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:41.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:41 smithi146 ceph-mon[32357]: pgmap v397: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:43.597 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:43 smithi081 ceph-mon[28640]: pgmap v398: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:43.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.647+0000 7f9713200700 1 -- 172.21.15.81:0/1647063714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f970c10b6c0 msgr2=0x7f970c10baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:43.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.647+0000 7f9713200700 1 --2- 172.21.15.81:0/1647063714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f970c10b6c0 0x7f970c10baa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f96fc009990 tx=0x7f96fc009ca0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.647+0000 7f9713200700 1 -- 172.21.15.81:0/1647063714 shutdown_connections 2024-05-03T16:44:43.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.647+0000 7f9713200700 1 --2- 172.21.15.81:0/1647063714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f970c106080 0x7f970c112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.647+0000 7f9713200700 1 --2- 172.21.15.81:0/1647063714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f970c10b6c0 0x7f970c10baa0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.647+0000 7f9713200700 1 --2- 172.21.15.81:0/1647063714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f970c1056c0 0x7f970c105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.647+0000 7f9713200700 1 -- 172.21.15.81:0/1647063714 >> 172.21.15.81:0/1647063714 conn(0x7f970c1011b0 msgr2=0x7f970c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:43.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.647+0000 7f9713200700 1 -- 172.21.15.81:0/1647063714 shutdown_connections 2024-05-03T16:44:43.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.647+0000 7f9713200700 1 -- 172.21.15.81:0/1647063714 wait complete. 2024-05-03T16:44:43.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.648+0000 7f9713200700 1 Processor -- start 2024-05-03T16:44:43.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.648+0000 7f9713200700 1 -- start start 2024-05-03T16:44:43.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.649+0000 7f9713200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f970c1056c0 0x7f970c19bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:43.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.649+0000 7f9713200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f970c106080 0x7f970c19c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:43.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.649+0000 7f9713200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f970c10b6c0 0x7f970c1a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:43.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.649+0000 7f9713200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f970c115800 con 0x7f970c10b6c0 2024-05-03T16:44:43.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.649+0000 7f9713200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f970c115680 con 0x7f970c1056c0 2024-05-03T16:44:43.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.649+0000 7f9713200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f970c115980 con 0x7f970c106080 2024-05-03T16:44:43.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.649+0000 7f9711200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f970c10b6c0 0x7f970c1a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:43.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.649+0000 7f9711200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f970c10b6c0 0x7f970c1a05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49864/0 (socket says 172.21.15.81:49864) 2024-05-03T16:44:43.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.649+0000 7f9711200700 1 -- 172.21.15.81:0/2203107979 learned_addr learned my addr 172.21.15.81:0/2203107979 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:44:43.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.649+0000 7f970be00700 1 --2- 172.21.15.81:0/2203107979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f970c1056c0 0x7f970c19bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:43.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.650+0000 7f9703e00700 1 --2- 172.21.15.81:0/2203107979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f970c106080 0x7f970c19c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:43.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.650+0000 7f9711200700 1 -- 172.21.15.81:0/2203107979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f970c106080 msgr2=0x7f970c19c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:43.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.650+0000 7f9711200700 1 --2- 172.21.15.81:0/2203107979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f970c106080 0x7f970c19c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.650+0000 7f9711200700 1 -- 172.21.15.81:0/2203107979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f970c1056c0 msgr2=0x7f970c19bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:43.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.650+0000 7f9711200700 1 --2- 172.21.15.81:0/2203107979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f970c1056c0 0x7f970c19bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.650+0000 7f9711200700 1 -- 172.21.15.81:0/2203107979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970c1a0d20 con 0x7f970c10b6c0 2024-05-03T16:44:43.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.650+0000 7f970be00700 1 --2- 172.21.15.81:0/2203107979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f970c1056c0 0x7f970c19bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:44:43.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.650+0000 7f9711200700 1 --2- 172.21.15.81:0/2203107979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f970c10b6c0 0x7f970c1a05e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f970400ada0 tx=0x7f970400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:43.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.650+0000 7f9709600700 1 -- 172.21.15.81:0/2203107979 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9704017020 con 0x7f970c10b6c0 2024-05-03T16:44:43.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.651+0000 7f9709600700 1 -- 172.21.15.81:0/2203107979 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f970400ce10 con 0x7f970c10b6c0 2024-05-03T16:44:43.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.651+0000 7f9709600700 1 -- 172.21.15.81:0/2203107979 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9704005440 con 0x7f970c10b6c0 2024-05-03T16:44:43.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.651+0000 7f9713200700 1 -- 172.21.15.81:0/2203107979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f970c1a1010 con 0x7f970c10b6c0 2024-05-03T16:44:43.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.651+0000 7f9713200700 1 -- 172.21.15.81:0/2203107979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f970c1a8890 con 0x7f970c10b6c0 2024-05-03T16:44:43.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.654+0000 7f9709600700 1 -- 172.21.15.81:0/2203107979 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9704004ad0 con 0x7f970c10b6c0 2024-05-03T16:44:43.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.655+0000 7f971db32b80 1 Processor -- start 2024-05-03T16:44:43.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.656+0000 7f971db32b80 1 -- start start 2024-05-03T16:44:43.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.656+0000 7f971db32b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb963760 0x55fedb963b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:43.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.656+0000 7f9709600700 1 --2- 172.21.15.81:0/2203107979 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f96f00b2900 0x7f96f00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:43.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.656+0000 7f971db32b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb964080 0x55fedb95ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:43.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.656+0000 7f971db32b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fedb95f580 0x55fedb95f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:43.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.656+0000 7f971db32b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fedb8b19d0 con 0x55fedb964080 2024-05-03T16:44:43.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.656+0000 7f971db32b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fedb84f710 con 0x55fedb963760 2024-05-03T16:44:43.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.656+0000 7f971db32b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55fedb8ad990 con 0x55fedb95f580 2024-05-03T16:44:43.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.656+0000 7f9709600700 1 -- 172.21.15.81:0/2203107979 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9063+0+0 (secure 0 0 0) 0x7f97040e1cf0 con 0x7f970c10b6c0 2024-05-03T16:44:43.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.656+0000 7f970be00700 1 --2- 172.21.15.81:0/2203107979 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f96f00b2900 0x7f96f00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:43.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.656+0000 7f9703e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb964080 0x55fedb95ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:43.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.656+0000 7f9703e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb964080 0x55fedb95ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49878/0 (socket says 172.21.15.81:49878) 2024-05-03T16:44:43.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.656+0000 7f9703e00700 1 -- 172.21.15.81:0/2130988039 learned_addr learned my addr 172.21.15.81:0/2130988039 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:44:43.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.657+0000 7f9711200700 1 --2- 172.21.15.81:0/2130988039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fedb95f580 0x55fedb95f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:43.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.657+0000 7f9703e00700 1 --2- 172.21.15.81:0/2130988039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb963760 0x55fedb963b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:43.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.657+0000 7f9703e00700 1 -- 172.21.15.81:0/2130988039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fedb95f580 msgr2=0x55fedb95f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:44:43.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.657+0000 7f9703e00700 1 --2- 172.21.15.81:0/2130988039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fedb95f580 0x55fedb95f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.657+0000 7f9703e00700 1 -- 172.21.15.81:0/2130988039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb963760 msgr2=0x55fedb963b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:44:43.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.657+0000 7f9703e00700 1 --2- 172.21.15.81:0/2130988039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb963760 0x55fedb963b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.657+0000 7f9703e00700 1 -- 172.21.15.81:0/2130988039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fedb7fe880 con 0x55fedb964080 2024-05-03T16:44:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.657+0000 7f970be00700 1 --2- 172.21.15.81:0/2203107979 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f96f00b2900 0x7f96f00b4dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00b5c0 tx=0x7f96fc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.658+0000 7f9703e00700 1 --2- 172.21.15.81:0/2130988039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb964080 0x55fedb95ef60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f96f4016580 tx=0x7f96f400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d13ee135a9894ae server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.658+0000 7f9701600700 1 -- 172.21.15.81:0/2130988039 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f4016ba0 con 0x55fedb964080 2024-05-03T16:44:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.658+0000 7f9701600700 1 -- 172.21.15.81:0/2130988039 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96f4016d40 con 0x55fedb964080 2024-05-03T16:44:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.658+0000 7f9701600700 1 -- 172.21.15.81:0/2130988039 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f4012390 con 0x55fedb964080 2024-05-03T16:44:43.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.659+0000 7f971db32b80 1 -- 172.21.15.81:0/2130988039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb964080 msgr2=0x55fedb95ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:43.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.659+0000 7f971db32b80 1 --2- 172.21.15.81:0/2130988039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb964080 0x55fedb95ef60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f96f4016580 tx=0x7f96f400a340 comp rx=0 tx=0).stop 2024-05-03T16:44:43.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.659+0000 7f971db32b80 1 -- 172.21.15.81:0/2130988039 shutdown_connections 2024-05-03T16:44:43.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.659+0000 7f971db32b80 1 --2- 172.21.15.81:0/2130988039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fedb95f580 0x55fedb95f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.659+0000 7f971db32b80 1 --2- 172.21.15.81:0/2130988039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb963760 0x55fedb963b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.659+0000 7f971db32b80 1 --2- 172.21.15.81:0/2130988039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb964080 0x55fedb95ef60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.659+0000 7f971db32b80 1 -- 172.21.15.81:0/2130988039 >> 172.21.15.81:0/2130988039 conn(0x55fedb88db10 msgr2=0x55fedb9597a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:43.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.659+0000 7f971db32b80 1 -- 172.21.15.81:0/2130988039 shutdown_connections 2024-05-03T16:44:43.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.659+0000 7f971db32b80 1 -- 172.21.15.81:0/2130988039 wait complete. 2024-05-03T16:44:43.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.660+0000 7f971db32b80 1 -- start start 2024-05-03T16:44:43.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.660+0000 7f971db32b80 1 Processor -- start 2024-05-03T16:44:43.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.660+0000 7f971db32b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb95f580 0x55fedb96aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:43.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.660+0000 7f971db32b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb963760 0x55fedb9682b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:43.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.660+0000 7f971db32b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fedb964080 0x55fedb9687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:43.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.660+0000 7f971db32b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fedb96bbf0 con 0x55fedb95f580 2024-05-03T16:44:43.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.660+0000 7f971db32b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fedb817ad0 con 0x55fedb963760 2024-05-03T16:44:43.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.660+0000 7f971db32b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55fedb96bd70 con 0x55fedb964080 2024-05-03T16:44:43.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.661+0000 7f971db32b80 10 client.0 _ll_register_callbacks cb 0x55fedb858c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:44:43.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.661+0000 7f970be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb95f580 0x55fedb96aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:43.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.661+0000 7f970be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb95f580 0x55fedb96aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49882/0 (socket says 172.21.15.81:49882) 2024-05-03T16:44:43.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.661+0000 7f970be00700 1 -- 172.21.15.81:0/3249399985 learned_addr learned my addr 172.21.15.81:0/3249399985 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:44:43.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.661+0000 7f9703e00700 1 --2- 172.21.15.81:0/3249399985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb963760 0x55fedb9682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:43.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.661+0000 7f9711200700 1 --2- 172.21.15.81:0/3249399985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fedb964080 0x55fedb9687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:43.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.661+0000 7f970be00700 1 -- 172.21.15.81:0/3249399985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fedb964080 msgr2=0x55fedb9687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:44:43.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.661+0000 7f970be00700 1 --2- 172.21.15.81:0/3249399985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fedb964080 0x55fedb9687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.661+0000 7f970be00700 1 -- 172.21.15.81:0/3249399985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb963760 msgr2=0x55fedb9682b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:44:43.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.661+0000 7f970be00700 1 --2- 172.21.15.81:0/3249399985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb963760 0x55fedb9682b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.661+0000 7f970be00700 1 -- 172.21.15.81:0/3249399985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fedb8773d0 con 0x55fedb95f580 2024-05-03T16:44:43.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.661+0000 7f9703e00700 1 --2- 172.21.15.81:0/3249399985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb963760 0x55fedb9682b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:44:43.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.662+0000 7f970be00700 1 --2- 172.21.15.81:0/3249399985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb95f580 0x55fedb96aea0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f96fc015000 tx=0x7f96fc009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fdaf3e340184c97 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:43.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.662+0000 7f96fa000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:44:43.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.662+0000 7f96fa000700 1 -- 172.21.15.81:0/3249399985 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc023820 con 0x55fedb95f580 2024-05-03T16:44:43.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.662+0000 7f96fa000700 1 -- 172.21.15.81:0/3249399985 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9063+0+0 (secure 0 0 0) 0x7f96fc0239c0 con 0x55fedb95f580 2024-05-03T16:44:43.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.662+0000 7f971db32b80 1 -- 172.21.15.81:0/3249399985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96f4016d40 con 0x55fedb95f580 2024-05-03T16:44:43.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.662+0000 7f96fa000700 1 -- 172.21.15.81:0/3249399985 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f96fc03b050 con 0x55fedb95f580 2024-05-03T16:44:43.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.662+0000 7f971db32b80 10 client.14700 fetch_fsmap learned FSMap version 17 2024-05-03T16:44:43.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.662+0000 7f971db32b80 1 -- 172.21.15.81:0/3249399985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55fedb976490 con 0x55fedb95f580 2024-05-03T16:44:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.663+0000 7f96fa000700 1 -- 172.21.15.81:0/3249399985 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96f4016d40 con 0x55fedb95f580 2024-05-03T16:44:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.663+0000 7f96fa000700 1 -- 172.21.15.81:0/3249399985 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7f96fc02da40 con 0x55fedb95f580 2024-05-03T16:44:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.663+0000 7f971db32b80 10 client.14700 fetch_fsmap finished waiting for FSMap version 17 2024-05-03T16:44:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.663+0000 7f971db32b80 10 client.14700 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-03T16:44:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.663+0000 7f971db32b80 20 client.14700 populate_metadata read hostname 'smithi081' 2024-05-03T16:44:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.663+0000 7f971db32b80 1 --2- 172.21.15.81:0/3249399985 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55fedb978b40 0x55fedb979fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.663+0000 7f971db32b80 4 client.14700 mds_command: new command op to 34466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T16:44:43.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.663+0000 7f971db32b80 1 -- 172.21.15.81:0/3249399985 --> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fedb92c180 con 0x55fedb978b40 2024-05-03T16:44:43.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.664+0000 7f9703e00700 1 --2- 172.21.15.81:0/3249399985 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55fedb978b40 0x55fedb979fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:43.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.665+0000 7f9703e00700 1 --2- 172.21.15.81:0/3249399985 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55fedb978b40 0x55fedb979fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=731741562b29619 server_cookie=961426ca31af3b86 in_seq=0 out_seq=0 2024-05-03T16:44:43.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.665+0000 7f96fa000700 10 client.14700 ms_handle_connect on v2:172.21.15.134:6838/2061491127 2024-05-03T16:44:43.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.667+0000 7f96fa000700 1 -- 172.21.15.81:0/3249399985 <== mds.0 v2:172.21.15.134:6838/2061491127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fedb92c180 con 0x55fedb978b40 2024-05-03T16:44:43.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.667+0000 7f96fa000700 10 client.14700 handle_command_reply: tid=0 2024-05-03T16:44:43.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.667+0000 7f971db32b80 1 client.14700 shutdown 2024-05-03T16:44:43.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.667+0000 7f971db32b80 1 -- 172.21.15.81:0/3249399985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb95f580 msgr2=0x55fedb96aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:43.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.667+0000 7f971db32b80 1 --2- 172.21.15.81:0/3249399985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb95f580 0x55fedb96aea0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f96fc015000 tx=0x7f96fc009310 comp rx=0 tx=0).stop 2024-05-03T16:44:43.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.667+0000 7f971db32b80 1 -- 172.21.15.81:0/3249399985 shutdown_connections 2024-05-03T16:44:43.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.667+0000 7f971db32b80 1 --2- 172.21.15.81:0/3249399985 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55fedb978b40 0x55fedb979fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.667+0000 7f971db32b80 1 --2- 172.21.15.81:0/3249399985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fedb964080 0x55fedb9687f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.667+0000 7f971db32b80 1 --2- 172.21.15.81:0/3249399985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb95f580 0x55fedb96aea0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.667+0000 7f971db32b80 1 --2- 172.21.15.81:0/3249399985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb963760 0x55fedb9682b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.667+0000 7f971db32b80 1 -- 172.21.15.81:0/3249399985 >> 172.21.15.81:0/3249399985 conn(0x55fedb88db10 msgr2=0x55fedb964db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:43.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.668+0000 7f96fa000700 0 client.14700 ms_handle_reset on v2:172.21.15.134:6838/2061491127 2024-05-03T16:44:43.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.668+0000 7f971db32b80 1 -- 172.21.15.81:0/3249399985 shutdown_connections 2024-05-03T16:44:43.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.668+0000 7f971db32b80 1 -- 172.21.15.81:0/3249399985 wait complete. 2024-05-03T16:44:43.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.668+0000 7f971db32b80 20 client.14700 trim_cache size 0 max 16384 2024-05-03T16:44:43.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.690+0000 7f971db32b80 1 Processor -- start 2024-05-03T16:44:43.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.690+0000 7f971db32b80 1 -- start start 2024-05-03T16:44:43.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.691+0000 7f971db32b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fedb95f580 0x55fedb96a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:43.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.691+0000 7f971db32b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb963760 0x55fedb95f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:43.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.691+0000 7f971db32b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb964080 0x55fedb962c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:43.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.691+0000 7f971db32b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fedb9782f0 con 0x55fedb963760 2024-05-03T16:44:43.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.691+0000 7f971db32b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fedb9789c0 con 0x55fedb964080 2024-05-03T16:44:43.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.691+0000 7f971db32b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55fedb979090 con 0x55fedb95f580 2024-05-03T16:44:43.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.691+0000 7f9703e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb963760 0x55fedb95f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:43.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.691+0000 7f9703e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb963760 0x55fedb95f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49894/0 (socket says 172.21.15.81:49894) 2024-05-03T16:44:43.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.691+0000 7f9703e00700 1 -- 172.21.15.81:0/3353550323 learned_addr learned my addr 172.21.15.81:0/3353550323 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:44:43.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.691+0000 7f9703e00700 1 -- 172.21.15.81:0/3353550323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fedb95f580 msgr2=0x55fedb96a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:44:43.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.691+0000 7f9703e00700 1 --2- 172.21.15.81:0/3353550323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fedb95f580 0x55fedb96a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.691+0000 7f9711200700 1 --2- 172.21.15.81:0/3353550323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb964080 0x55fedb962c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:43.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.691+0000 7f9703e00700 1 -- 172.21.15.81:0/3353550323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb964080 msgr2=0x55fedb962c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:44:43.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.692+0000 7f9703e00700 1 --2- 172.21.15.81:0/3353550323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb964080 0x55fedb962c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.692+0000 7f9703e00700 1 -- 172.21.15.81:0/3353550323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fedb97af10 con 0x55fedb963760 2024-05-03T16:44:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.692+0000 7f9703e00700 1 --2- 172.21.15.81:0/3353550323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb963760 0x55fedb95f960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f96f4017010 tx=0x7f96f400a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9133c6cd7b31ed server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.692+0000 7f9700c00700 1 -- 172.21.15.81:0/3353550323 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f401d040 con 0x55fedb963760 2024-05-03T16:44:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.692+0000 7f9700c00700 1 -- 172.21.15.81:0/3353550323 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96f400a150 con 0x55fedb963760 2024-05-03T16:44:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.692+0000 7f9700c00700 1 -- 172.21.15.81:0/3353550323 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f4026170 con 0x55fedb963760 2024-05-03T16:44:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.693+0000 7f971db32b80 1 -- 172.21.15.81:0/3353550323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb963760 msgr2=0x55fedb95f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.693+0000 7f971db32b80 1 --2- 172.21.15.81:0/3353550323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb963760 0x55fedb95f960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f96f4017010 tx=0x7f96f400a410 comp rx=0 tx=0).stop 2024-05-03T16:44:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.693+0000 7f971db32b80 1 -- 172.21.15.81:0/3353550323 shutdown_connections 2024-05-03T16:44:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.693+0000 7f971db32b80 1 --2- 172.21.15.81:0/3353550323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fedb95f580 0x55fedb96a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.693+0000 7f971db32b80 1 --2- 172.21.15.81:0/3353550323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb964080 0x55fedb962c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.693+0000 7f971db32b80 1 --2- 172.21.15.81:0/3353550323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb963760 0x55fedb95f960 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.693+0000 7f971db32b80 1 -- 172.21.15.81:0/3353550323 >> 172.21.15.81:0/3353550323 conn(0x55fedb88db10 msgr2=0x55fedb95e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.693+0000 7f971db32b80 1 -- 172.21.15.81:0/3353550323 shutdown_connections 2024-05-03T16:44:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.693+0000 7f971db32b80 1 -- 172.21.15.81:0/3353550323 wait complete. 2024-05-03T16:44:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.693+0000 7f971db32b80 1 -- start start 2024-05-03T16:44:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.694+0000 7f971db32b80 1 Processor -- start 2024-05-03T16:44:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.694+0000 7f971db32b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb95f580 0x55fedb983430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.694+0000 7f971db32b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb963760 0x55fedb983970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.694+0000 7f971db32b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fedb964080 0x55fedb97c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.694+0000 7f971db32b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fedb979e30 con 0x55fedb95f580 2024-05-03T16:44:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.694+0000 7f971db32b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fedb979760 con 0x55fedb963760 2024-05-03T16:44:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.694+0000 7f971db32b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55fedb97a500 con 0x55fedb964080 2024-05-03T16:44:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.694+0000 7f971db32b80 10 client.0 _ll_register_callbacks cb 0x55fedb858c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:44:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.694+0000 7f970be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb95f580 0x55fedb983430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.694+0000 7f970be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb95f580 0x55fedb983430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49904/0 (socket says 172.21.15.81:49904) 2024-05-03T16:44:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.694+0000 7f970be00700 1 -- 172.21.15.81:0/39589920 learned_addr learned my addr 172.21.15.81:0/39589920 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:44:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.695+0000 7f9703e00700 1 --2- 172.21.15.81:0/39589920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb963760 0x55fedb983970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.695+0000 7f9711200700 1 --2- 172.21.15.81:0/39589920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fedb964080 0x55fedb97c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.695+0000 7f970be00700 1 -- 172.21.15.81:0/39589920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fedb964080 msgr2=0x55fedb97c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:44:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.695+0000 7f970be00700 1 --2- 172.21.15.81:0/39589920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fedb964080 0x55fedb97c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.695+0000 7f970be00700 1 -- 172.21.15.81:0/39589920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb963760 msgr2=0x55fedb983970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:44:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.695+0000 7f970be00700 1 --2- 172.21.15.81:0/39589920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb963760 0x55fedb983970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.695+0000 7f970be00700 1 -- 172.21.15.81:0/39589920 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fedb97ca10 con 0x55fedb95f580 2024-05-03T16:44:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.695+0000 7f9703e00700 1 --2- 172.21.15.81:0/39589920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb963760 0x55fedb983970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:44:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.695+0000 7f970be00700 1 --2- 172.21.15.81:0/39589920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb95f580 0x55fedb983430 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f96fc02dde0 tx=0x7f96fc005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6651c4356b432d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.695+0000 7f96fa000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:44:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.695+0000 7f96fa000700 1 -- 172.21.15.81:0/39589920 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc044060 con 0x55fedb95f580 2024-05-03T16:44:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.695+0000 7f96fa000700 1 -- 172.21.15.81:0/39589920 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9063+0+0 (secure 0 0 0) 0x7f96fc017a90 con 0x55fedb95f580 2024-05-03T16:44:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.695+0000 7f971db32b80 1 -- 172.21.15.81:0/39589920 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96f400a150 con 0x55fedb95f580 2024-05-03T16:44:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.696+0000 7f96fa000700 1 -- 172.21.15.81:0/39589920 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f96fc04b050 con 0x55fedb95f580 2024-05-03T16:44:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.696+0000 7f971db32b80 10 client.14706 fetch_fsmap learned FSMap version 17 2024-05-03T16:44:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.696+0000 7f971db32b80 1 -- 172.21.15.81:0/39589920 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55fedb9e48d0 con 0x55fedb95f580 2024-05-03T16:44:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.696+0000 7f96fa000700 1 -- 172.21.15.81:0/39589920 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96f400a150 con 0x55fedb95f580 2024-05-03T16:44:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.696+0000 7f96fa000700 1 -- 172.21.15.81:0/39589920 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7f96fc0051c0 con 0x55fedb95f580 2024-05-03T16:44:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.696+0000 7f971db32b80 10 client.14706 fetch_fsmap finished waiting for FSMap version 17 2024-05-03T16:44:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.696+0000 7f971db32b80 10 client.14706 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-03T16:44:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.696+0000 7f971db32b80 20 client.14706 populate_metadata read hostname 'smithi081' 2024-05-03T16:44:43.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.696+0000 7f971db32b80 1 --2- 172.21.15.81:0/39589920 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55fedb9e94e0 0x55fedb9e81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:43.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.696+0000 7f971db32b80 4 client.14706 mds_command: new command op to 34466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T16:44:43.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.696+0000 7f971db32b80 1 -- 172.21.15.81:0/39589920 --> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] -- command(tid 0: {"prefix": "status"}) -- 0x55fedb8bf3b0 con 0x55fedb9e94e0 2024-05-03T16:44:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.697+0000 7f9703e00700 1 --2- 172.21.15.81:0/39589920 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55fedb9e94e0 0x55fedb9e81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.698+0000 7f9703e00700 1 --2- 172.21.15.81:0/39589920 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55fedb9e94e0 0x55fedb9e81f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c64e44395fa8f80 server_cookie=d35bf613a784856d in_seq=0 out_seq=0 2024-05-03T16:44:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.698+0000 7f96fa000700 10 client.14706 ms_handle_connect on v2:172.21.15.134:6838/2061491127 2024-05-03T16:44:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.698+0000 7f96fa000700 1 -- 172.21.15.81:0/39589920 <== mds.0 v2:172.21.15.134:6838/2061491127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55fedb8bf3b0 con 0x55fedb9e94e0 2024-05-03T16:44:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.699+0000 7f96fa000700 10 client.14706 handle_command_reply: tid=0 2024-05-03T16:44:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.699+0000 7f971db32b80 1 client.14706 shutdown 2024-05-03T16:44:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.699+0000 7f971db32b80 1 -- 172.21.15.81:0/39589920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb95f580 msgr2=0x55fedb983430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.699+0000 7f971db32b80 1 --2- 172.21.15.81:0/39589920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb95f580 0x55fedb983430 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f96fc02dde0 tx=0x7f96fc005c40 comp rx=0 tx=0).stop 2024-05-03T16:44:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.699+0000 7f971db32b80 1 -- 172.21.15.81:0/39589920 shutdown_connections 2024-05-03T16:44:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.699+0000 7f971db32b80 1 --2- 172.21.15.81:0/39589920 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55fedb9e94e0 0x55fedb9e81f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.699+0000 7f971db32b80 1 --2- 172.21.15.81:0/39589920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fedb964080 0x55fedb97c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.699+0000 7f971db32b80 1 --2- 172.21.15.81:0/39589920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedb95f580 0x55fedb983430 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.699+0000 7f971db32b80 1 --2- 172.21.15.81:0/39589920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fedb963760 0x55fedb983970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.699+0000 7f96fa000700 0 client.14706 ms_handle_reset on v2:172.21.15.134:6838/2061491127 2024-05-03T16:44:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.699+0000 7f971db32b80 1 -- 172.21.15.81:0/39589920 >> 172.21.15.81:0/39589920 conn(0x55fedb88db10 msgr2=0x55fedb962ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.699+0000 7f971db32b80 1 -- 172.21.15.81:0/39589920 shutdown_connections 2024-05-03T16:44:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.699+0000 7f971db32b80 1 -- 172.21.15.81:0/39589920 wait complete. 2024-05-03T16:44:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.699+0000 7f971db32b80 20 client.14706 trim_cache size 0 max 16384 2024-05-03T16:44:43.705 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-03T16:44:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8988869e-096a-11ef-bc97-c7b262605968", 2024-05-03T16:44:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-05-03T16:44:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 34466, 2024-05-03T16:44:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-05-03T16:44:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-05-03T16:44:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-05-03T16:44:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 44.760752369999999, 2024-05-03T16:44:43.707 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 17, 2024-05-03T16:44:43.707 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 89, 2024-05-03T16:44:43.707 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 89, 2024-05-03T16:44:43.707 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 64.293366392999999 2024-05-03T16:44:43.707 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-03T16:44:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.700+0000 7f9713200700 1 -- 172.21.15.81:0/2203107979 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f96f00b2900 msgr2=0x7f96f00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.700+0000 7f9713200700 1 --2- 172.21.15.81:0/2203107979 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f96f00b2900 0x7f96f00b4dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00b5c0 tx=0x7f96fc01a040 comp rx=0 tx=0).stop 2024-05-03T16:44:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.700+0000 7f9713200700 1 -- 172.21.15.81:0/2203107979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f970c10b6c0 msgr2=0x7f970c1a05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.700+0000 7f9713200700 1 --2- 172.21.15.81:0/2203107979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f970c10b6c0 0x7f970c1a05e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f970400ada0 tx=0x7f970400c330 comp rx=0 tx=0).stop 2024-05-03T16:44:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.700+0000 7f9713200700 1 -- 172.21.15.81:0/2203107979 shutdown_connections 2024-05-03T16:44:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.700+0000 7f9713200700 1 --2- 172.21.15.81:0/2203107979 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f96f00b2900 0x7f96f00b4dc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.700+0000 7f9713200700 1 --2- 172.21.15.81:0/2203107979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f970c10b6c0 0x7f970c1a05e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.700+0000 7f9713200700 1 --2- 172.21.15.81:0/2203107979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f970c1056c0 0x7f970c19bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.700+0000 7f9713200700 1 --2- 172.21.15.81:0/2203107979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f970c106080 0x7f970c19c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.700+0000 7f9713200700 1 -- 172.21.15.81:0/2203107979 >> 172.21.15.81:0/2203107979 conn(0x7f970c1011b0 msgr2=0x7f970c101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.700+0000 7f9713200700 1 -- 172.21.15.81:0/2203107979 shutdown_connections 2024-05-03T16:44:43.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:43.700+0000 7f9713200700 1 -- 172.21.15.81:0/2203107979 wait complete. 2024-05-03T16:44:43.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:43 smithi134 ceph-mon[31708]: pgmap v398: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:43.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:43 smithi146 ceph-mon[32357]: pgmap v398: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:44.567 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-03T16:44:44.568 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-03T16:44:44.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-03T16:44:45.004 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:44:45.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:45 smithi081 ceph-mon[28640]: pgmap v399: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:45.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:45 smithi146 ceph-mon[32357]: pgmap v399: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:45.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:45 smithi134 ceph-mon[31708]: pgmap v399: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.276+0000 7fb34e000700 1 -- 172.21.15.81:0/1130316126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34810fb60 msgr2=0x7fb34810ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.276+0000 7fb34e000700 1 --2- 172.21.15.81:0/1130316126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34810fb60 0x7fb34810ff40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb338009990 tx=0x7fb338009ca0 comp rx=0 tx=0).stop 2024-05-03T16:44:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.276+0000 7fb34e000700 1 -- 172.21.15.81:0/1130316126 shutdown_connections 2024-05-03T16:44:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.276+0000 7fb34e000700 1 --2- 172.21.15.81:0/1130316126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb34810a490 0x7fb3481169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.276+0000 7fb34e000700 1 --2- 172.21.15.81:0/1130316126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34810fb60 0x7fb34810ff40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.276+0000 7fb34e000700 1 --2- 172.21.15.81:0/1130316126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb348109ad0 0x7fb348109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.276+0000 7fb34e000700 1 -- 172.21.15.81:0/1130316126 >> 172.21.15.81:0/1130316126 conn(0x7fb348076c70 msgr2=0x7fb3481082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.276+0000 7fb34e000700 1 -- 172.21.15.81:0/1130316126 shutdown_connections 2024-05-03T16:44:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.276+0000 7fb34e000700 1 -- 172.21.15.81:0/1130316126 wait complete. 2024-05-03T16:44:47.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.277+0000 7fb34e000700 1 Processor -- start 2024-05-03T16:44:47.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.277+0000 7fb34e000700 1 -- start start 2024-05-03T16:44:47.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.278+0000 7fb34e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb348109ad0 0x7fb3481a0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:47.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.278+0000 7fb34e000700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb34810a490 0x7fb3481a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:47.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.278+0000 7fb34e000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb34810fb60 0x7fb3481a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:47.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.278+0000 7fb34e000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb348119b80 con 0x7fb348109ad0 2024-05-03T16:44:47.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.278+0000 7fb34e000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb348119a00 con 0x7fb34810fb60 2024-05-03T16:44:47.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.278+0000 7fb34e000700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb348119d00 con 0x7fb34810a490 2024-05-03T16:44:47.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.278+0000 7fb347400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb348109ad0 0x7fb3481a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:47.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.278+0000 7fb347400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb348109ad0 0x7fb3481a0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59548/0 (socket says 172.21.15.81:59548) 2024-05-03T16:44:47.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.278+0000 7fb347400700 1 -- 172.21.15.81:0/2550371330 learned_addr learned my addr 172.21.15.81:0/2550371330 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:44:47.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.278+0000 7fb346a00700 1 --2- 172.21.15.81:0/2550371330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb34810a490 0x7fb3481a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:47.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.278+0000 7fb347e00700 1 --2- 172.21.15.81:0/2550371330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb34810fb60 0x7fb3481a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:47.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.278+0000 7fb347400700 1 -- 172.21.15.81:0/2550371330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb34810a490 msgr2=0x7fb3481a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:47.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.278+0000 7fb347400700 1 --2- 172.21.15.81:0/2550371330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb34810a490 0x7fb3481a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:47.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.278+0000 7fb347400700 1 -- 172.21.15.81:0/2550371330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb34810fb60 msgr2=0x7fb3481a4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:47.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.278+0000 7fb347400700 1 --2- 172.21.15.81:0/2550371330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb34810fb60 0x7fb3481a4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:47.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.278+0000 7fb347400700 1 -- 172.21.15.81:0/2550371330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3481a50a0 con 0x7fb348109ad0 2024-05-03T16:44:47.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.279+0000 7fb347e00700 1 --2- 172.21.15.81:0/2550371330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb34810fb60 0x7fb3481a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:44:47.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.279+0000 7fb347400700 1 --2- 172.21.15.81:0/2550371330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb348109ad0 0x7fb3481a0090 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb338000c00 tx=0x7fb338009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:47.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.279+0000 7fb33fe00700 1 -- 172.21.15.81:0/2550371330 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb338027070 con 0x7fb348109ad0 2024-05-03T16:44:47.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.279+0000 7fb34e000700 1 -- 172.21.15.81:0/2550371330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3481a5330 con 0x7fb348109ad0 2024-05-03T16:44:47.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.279+0000 7fb33fe00700 1 -- 172.21.15.81:0/2550371330 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb33800fc70 con 0x7fb348109ad0 2024-05-03T16:44:47.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.279+0000 7fb33fe00700 1 -- 172.21.15.81:0/2550371330 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb338022d40 con 0x7fb348109ad0 2024-05-03T16:44:47.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.279+0000 7fb34e000700 1 -- 172.21.15.81:0/2550371330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3481acc10 con 0x7fb348109ad0 2024-05-03T16:44:47.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.281+0000 7fb34e000700 1 -- 172.21.15.81:0/2550371330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb34806a190 con 0x7fb348109ad0 2024-05-03T16:44:47.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.284+0000 7fb33fe00700 1 -- 172.21.15.81:0/2550371330 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fb33802a070 con 0x7fb348109ad0 2024-05-03T16:44:47.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.286+0000 7fb33fe00700 1 --2- 172.21.15.81:0/2550371330 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb32c0b2900 0x7fb32c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:47.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.286+0000 7fb33fe00700 1 -- 172.21.15.81:0/2550371330 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9063+0+0 (secure 0 0 0) 0x7fb3380e3710 con 0x7fb348109ad0 2024-05-03T16:44:47.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.286+0000 7fb346a00700 1 --2- 172.21.15.81:0/2550371330 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb32c0b2900 0x7fb32c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:47.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.287+0000 7fb346a00700 1 --2- 172.21.15.81:0/2550371330 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb32c0b2900 0x7fb32c0b4dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb334005950 tx=0x7fb3340058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:47.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.288+0000 7fb33fe00700 1 -- 172.21.15.81:0/2550371330 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb338031070 con 0x7fb348109ad0 2024-05-03T16:44:47.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.572+0000 7fb34e000700 1 -- 172.21.15.81:0/2550371330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb34802e510 con 0x7fb348109ad0 2024-05-03T16:44:47.574 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:47 smithi081 ceph-mon[28640]: pgmap v400: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:47.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.573+0000 7fb33fe00700 1 -- 172.21.15.81:0/2550371330 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fb338013070 con 0x7fb348109ad0 2024-05-03T16:44:47.574 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-03T16:44:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.576+0000 7fb34e000700 1 -- 172.21.15.81:0/2550371330 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb32c0b2900 msgr2=0x7fb32c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.576+0000 7fb34e000700 1 --2- 172.21.15.81:0/2550371330 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb32c0b2900 0x7fb32c0b4dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb334005950 tx=0x7fb3340058e0 comp rx=0 tx=0).stop 2024-05-03T16:44:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.576+0000 7fb34e000700 1 -- 172.21.15.81:0/2550371330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb348109ad0 msgr2=0x7fb3481a0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.576+0000 7fb34e000700 1 --2- 172.21.15.81:0/2550371330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb348109ad0 0x7fb3481a0090 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb338000c00 tx=0x7fb338009f90 comp rx=0 tx=0).stop 2024-05-03T16:44:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.576+0000 7fb34e000700 1 -- 172.21.15.81:0/2550371330 shutdown_connections 2024-05-03T16:44:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.576+0000 7fb34e000700 1 --2- 172.21.15.81:0/2550371330 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb32c0b2900 0x7fb32c0b4dc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.576+0000 7fb34e000700 1 --2- 172.21.15.81:0/2550371330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb34810fb60 0x7fb3481a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:47.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.576+0000 7fb34e000700 1 --2- 172.21.15.81:0/2550371330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb348109ad0 0x7fb3481a0090 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:47.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.576+0000 7fb34e000700 1 --2- 172.21.15.81:0/2550371330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb34810a490 0x7fb3481a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:47.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.576+0000 7fb34e000700 1 -- 172.21.15.81:0/2550371330 >> 172.21.15.81:0/2550371330 conn(0x7fb348076c70 msgr2=0x7fb348077330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:47.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.576+0000 7fb34e000700 1 -- 172.21.15.81:0/2550371330 shutdown_connections 2024-05-03T16:44:47.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:47.576+0000 7fb34e000700 1 -- 172.21.15.81:0/2550371330 wait complete. 2024-05-03T16:44:47.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:47 smithi146 ceph-mon[32357]: pgmap v400: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:47.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:47 smithi134 ceph-mon[31708]: pgmap v400: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:48.434 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-03T16:44:48.434 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-03T16:44:48.434 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-05-03T16:44:48.434 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-03T16:44:48.434 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-03T16:44:48.434 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-03T16:44:48.434 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-03T16:44:48.434 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-03T16:44:48.434 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-03T16:44:48.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:44:48.435 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-05-03T16:44:48.491 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-03T16:44:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-03T16:44:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-05-03T16:44:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-05-03T16:44:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-05-03T16:44:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-05-03T16:44:48.492 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-03T16:44:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-05-03T16:44:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-05-03T16:44:48.492 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-03T16:44:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-05-03T16:44:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-05-03T16:44:48.493 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-03T16:44:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-05-03T16:44:48.493 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-03T16:44:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-05-03T16:44:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-03T16:44:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 41879sec preferred_lft 41879sec 2024-05-03T16:44:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2024-05-03T16:44:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-05-03T16:44:48.495 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-03T16:44:48.495 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T16:44:48.495 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-03T16:44:48.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-05-03T16:44:48.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-05-03T16:44:48.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-05-03T16:44:48.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-03T16:44:48.495 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-03T16:44:48.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T16:44:48.623 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:48 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2550371330' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-03T16:44:48.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:48 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2550371330' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-03T16:44:48.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T16:44:48.970 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:48 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2550371330' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-03T16:44:48.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:44:48.971 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-03T16:44:49.036 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-05-03T16:44:49.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:44:49.039 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-05-03T16:44:49.095 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-05-03T16:44:49.096 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-03T16:44:49.096 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-03T16:44:49.096 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-03T16:44:49.096 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-03T16:44:49.096 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T16:44:49.096 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-03T16:44:49.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-03T16:44:49.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-03T16:44:49.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-03T16:44:49.097 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-03T16:44:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T16:44:49.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:49 smithi081 ceph-mon[28640]: pgmap v401: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:49.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:49 smithi146 ceph-mon[32357]: pgmap v401: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:49.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T16:44:49.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:44:49.877 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-05-03T16:44:49.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:44:49.931 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-05-03T16:44:49.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:49 smithi134 ceph-mon[31708]: pgmap v401: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:49.981 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T16:44:49.981 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-03T16:44:49.981 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T16:44:49.981 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-03T16:44:49.981 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-03T16:44:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T16:44:50.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T16:44:50.212 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-03T16:44:50.212 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T16:44:50.212 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-03T16:44:50.212 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-03T16:44:50.212 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-03T16:44:50.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-03T16:44:50.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-03T16:44:50.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-03T16:44:50.213 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-03T16:44:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T16:44:50.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T16:44:50.530 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T16:44:50.530 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-03T16:44:50.530 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-05-03T16:44:50.530 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-05-03T16:44:50.530 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-03T16:44:50.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T16:44:50.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T16:44:50.729 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-03T16:44:50.729 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-03T16:44:50.729 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-03T16:44:50.774 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-03T16:44:50.774 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-03T16:44:50.775 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-03T16:44:50.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-05-03T16:44:50.932 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-05-03T16:44:50.980 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-05-03T16:44:50.980 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-05-03T16:44:50.980 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-05-03T16:44:50.980 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-05-03T16:44:50.980 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-05-03T16:44:50.980 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-05-03T16:44:50.980 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-05-03T16:44:50.980 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-05-03T16:44:50.980 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-05-03T16:44:50.980 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-05-03T16:44:50.980 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-05-03T16:44:50.981 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-05-03T16:44:50.981 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T16:44:50.981 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-05-03T16:44:50.981 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-05-03T16:44:50.981 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-05-03T16:44:50.981 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-05-03T16:44:50.981 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-05-03T16:44:50.981 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-05-03T16:44:50.981 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-05-03T16:44:50.981 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-03T16:44:50.981 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-03T16:44:50.981 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-05-03T16:44:50.981 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-05-03T16:44:50.981 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-05-03T16:44:50.981 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay 2024-05-03T16:44:50.982 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/ef21a1765c814f7b199172b2380c4ab6b7deae0ffb2ec0845a59b930e1ee14eb/merged 2024-05-03T16:44:50.982 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/97623808ebcaa476288032bccd5e0b81feafe3af096f10120979307cad09599f/merged 2024-05-03T16:44:50.982 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/0 2024-05-03T16:44:50.982 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T16:44:50.982 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/59e6e395e56c0dd894fdf1d362da8edec154ba9aa4eec74c6e0ecd5e3618190e/merged 2024-05-03T16:44:50.982 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/f6bcc11df8066728c3695f63db3505216cf09469ed1f476056eba47a2eb2ad77/merged 2024-05-03T16:44:50.982 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/2da88de54e672105906813d0dd30341cd8d2cb89eeb18e1e9b967ebd047dcb65/merged 2024-05-03T16:44:50.982 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/ab038f1f8f511d57f464b8764e91bd422fddf64a83dd5fffc7c280bce71e6c29/merged 2024-05-03T16:44:50.982 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/2641176c9814c14c3705833a66ff67bfd5b1ea4e117b811d2496dda6b26782a4/merged 2024-05-03T16:44:50.982 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/72f4b088b79e7a1ee2706605e7b13d097d09dbbcace9ce15fd83e4ba1e820777/merged 2024-05-03T16:44:50.982 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/c0e43eac94a5dd223e4b4721f5b1a02373c4ac98289402d78b35a57063c7dd59/merged 2024-05-03T16:44:50.982 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/e1da9ee5148cd75d55a64da26cdfe0cb72be42e0be8955cbddfcfe56893cbab6/merged 2024-05-03T16:44:50.982 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-05-03T16:44:50.982 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T16:44:50.983 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T16:44:50.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:44:50.984 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-05-03T16:44:51.028 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-03T16:44:51.029 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-03T16:44:51.077 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-05-03T16:44:51.151 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-05-03T16:44:51.194 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-05-03T16:44:51.194 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-05-03T16:44:51.194 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-05-03T16:44:51.194 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-05-03T16:44:51.195 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-05-03T16:44:51.195 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-05-03T16:44:51.195 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-05-03T16:44:51.195 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-05-03T16:44:51.195 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-05-03T16:44:51.195 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-05-03T16:44:51.195 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-05-03T16:44:51.195 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-05-03T16:44:51.195 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T16:44:51.195 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-05-03T16:44:51.195 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-05-03T16:44:51.195 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-05-03T16:44:51.195 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-05-03T16:44:51.196 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-05-03T16:44:51.196 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-05-03T16:44:51.196 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-05-03T16:44:51.196 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-03T16:44:51.196 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-03T16:44:51.196 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-05-03T16:44:51.196 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-05-03T16:44:51.196 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-05-03T16:44:51.196 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay 2024-05-03T16:44:51.196 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/ef21a1765c814f7b199172b2380c4ab6b7deae0ffb2ec0845a59b930e1ee14eb/merged 2024-05-03T16:44:51.196 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/97623808ebcaa476288032bccd5e0b81feafe3af096f10120979307cad09599f/merged 2024-05-03T16:44:51.196 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/0 2024-05-03T16:44:51.196 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T16:44:51.197 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/59e6e395e56c0dd894fdf1d362da8edec154ba9aa4eec74c6e0ecd5e3618190e/merged 2024-05-03T16:44:51.197 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/f6bcc11df8066728c3695f63db3505216cf09469ed1f476056eba47a2eb2ad77/merged 2024-05-03T16:44:51.197 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/2da88de54e672105906813d0dd30341cd8d2cb89eeb18e1e9b967ebd047dcb65/merged 2024-05-03T16:44:51.197 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/ab038f1f8f511d57f464b8764e91bd422fddf64a83dd5fffc7c280bce71e6c29/merged 2024-05-03T16:44:51.197 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/2641176c9814c14c3705833a66ff67bfd5b1ea4e117b811d2496dda6b26782a4/merged 2024-05-03T16:44:51.197 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/72f4b088b79e7a1ee2706605e7b13d097d09dbbcace9ce15fd83e4ba1e820777/merged 2024-05-03T16:44:51.197 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/c0e43eac94a5dd223e4b4721f5b1a02373c4ac98289402d78b35a57063c7dd59/merged 2024-05-03T16:44:51.197 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/e1da9ee5148cd75d55a64da26cdfe0cb72be42e0be8955cbddfcfe56893cbab6/merged 2024-05-03T16:44:51.197 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-05-03T16:44:51.197 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T16:44:51.197 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T16:44:51.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:44:51.199 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-05-03T16:44:51.319 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:2024-05-03T16:44:51.318+0000 7f5b01785480 -1 init, newargv = 0x558bd465e350 newargc=15 2024-05-03T16:44:51.320 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[72249]: starting ceph client 2024-05-03T16:44:51.335 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[72249]: starting fuse 2024-05-03T16:44:51.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:51 smithi146 ceph-mon[32357]: pgmap v402: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:51.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:51 smithi134 ceph-mon[31708]: pgmap v402: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:51.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:51 smithi081 ceph-mon[28640]: pgmap v402: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:52.388 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-05-03T16:44:52.468 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-05-03T16:44:52.509 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-05-03T16:44:52.509 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-05-03T16:44:52.509 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-05-03T16:44:52.509 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-05-03T16:44:52.509 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-05-03T16:44:52.509 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-05-03T16:44:52.509 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-05-03T16:44:52.509 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-05-03T16:44:52.509 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-05-03T16:44:52.509 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-05-03T16:44:52.509 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-05-03T16:44:52.510 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-05-03T16:44:52.510 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T16:44:52.510 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-05-03T16:44:52.510 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-05-03T16:44:52.510 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-05-03T16:44:52.510 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-05-03T16:44:52.510 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-05-03T16:44:52.510 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-05-03T16:44:52.510 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-05-03T16:44:52.510 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-03T16:44:52.510 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-03T16:44:52.511 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-05-03T16:44:52.511 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-05-03T16:44:52.511 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-05-03T16:44:52.511 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay 2024-05-03T16:44:52.511 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/ef21a1765c814f7b199172b2380c4ab6b7deae0ffb2ec0845a59b930e1ee14eb/merged 2024-05-03T16:44:52.511 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/97623808ebcaa476288032bccd5e0b81feafe3af096f10120979307cad09599f/merged 2024-05-03T16:44:52.511 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/0 2024-05-03T16:44:52.511 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T16:44:52.511 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/59e6e395e56c0dd894fdf1d362da8edec154ba9aa4eec74c6e0ecd5e3618190e/merged 2024-05-03T16:44:52.511 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/f6bcc11df8066728c3695f63db3505216cf09469ed1f476056eba47a2eb2ad77/merged 2024-05-03T16:44:52.511 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/2da88de54e672105906813d0dd30341cd8d2cb89eeb18e1e9b967ebd047dcb65/merged 2024-05-03T16:44:52.511 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/ab038f1f8f511d57f464b8764e91bd422fddf64a83dd5fffc7c280bce71e6c29/merged 2024-05-03T16:44:52.511 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/2641176c9814c14c3705833a66ff67bfd5b1ea4e117b811d2496dda6b26782a4/merged 2024-05-03T16:44:52.512 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/72f4b088b79e7a1ee2706605e7b13d097d09dbbcace9ce15fd83e4ba1e820777/merged 2024-05-03T16:44:52.512 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/c0e43eac94a5dd223e4b4721f5b1a02373c4ac98289402d78b35a57063c7dd59/merged 2024-05-03T16:44:52.512 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/e1da9ee5148cd75d55a64da26cdfe0cb72be42e0be8955cbddfcfe56893cbab6/merged 2024-05-03T16:44:52.512 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-05-03T16:44:52.512 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T16:44:52.512 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T16:44:52.512 INFO:teuthology.orchestra.run.smithi081.stdout:/home/ubuntu/cephtest/mnt.admin 2024-05-03T16:44:52.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:44:52.513 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-05-03T16:44:52.596 INFO:teuthology.orchestra.run.smithi081.stdout:114 2024-05-03T16:44:52.597 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [114] 2024-05-03T16:44:52.597 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-05-03T16:44:52.597 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-05-03T16:44:52.597 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-05-03T16:44:52.597 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-05-03T16:44:52.597 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-05-03T16:44:52.597 DEBUG:teuthology.orchestra.run.smithi081:> 2024-05-03T16:44:52.597 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-05-03T16:44:52.598 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-03T16:44:52.598 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-05-03T16:44:52.598 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-03T16:44:52.598 DEBUG:teuthology.orchestra.run.smithi081:> 2024-05-03T16:44:52.598 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-05-03T16:44:52.598 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-05-03T16:44:52.598 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-05-03T16:44:52.598 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-05-03T16:44:52.598 DEBUG:teuthology.orchestra.run.smithi081:> 2024-05-03T16:44:52.598 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-05-03T16:44:52.598 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-03T16:44:52.598 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-03T16:44:52.598 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-03T16:44:52.598 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-05-03T16:44:52.598 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-05-03T16:44:52.599 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-05-03T16:44:52.599 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-03T16:44:52.599 DEBUG:teuthology.orchestra.run.smithi081:> 2024-05-03T16:44:52.599 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.admin")) 2024-05-03T16:44:52.599 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-05-03T16:44:52.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:52 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:44:52.798 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.admin.72249.asok 2024-05-03T16:44:52.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T16:44:52.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:52 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:44:52.813 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.72249.asok 2024-05-03T16:44:52.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:44:52.814 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.72249.asok status 2024-05-03T16:44:52.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:52 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:44:53.026 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-03T16:44:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-05-03T16:44:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "9a047fe7599a549042d06a3fb5b6813a203eabea", 2024-05-03T16:44:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev)", 2024-05-03T16:44:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "admin", 2024-05-03T16:44:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-05-03T16:44:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-03T16:44:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "72249", 2024-05-03T16:44:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-05-03T16:44:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-03T16:44:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-05-03T16:44:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-05-03T16:44:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 14718, 2024-05-03T16:44:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-05-03T16:44:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-05-03T16:44:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-05-03T16:44:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 14718 2024-05-03T16:44:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-03T16:44:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-05-03T16:44:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-03T16:44:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-05-03T16:44:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 954299165 2024-05-03T16:44:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-03T16:44:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-03T16:44:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-05-03T16:44:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-03T16:44:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-05-03T16:44:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 954299165 2024-05-03T16:44:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-03T16:44:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.14718 192.168.0.1:0/954299165", 2024-05-03T16:44:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/954299165", 2024-05-03T16:44:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-05-03T16:44:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 17, 2024-05-03T16:44:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 89, 2024-05-03T16:44:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-05-03T16:44:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-05-03T16:44:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-05-03T16:44:53.029 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-03T16:44:53.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:44:53.043 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-05-03T16:44:53.043 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-03T16:44:53.093 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-05-03T16:44:53.093 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-03T16:44:53.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:44:53.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-03T16:44:53.165 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-03T16:44:53.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-03T16:44:53.295 INFO:teuthology.orchestra.run.smithi081.stdout:# file: . 2024-05-03T16:44:53.295 INFO:teuthology.orchestra.run.smithi081.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-03T16:44:53.295 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:44:53.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T16:44:53.305 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T16:44:53.305 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-03T16:44:53.345 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-03T16:44:53.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:53 smithi081 ceph-mon[28640]: pgmap v403: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:53.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:53 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:53.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:53 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:53.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:53 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:53.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:53 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:53.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:53 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:53.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:53 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:53.951 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:53 smithi134 ceph-mon[31708]: pgmap v403: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:53.952 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:53 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:53.952 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:53 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:53.952 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:53 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:53.952 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:53 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:53.952 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:53 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:53.952 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:53 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:53.959 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:53 smithi146 ceph-mon[32357]: pgmap v403: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:53.959 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:53 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:53.959 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:53 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:53.959 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:53 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:53.959 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:53 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:53.959 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:53 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:53.959 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:53 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:54.431 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:44:55.887 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:55 smithi081 ceph-mon[28640]: pgmap v404: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:55.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:55.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:55.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:55.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:55.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:55 smithi134 ceph-mon[31708]: pgmap v404: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:55.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:55.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:55.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:55.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:55 smithi146 ceph-mon[32357]: pgmap v404: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:44:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:56.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.741+0000 7f2098400700 1 -- 172.21.15.81:0/450451186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2090075ff0 msgr2=0x7f209010f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:56.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.741+0000 7f2098400700 1 --2- 172.21.15.81:0/450451186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2090075ff0 0x7f209010f960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f207c0098f0 tx=0x7f207c009c00 comp rx=0 tx=0).stop 2024-05-03T16:44:56.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.741+0000 7f2098400700 1 -- 172.21.15.81:0/450451186 shutdown_connections 2024-05-03T16:44:56.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.741+0000 7f2098400700 1 --2- 172.21.15.81:0/450451186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20900756d0 0x7f2090075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:56.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.741+0000 7f2098400700 1 --2- 172.21.15.81:0/450451186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f209010fea0 0x7f2090112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:56.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.741+0000 7f2098400700 1 --2- 172.21.15.81:0/450451186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2090075ff0 0x7f209010f960 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:56.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.741+0000 7f2098400700 1 -- 172.21.15.81:0/450451186 >> 172.21.15.81:0/450451186 conn(0x7f209007a600 msgr2=0x7f209007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:56.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.742+0000 7f2098400700 1 -- 172.21.15.81:0/450451186 shutdown_connections 2024-05-03T16:44:56.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.742+0000 7f2098400700 1 -- 172.21.15.81:0/450451186 wait complete. 2024-05-03T16:44:56.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.743+0000 7f2098400700 1 Processor -- start 2024-05-03T16:44:56.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.744+0000 7f2098400700 1 -- start start 2024-05-03T16:44:56.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.744+0000 7f2098400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20900756d0 0x7f20901a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:56.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.744+0000 7f2098400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2090075ff0 0x7f20901a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:56.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.744+0000 7f2098400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f209010fea0 0x7f209019bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:56.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.744+0000 7f2098400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2090115720 con 0x7f2090075ff0 2024-05-03T16:44:56.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.744+0000 7f2098400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f20901155a0 con 0x7f209010fea0 2024-05-03T16:44:56.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.744+0000 7f2098400700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f20901158a0 con 0x7f20900756d0 2024-05-03T16:44:56.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.745+0000 7f2095000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2090075ff0 0x7f20901a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:56.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.745+0000 7f2095a00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20900756d0 0x7f20901a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:56.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.745+0000 7f2095000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2090075ff0 0x7f20901a1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50998/0 (socket says 172.21.15.81:50998) 2024-05-03T16:44:56.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.745+0000 7f2095000700 1 -- 172.21.15.81:0/2044813176 learned_addr learned my addr 172.21.15.81:0/2044813176 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:44:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.745+0000 7f2096400700 1 --2- 172.21.15.81:0/2044813176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f209010fea0 0x7f209019bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.745+0000 7f2095000700 1 -- 172.21.15.81:0/2044813176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20900756d0 msgr2=0x7f20901a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.745+0000 7f2095000700 1 --2- 172.21.15.81:0/2044813176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20900756d0 0x7f20901a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.745+0000 7f2095000700 1 -- 172.21.15.81:0/2044813176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f209010fea0 msgr2=0x7f209019bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.745+0000 7f2095000700 1 --2- 172.21.15.81:0/2044813176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f209010fea0 0x7f209019bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.745+0000 7f2095000700 1 -- 172.21.15.81:0/2044813176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209019c410 con 0x7f2090075ff0 2024-05-03T16:44:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.746+0000 7f2095000700 1 --2- 172.21.15.81:0/2044813176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2090075ff0 0x7f20901a1fa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f207c009230 tx=0x7f207c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.746+0000 7f208e000700 1 -- 172.21.15.81:0/2044813176 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c00b560 con 0x7f2090075ff0 2024-05-03T16:44:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.746+0000 7f2098400700 1 -- 172.21.15.81:0/2044813176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209019c6a0 con 0x7f2090075ff0 2024-05-03T16:44:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.746+0000 7f2098400700 1 -- 172.21.15.81:0/2044813176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20901a89e0 con 0x7f2090075ff0 2024-05-03T16:44:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.746+0000 7f208e000700 1 -- 172.21.15.81:0/2044813176 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f207c00bb90 con 0x7f2090075ff0 2024-05-03T16:44:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.746+0000 7f208e000700 1 -- 172.21.15.81:0/2044813176 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c0038e0 con 0x7f2090075ff0 2024-05-03T16:44:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.747+0000 7f2098400700 1 -- 172.21.15.81:0/2044813176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2070005330 con 0x7f2090075ff0 2024-05-03T16:44:56.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.750+0000 7f208e000700 1 -- 172.21.15.81:0/2044813176 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f207c00b700 con 0x7f2090075ff0 2024-05-03T16:44:56.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.752+0000 7f208e000700 1 --2- 172.21.15.81:0/2044813176 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f20780b2900 0x7f20780b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:44:56.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.752+0000 7f208e000700 1 -- 172.21.15.81:0/2044813176 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9063+0+0 (secure 0 0 0) 0x7f207c0e3710 con 0x7f2090075ff0 2024-05-03T16:44:56.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.752+0000 7f2095a00700 1 --2- 172.21.15.81:0/2044813176 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f20780b2900 0x7f20780b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:44:56.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.753+0000 7f2095a00700 1 --2- 172.21.15.81:0/2044813176 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f20780b2900 0x7f20780b4dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2084009c60 tx=0x7f2084009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:44:56.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:56.768+0000 7f208e000700 1 -- 172.21.15.81:0/2044813176 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f207c013030 con 0x7f2090075ff0 2024-05-03T16:44:57.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:57.030+0000 7f2098400700 1 -- 172.21.15.81:0/2044813176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2070005620 con 0x7f2090075ff0 2024-05-03T16:44:57.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:57.031+0000 7f208e000700 1 -- 172.21.15.81:0/2044813176 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+592 (secure 0 0 0) 0x7f207c0ab120 con 0x7f2090075ff0 2024-05-03T16:44:57.032 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/2734678359 2024-05-04T16:34:04.089390+0000 2024-05-03T16:44:57.033 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/2734678359 2024-05-04T16:34:04.089390+0000 2024-05-03T16:44:57.033 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2237510960 2024-05-04T16:34:04.089390+0000 2024-05-03T16:44:57.033 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/2256692598 2024-05-04T16:33:30.274051+0000 2024-05-03T16:44:57.033 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3199433706 2024-05-04T16:33:30.274051+0000 2024-05-03T16:44:57.033 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1689714816 2024-05-04T16:33:30.274051+0000 2024-05-03T16:44:57.033 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2777950369 2024-05-04T16:34:04.089390+0000 2024-05-03T16:44:57.033 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1982866220 2024-05-04T16:34:04.089390+0000 2024-05-03T16:44:57.033 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/2256692598 2024-05-04T16:33:30.274051+0000 2024-05-03T16:44:57.033 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1112375028 2024-05-04T16:33:30.274051+0000 2024-05-03T16:44:57.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:57.034+0000 7f2098400700 1 -- 172.21.15.81:0/2044813176 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f20780b2900 msgr2=0x7f20780b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:57.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:57.034+0000 7f2098400700 1 --2- 172.21.15.81:0/2044813176 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f20780b2900 0x7f20780b4dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2084009c60 tx=0x7f2084009260 comp rx=0 tx=0).stop 2024-05-03T16:44:57.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:57.034+0000 7f2098400700 1 -- 172.21.15.81:0/2044813176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2090075ff0 msgr2=0x7f20901a1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:44:57.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:57.034+0000 7f2098400700 1 --2- 172.21.15.81:0/2044813176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2090075ff0 0x7f20901a1fa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f207c009230 tx=0x7f207c00fa00 comp rx=0 tx=0).stop 2024-05-03T16:44:57.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:57.034+0000 7f2098400700 1 -- 172.21.15.81:0/2044813176 shutdown_connections 2024-05-03T16:44:57.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:57.034+0000 7f2098400700 1 --2- 172.21.15.81:0/2044813176 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f20780b2900 0x7f20780b4dc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:57.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:57.034+0000 7f2098400700 1 --2- 172.21.15.81:0/2044813176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20900756d0 0x7f20901a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:57.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:57.034+0000 7f2098400700 1 --2- 172.21.15.81:0/2044813176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f209010fea0 0x7f209019bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:57.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:57.034+0000 7f2098400700 1 --2- 172.21.15.81:0/2044813176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2090075ff0 0x7f20901a1fa0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:44:57.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:57.034+0000 7f2098400700 1 -- 172.21.15.81:0/2044813176 >> 172.21.15.81:0/2044813176 conn(0x7f209007a600 msgr2=0x7f20901007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:44:57.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:57.034+0000 7f2098400700 1 -- 172.21.15.81:0/2044813176 shutdown_connections 2024-05-03T16:44:57.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:44:57.034+0000 7f2098400700 1 -- 172.21.15.81:0/2044813176 wait complete. 2024-05-03T16:44:57.036 INFO:teuthology.orchestra.run.smithi081.stderr:listed 10 entries 2024-05-03T16:44:57.928 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T16:44:57.928 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-03T16:44:57.973 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-03T16:44:58.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:57 smithi081 ceph-mon[28640]: pgmap v405: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-03T16:44:58.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:57 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:58.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:57 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:58.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:57 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2044813176' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T16:44:58.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:57 smithi146 ceph-mon[32357]: pgmap v405: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-03T16:44:58.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:57 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:58.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:57 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:58.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:57 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2044813176' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T16:44:58.448 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:44:58.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:57 smithi134 ceph-mon[31708]: pgmap v405: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-03T16:44:58.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:57 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:58.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:57 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:58.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:57 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2044813176' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T16:44:59.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:58 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:44:59.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:58 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:44:59.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:58 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:59.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:58 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:44:59.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:58 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:44:59.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:58 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:44:59.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:58 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:44:59.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:58 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:44:59.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:58 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:45:00.181 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:44:59 smithi081 ceph-mon[28640]: pgmap v406: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-03T16:45:00.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:44:59 smithi146 ceph-mon[32357]: pgmap v406: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-03T16:45:00.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:44:59 smithi134 ceph-mon[31708]: pgmap v406: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-03T16:45:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.688+0000 7f0102a00700 1 -- 172.21.15.81:0/3844964739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc06b180 msgr2=0x7f00fc06b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.688+0000 7f0102a00700 1 --2- 172.21.15.81:0/3844964739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc06b180 0x7f00fc06b600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009990 tx=0x7f00e4009ca0 comp rx=0 tx=0).stop 2024-05-03T16:45:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.688+0000 7f0102a00700 1 -- 172.21.15.81:0/3844964739 shutdown_connections 2024-05-03T16:45:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.688+0000 7f0102a00700 1 --2- 172.21.15.81:0/3844964739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00fc109510 0x7f00fc1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.688+0000 7f0102a00700 1 --2- 172.21.15.81:0/3844964739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00fc06bb40 0x7f00fc110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.688+0000 7f0102a00700 1 --2- 172.21.15.81:0/3844964739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc06b180 0x7f00fc06b600 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.688+0000 7f0102a00700 1 -- 172.21.15.81:0/3844964739 >> 172.21.15.81:0/3844964739 conn(0x7f00fc079350 msgr2=0x7f00fc079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.688+0000 7f0102a00700 1 -- 172.21.15.81:0/3844964739 shutdown_connections 2024-05-03T16:45:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.688+0000 7f0102a00700 1 -- 172.21.15.81:0/3844964739 wait complete. 2024-05-03T16:45:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.689+0000 7f0102a00700 1 Processor -- start 2024-05-03T16:45:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.690+0000 7f0102a00700 1 -- start start 2024-05-03T16:45:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.690+0000 7f0102a00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00fc06b180 0x7f00fc102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.690+0000 7f0102a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc06bb40 0x7f00fc1029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.690+0000 7f0102a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00fc109510 0x7f00fc102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.690+0000 7f0102a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc113540 con 0x7f00fc06bb40 2024-05-03T16:45:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.690+0000 7f0102a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc1133c0 con 0x7f00fc109510 2024-05-03T16:45:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.690+0000 7f0102a00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc1136c0 con 0x7f00fc06b180 2024-05-03T16:45:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.690+0000 7f00f3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc06bb40 0x7f00fc1029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.690+0000 7f00f3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc06bb40 0x7f00fc1029b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51022/0 (socket says 172.21.15.81:51022) 2024-05-03T16:45:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.690+0000 7f00f3e00700 1 -- 172.21.15.81:0/2520761133 learned_addr learned my addr 172.21.15.81:0/2520761133 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:45:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.691+0000 7f00fbe00700 1 --2- 172.21.15.81:0/2520761133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00fc06b180 0x7f00fc102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.691+0000 7f0100a00700 1 --2- 172.21.15.81:0/2520761133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00fc109510 0x7f00fc102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.691+0000 7f00f3e00700 1 -- 172.21.15.81:0/2520761133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00fc06b180 msgr2=0x7f00fc102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.691+0000 7f00f3e00700 1 --2- 172.21.15.81:0/2520761133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00fc06b180 0x7f00fc102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.691+0000 7f00f3e00700 1 -- 172.21.15.81:0/2520761133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00fc109510 msgr2=0x7f00fc102ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.691+0000 7f00f3e00700 1 --2- 172.21.15.81:0/2520761133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00fc109510 0x7f00fc102ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.691+0000 7f00f3e00700 1 -- 172.21.15.81:0/2520761133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00fc1a8070 con 0x7f00fc06bb40 2024-05-03T16:45:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.691+0000 7f00f3e00700 1 --2- 172.21.15.81:0/2520761133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc06bb40 0x7f00fc1029b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f00e4000c00 tx=0x7f00e40057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.692+0000 7f00f9600700 1 -- 172.21.15.81:0/2520761133 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4027070 con 0x7f00fc06bb40 2024-05-03T16:45:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.692+0000 7f00f9600700 1 -- 172.21.15.81:0/2520761133 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00e400fc00 con 0x7f00fc06bb40 2024-05-03T16:45:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.692+0000 7f0102a00700 1 -- 172.21.15.81:0/2520761133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00fc1a8300 con 0x7f00fc06bb40 2024-05-03T16:45:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.692+0000 7f00f9600700 1 -- 172.21.15.81:0/2520761133 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4022ca0 con 0x7f00fc06bb40 2024-05-03T16:45:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.692+0000 7f0102a00700 1 -- 172.21.15.81:0/2520761133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00fc1a87b0 con 0x7f00fc06bb40 2024-05-03T16:45:00.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.693+0000 7f0102a00700 1 -- 172.21.15.81:0/2520761133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00fc10b9f0 con 0x7f00fc06bb40 2024-05-03T16:45:00.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.695+0000 7f00f9600700 1 -- 172.21.15.81:0/2520761133 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f00e402a070 con 0x7f00fc06bb40 2024-05-03T16:45:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.697+0000 7f00f9600700 1 --2- 172.21.15.81:0/2520761133 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f00e00b2900 0x7f00e00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.697+0000 7f00f9600700 1 -- 172.21.15.81:0/2520761133 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9063+0+0 (secure 0 0 0) 0x7f00e40e3650 con 0x7f00fc06bb40 2024-05-03T16:45:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.697+0000 7f00fbe00700 1 --2- 172.21.15.81:0/2520761133 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f00e00b2900 0x7f00e00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:00.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.698+0000 7f00fbe00700 1 --2- 172.21.15.81:0/2520761133 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f00e00b2900 0x7f00e00b4dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f00ec005950 tx=0x7f00ec00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:00.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.700+0000 7f00f9600700 1 -- 172.21.15.81:0/2520761133 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f00e4031080 con 0x7f00fc06bb40 2024-05-03T16:45:00.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.950+0000 7f0102a00700 1 -- 172.21.15.81:0/2520761133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f00fc06a190 con 0x7f00fc06bb40 2024-05-03T16:45:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.951+0000 7f00f9600700 1 -- 172.21.15.81:0/2520761133 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+592 (secure 0 0 0) 0x7f00e4013070 con 0x7f00fc06bb40 2024-05-03T16:45:00.953 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/2734678359 2024-05-04T16:34:04.089390+0000 2024-05-03T16:45:00.953 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/2734678359 2024-05-04T16:34:04.089390+0000 2024-05-03T16:45:00.953 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2237510960 2024-05-04T16:34:04.089390+0000 2024-05-03T16:45:00.953 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/2256692598 2024-05-04T16:33:30.274051+0000 2024-05-03T16:45:00.953 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3199433706 2024-05-04T16:33:30.274051+0000 2024-05-03T16:45:00.953 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1689714816 2024-05-04T16:33:30.274051+0000 2024-05-03T16:45:00.953 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2777950369 2024-05-04T16:34:04.089390+0000 2024-05-03T16:45:00.953 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1982866220 2024-05-04T16:34:04.089390+0000 2024-05-03T16:45:00.953 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/2256692598 2024-05-04T16:33:30.274051+0000 2024-05-03T16:45:00.953 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1112375028 2024-05-04T16:33:30.274051+0000 2024-05-03T16:45:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.954+0000 7f0102a00700 1 -- 172.21.15.81:0/2520761133 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f00e00b2900 msgr2=0x7f00e00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.954+0000 7f0102a00700 1 --2- 172.21.15.81:0/2520761133 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f00e00b2900 0x7f00e00b4dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f00ec005950 tx=0x7f00ec00a300 comp rx=0 tx=0).stop 2024-05-03T16:45:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.954+0000 7f0102a00700 1 -- 172.21.15.81:0/2520761133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc06bb40 msgr2=0x7f00fc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.954+0000 7f0102a00700 1 --2- 172.21.15.81:0/2520761133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc06bb40 0x7f00fc1029b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f00e4000c00 tx=0x7f00e40057c0 comp rx=0 tx=0).stop 2024-05-03T16:45:00.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.955+0000 7f0102a00700 1 -- 172.21.15.81:0/2520761133 shutdown_connections 2024-05-03T16:45:00.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.955+0000 7f0102a00700 1 --2- 172.21.15.81:0/2520761133 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f00e00b2900 0x7f00e00b4dc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:00.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.955+0000 7f0102a00700 1 --2- 172.21.15.81:0/2520761133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00fc06b180 0x7f00fc102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:00.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.955+0000 7f0102a00700 1 --2- 172.21.15.81:0/2520761133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00fc109510 0x7f00fc102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:00.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.955+0000 7f0102a00700 1 --2- 172.21.15.81:0/2520761133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc06bb40 0x7f00fc1029b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:00.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.955+0000 7f0102a00700 1 -- 172.21.15.81:0/2520761133 >> 172.21.15.81:0/2520761133 conn(0x7f00fc079350 msgr2=0x7f00fc101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:00.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.955+0000 7f0102a00700 1 -- 172.21.15.81:0/2520761133 shutdown_connections 2024-05-03T16:45:00.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:00.955+0000 7f0102a00700 1 -- 172.21.15.81:0/2520761133 wait complete. 2024-05-03T16:45:00.957 INFO:teuthology.orchestra.run.smithi081.stderr:listed 10 entries 2024-05-03T16:45:01.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:00 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2520761133' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T16:45:01.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:00 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2520761133' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T16:45:01.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:00 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2520761133' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T16:45:01.765 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-05-03T16:45:01.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:45:01.766 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-03T16:45:01.851 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[72249]: fuse finished with error 0 and tester_r 0 2024-05-03T16:45:01.856 INFO:teuthology.orchestra.run:waiting for 300 2024-05-03T16:45:02.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:02 smithi146 ceph-mon[32357]: pgmap v407: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-03T16:45:02.450 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:02 smithi081 ceph-mon[28640]: pgmap v407: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-03T16:45:02.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:02 smithi134 ceph-mon[31708]: pgmap v407: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-03T16:45:04.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:04 smithi146 ceph-mon[32357]: pgmap v408: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-03T16:45:04.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:04 smithi134 ceph-mon[31708]: pgmap v408: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-03T16:45:04.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:04 smithi081 ceph-mon[28640]: pgmap v408: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-03T16:45:05.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:05 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]: dispatch 2024-05-03T16:45:05.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:05 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-05-03T16:45:05.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:05 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2024-05-03T16:45:05.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:05 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2024-05-03T16:45:05.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]: dispatch 2024-05-03T16:45:05.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-05-03T16:45:05.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2024-05-03T16:45:05.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2024-05-03T16:45:05.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:05 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]: dispatch 2024-05-03T16:45:05.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:05 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-05-03T16:45:05.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:05 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2024-05-03T16:45:05.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:05 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2024-05-03T16:45:06.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:06 smithi134 ceph-mon[31708]: pgmap v409: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-03T16:45:06.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:06 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-05-03T16:45:06.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:06 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-05-03T16:45:06.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:06 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-05-03T16:45:06.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:06 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2024-05-03T16:45:06.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:06 smithi134 ceph-mon[31708]: osdmap e90: 12 total, 12 up, 12 in 2024-05-03T16:45:06.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:06 smithi081 ceph-mon[28640]: pgmap v409: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-03T16:45:06.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:06 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-05-03T16:45:06.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:06 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-05-03T16:45:06.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:06 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-05-03T16:45:06.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:06 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2024-05-03T16:45:06.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:06 smithi081 ceph-mon[28640]: osdmap e90: 12 total, 12 up, 12 in 2024-05-03T16:45:06.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:06 smithi146 ceph-mon[32357]: pgmap v409: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-03T16:45:06.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:06 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-05-03T16:45:06.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:06 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-05-03T16:45:06.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:06 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-05-03T16:45:06.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:06 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2024-05-03T16:45:06.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:06 smithi146 ceph-mon[32357]: osdmap e90: 12 total, 12 up, 12 in 2024-05-03T16:45:07.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:07 smithi134 ceph-mon[31708]: osdmap e91: 12 total, 12 up, 12 in 2024-05-03T16:45:07.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:07 smithi134 ceph-mon[31708]: pgmap v412: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-03T16:45:07.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:07 smithi081 ceph-mon[28640]: osdmap e91: 12 total, 12 up, 12 in 2024-05-03T16:45:07.522 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:07 smithi081 ceph-mon[28640]: pgmap v412: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-03T16:45:07.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:07 smithi146 ceph-mon[32357]: osdmap e91: 12 total, 12 up, 12 in 2024-05-03T16:45:07.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:07 smithi146 ceph-mon[32357]: pgmap v412: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-03T16:45:07.958 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-05-03T16:45:07.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:45:07.958 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-03T16:45:08.036 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T16:45:08.472 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:45:09.683 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:09 smithi081 ceph-mon[28640]: pgmap v413: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-03T16:45:09.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:09 smithi134 ceph-mon[31708]: pgmap v413: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-03T16:45:09.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:09 smithi146 ceph-mon[32357]: pgmap v413: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-03T16:45:10.640 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:10 smithi081 ceph-mon[28640]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-05-03T16:45:10.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:10 smithi134 ceph-mon[31708]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-05-03T16:45:10.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:10 smithi146 ceph-mon[32357]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-05-03T16:45:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.951+0000 7f8aeb400700 1 -- 172.21.15.81:0/2880441630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae410b690 msgr2=0x7f8ae410ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.951+0000 7f8aeb400700 1 --2- 172.21.15.81:0/2880441630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae410b690 0x7f8ae410ba70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009990 tx=0x7f8ad4009ca0 comp rx=0 tx=0).stop 2024-05-03T16:45:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.951+0000 7f8aeb400700 1 -- 172.21.15.81:0/2880441630 shutdown_connections 2024-05-03T16:45:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.951+0000 7f8aeb400700 1 --2- 172.21.15.81:0/2880441630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ae4106050 0x7f8ae4112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.951+0000 7f8aeb400700 1 --2- 172.21.15.81:0/2880441630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae410b690 0x7f8ae410ba70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.951+0000 7f8aeb400700 1 --2- 172.21.15.81:0/2880441630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ae4105690 0x7f8ae4105b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.951+0000 7f8aeb400700 1 -- 172.21.15.81:0/2880441630 >> 172.21.15.81:0/2880441630 conn(0x7f8ae4101180 msgr2=0x7f8ae41035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.951+0000 7f8aeb400700 1 -- 172.21.15.81:0/2880441630 shutdown_connections 2024-05-03T16:45:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.951+0000 7f8aeb400700 1 -- 172.21.15.81:0/2880441630 wait complete. 2024-05-03T16:45:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.952+0000 7f8aeb400700 1 Processor -- start 2024-05-03T16:45:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.952+0000 7f8aeb400700 1 -- start start 2024-05-03T16:45:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.953+0000 7f8aeb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae4105690 0x7f8ae41a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.953+0000 7f8aeb400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ae4106050 0x7f8ae41a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.953+0000 7f8aeb400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ae410b690 0x7f8ae419ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.953+0000 7f8aeb400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae4115720 con 0x7f8ae4105690 2024-05-03T16:45:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.953+0000 7f8aeb400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae41155a0 con 0x7f8ae4106050 2024-05-03T16:45:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.953+0000 7f8aeb400700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae41158a0 con 0x7f8ae410b690 2024-05-03T16:45:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.953+0000 7f8ae8a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae4105690 0x7f8ae41a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.953+0000 7f8ae8a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae4105690 0x7f8ae41a1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32798/0 (socket says 172.21.15.81:32798) 2024-05-03T16:45:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.953+0000 7f8ae8a00700 1 -- 172.21.15.81:0/4032363122 learned_addr learned my addr 172.21.15.81:0/4032363122 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:45:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.953+0000 7f8adbe00700 1 --2- 172.21.15.81:0/4032363122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ae4106050 0x7f8ae41a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.953+0000 7f8ae9400700 1 --2- 172.21.15.81:0/4032363122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ae410b690 0x7f8ae419ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.954+0000 7f8ae8a00700 1 -- 172.21.15.81:0/4032363122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ae410b690 msgr2=0x7f8ae419ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.954+0000 7f8ae8a00700 1 --2- 172.21.15.81:0/4032363122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ae410b690 0x7f8ae419ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.954+0000 7f8ae8a00700 1 -- 172.21.15.81:0/4032363122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ae4106050 msgr2=0x7f8ae41a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.954+0000 7f8ae8a00700 1 --2- 172.21.15.81:0/4032363122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ae4106050 0x7f8ae41a1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.954+0000 7f8ae8a00700 1 -- 172.21.15.81:0/4032363122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae419c180 con 0x7f8ae4105690 2024-05-03T16:45:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.954+0000 7f8ae8a00700 1 --2- 172.21.15.81:0/4032363122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae4105690 0x7f8ae41a1860 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4006010 tx=0x7f8ad400bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.954+0000 7f8ae2000700 1 -- 172.21.15.81:0/4032363122 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4027070 con 0x7f8ae4105690 2024-05-03T16:45:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.954+0000 7f8ae2000700 1 -- 172.21.15.81:0/4032363122 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ad400fb90 con 0x7f8ae4105690 2024-05-03T16:45:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.954+0000 7f8aeb400700 1 -- 172.21.15.81:0/4032363122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae419c410 con 0x7f8ae4105690 2024-05-03T16:45:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.954+0000 7f8ae2000700 1 -- 172.21.15.81:0/4032363122 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad40173f0 con 0x7f8ae4105690 2024-05-03T16:45:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.954+0000 7f8aeb400700 1 -- 172.21.15.81:0/4032363122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ae41a8730 con 0x7f8ae4105690 2024-05-03T16:45:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.955+0000 7f8aeb400700 1 -- 172.21.15.81:0/4032363122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ae410dc20 con 0x7f8ae4105690 2024-05-03T16:45:10.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.957+0000 7f8ae2000700 1 -- 172.21.15.81:0/4032363122 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f8ad402a070 con 0x7f8ae4105690 2024-05-03T16:45:10.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.958+0000 7f8ae2000700 1 --2- 172.21.15.81:0/4032363122 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8ac80b2880 0x7f8ac80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:10.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.959+0000 7f8ae2000700 1 -- 172.21.15.81:0/4032363122 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f8ad40e3600 con 0x7f8ae4105690 2024-05-03T16:45:10.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.959+0000 7f8adbe00700 1 --2- 172.21.15.81:0/4032363122 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8ac80b2880 0x7f8ac80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:10.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.960+0000 7f8adbe00700 1 --2- 172.21.15.81:0/4032363122 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8ac80b2880 0x7f8ac80b4d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8acc005950 tx=0x7f8acc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:10.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:10.963+0000 7f8ae2000700 1 -- 172.21.15.81:0/4032363122 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8ad4013070 con 0x7f8ae4105690 2024-05-03T16:45:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:11.197+0000 7f8aeb400700 1 -- 172.21.15.81:0/4032363122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ae419cf50 con 0x7f8ae4105690 2024-05-03T16:45:11.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:11.199+0000 7f8ae2000700 1 -- 172.21.15.81:0/4032363122 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24767 (secure 0 0 0) 0x7f8ad40aafa0 con 0x7f8ae4105690 2024-05-03T16:45:11.202 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:45:11.202 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":91,"fsid":"8988869e-096a-11ef-bc97-c7b262605968","created":"2024-05-03T16:32:56.440204+0000","modified":"2024-05-03T16:45:06.079032+0000","last_up_change":"2024-05-03T16:42:31.768974+0000","last_in_change":"2024-05-03T16:42:06.989688+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T16:37:18.271939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T16:43:50.469793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T16:43:54.708564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T16:44:09.064474+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"957b05dc-dfb9-4561-8800-b7ec0aba679d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6803","nonce":1639968055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6805","nonce":1639968055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6809","nonce":1639968055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6807","nonce":1639968055}]},"public_addr":"172.21.15.81:6803/1639968055","cluster_addr":"172.21.15.81:6805/1639968055","heartbeat_back_addr":"172.21.15.81:6809/1639968055","heartbeat_front_addr":"172.21.15.81:6807/1639968055","state":["exists","up"]},{"osd":1,"uuid":"3bb199cd-b4d0-4c67-b98f-2106336dd57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6801","nonce":1928503491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6803","nonce":1928503491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6807","nonce":1928503491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6805","nonce":1928503491}]},"public_addr":"172.21.15.134:6801/1928503491","cluster_addr":"172.21.15.134:6803/1928503491","heartbeat_back_addr":"172.21.15.134:6807/1928503491","heartbeat_front_addr":"172.21.15.134:6805/1928503491","state":["exists","up"]},{"osd":2,"uuid":"79ec9995-50e8-4eaf-935a-39a479925734","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6801","nonce":1233108455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6803","nonce":1233108455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6807","nonce":1233108455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6805","nonce":1233108455}]},"public_addr":"172.21.15.146:6801/1233108455","cluster_addr":"172.21.15.146:6803/1233108455","heartbeat_back_addr":"172.21.15.146:6807/1233108455","heartbeat_front_addr":"172.21.15.146:6805/1233108455","state":["exists","up"]},{"osd":3,"uuid":"2d38f4e7-73c3-4e70-9f87-d44da28db452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6811","nonce":4128709465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6813","nonce":4128709465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6817","nonce":4128709465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6815","nonce":4128709465}]},"public_addr":"172.21.15.81:6811/4128709465","cluster_addr":"172.21.15.81:6813/4128709465","heartbeat_back_addr":"172.21.15.81:6817/4128709465","heartbeat_front_addr":"172.21.15.81:6815/4128709465","state":["exists","up"]},{"osd":4,"uuid":"3837a136-a25b-4cb9-aa82-084b477c67d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6809","nonce":1498616220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6811","nonce":1498616220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6815","nonce":1498616220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6813","nonce":1498616220}]},"public_addr":"172.21.15.134:6809/1498616220","cluster_addr":"172.21.15.134:6811/1498616220","heartbeat_back_addr":"172.21.15.134:6815/1498616220","heartbeat_front_addr":"172.21.15.134:6813/1498616220","state":["exists","up"]},{"osd":5,"uuid":"2e783d2e-c181-41a9-97de-f17705a201bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6809","nonce":1276988922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6811","nonce":1276988922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6815","nonce":1276988922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6813","nonce":1276988922}]},"public_addr":"172.21.15.146:6809/1276988922","cluster_addr":"172.21.15.146:6811/1276988922","heartbeat_back_addr":"172.21.15.146:6815/1276988922","heartbeat_front_addr":"172.21.15.146:6813/1276988922","state":["exists","up"]},{"osd":6,"uuid":"6faebdbf-7820-42e5-b07c-15db11f278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6819","nonce":3319125020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6821","nonce":3319125020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6825","nonce":3319125020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6823","nonce":3319125020}]},"public_addr":"172.21.15.81:6819/3319125020","cluster_addr":"172.21.15.81:6821/3319125020","heartbeat_back_addr":"172.21.15.81:6825/3319125020","heartbeat_front_addr":"172.21.15.81:6823/3319125020","state":["exists","up"]},{"osd":7,"uuid":"ec4b6b84-6c5f-4d07-a747-06610b2cd345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6817","nonce":3241993481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6819","nonce":3241993481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6823","nonce":3241993481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6821","nonce":3241993481}]},"public_addr":"172.21.15.134:6817/3241993481","cluster_addr":"172.21.15.134:6819/3241993481","heartbeat_back_addr":"172.21.15.134:6823/3241993481","heartbeat_front_addr":"172.21.15.134:6821/3241993481","state":["exists","up"]},{"osd":8,"uuid":"02b1b0fd-837c-4c29-bedb-54fa2ee7531d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6817","nonce":2423161684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6819","nonce":2423161684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6823","nonce":2423161684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6821","nonce":2423161684}]},"public_addr":"172.21.15.146:6817/2423161684","cluster_addr":"172.21.15.146:6819/2423161684","heartbeat_back_addr":"172.21.15.146:6823/2423161684","heartbeat_front_addr":"172.21.15.146:6821/2423161684","state":["exists","up"]},{"osd":9,"uuid":"46713a8e-743d-44d5-babe-c01d3179afcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6827","nonce":873909886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6829","nonce":873909886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6833","nonce":873909886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6831","nonce":873909886}]},"public_addr":"172.21.15.81:6827/873909886","cluster_addr":"172.21.15.81:6829/873909886","heartbeat_back_addr":"172.21.15.81:6833/873909886","heartbeat_front_addr":"172.21.15.81:6831/873909886","state":["exists","up"]},{"osd":10,"uuid":"12fcae89-30af-436b-a513-3998303da93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6825","nonce":1183629038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6827","nonce":1183629038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6831","nonce":1183629038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6829","nonce":1183629038}]},"public_addr":"172.21.15.134:6825/1183629038","cluster_addr":"172.21.15.134:6827/1183629038","heartbeat_back_addr":"172.21.15.134:6831/1183629038","heartbeat_front_addr":"172.21.15.134:6829/1183629038","state":["exists","up"]},{"osd":11,"uuid":"a543f42c-61da-4a93-b16b-a2891a4ef873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6825","nonce":2627233639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6827","nonce":2627233639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6831","nonce":2627233639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6829","nonce":2627233639}]},"public_addr":"172.21.15.146:6825/2627233639","cluster_addr":"172.21.15.146:6827/2627233639","heartbeat_back_addr":"172.21.15.146:6831/2627233639","heartbeat_front_addr":"172.21.15.146:6829/2627233639","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:08.411954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:41.459869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:15.068172+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:49.711273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:23.231811+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:57.917964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:39:32.982397+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:07.434610+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:43.606108+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:19.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:54.917284+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:42:30.525217+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6801/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/2237510960":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6801/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/3199433706":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1689714816":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/2777950369":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/1982866220":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1112375028":"2024-05-04T16:33:30.274051+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T16:45:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:11.202+0000 7f8aeb400700 1 -- 172.21.15.81:0/4032363122 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8ac80b2880 msgr2=0x7f8ac80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:11.202+0000 7f8aeb400700 1 --2- 172.21.15.81:0/4032363122 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8ac80b2880 0x7f8ac80b4d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8acc005950 tx=0x7f8acc0058e0 comp rx=0 tx=0).stop 2024-05-03T16:45:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:11.202+0000 7f8aeb400700 1 -- 172.21.15.81:0/4032363122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae4105690 msgr2=0x7f8ae41a1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:11.202+0000 7f8aeb400700 1 --2- 172.21.15.81:0/4032363122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae4105690 0x7f8ae41a1860 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4006010 tx=0x7f8ad400bfa0 comp rx=0 tx=0).stop 2024-05-03T16:45:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:11.203+0000 7f8aeb400700 1 -- 172.21.15.81:0/4032363122 shutdown_connections 2024-05-03T16:45:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:11.203+0000 7f8aeb400700 1 --2- 172.21.15.81:0/4032363122 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8ac80b2880 0x7f8ac80b4d40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:11.203+0000 7f8aeb400700 1 --2- 172.21.15.81:0/4032363122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ae410b690 0x7f8ae419ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:11.203+0000 7f8aeb400700 1 --2- 172.21.15.81:0/4032363122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae4105690 0x7f8ae41a1860 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:11.203+0000 7f8aeb400700 1 --2- 172.21.15.81:0/4032363122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ae4106050 0x7f8ae41a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:11.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:11.203+0000 7f8aeb400700 1 -- 172.21.15.81:0/4032363122 >> 172.21.15.81:0/4032363122 conn(0x7f8ae4101180 msgr2=0x7f8ae41019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:11.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:11.203+0000 7f8aeb400700 1 -- 172.21.15.81:0/4032363122 shutdown_connections 2024-05-03T16:45:11.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:11.203+0000 7f8aeb400700 1 -- 172.21.15.81:0/4032363122 wait complete. 2024-05-03T16:45:11.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:11 smithi081 ceph-mon[28640]: pgmap v414: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-03T16:45:11.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:11 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/4032363122' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:45:11.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:11 smithi134 ceph-mon[31708]: pgmap v414: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-03T16:45:11.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:11 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/4032363122' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:45:11.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:11 smithi146 ceph-mon[32357]: pgmap v414: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-03T16:45:11.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:11 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/4032363122' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:45:12.086 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T16:45:12.527 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:45:12.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:12 smithi081 ceph-mon[28640]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-05-03T16:45:12.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:12 smithi081 ceph-mon[28640]: Cluster is now healthy 2024-05-03T16:45:12.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:12 smithi146 ceph-mon[32357]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-05-03T16:45:12.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:12 smithi146 ceph-mon[32357]: Cluster is now healthy 2024-05-03T16:45:12.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:12 smithi134 ceph-mon[31708]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-05-03T16:45:12.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:12 smithi134 ceph-mon[31708]: Cluster is now healthy 2024-05-03T16:45:13.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:13 smithi081 ceph-mon[28640]: pgmap v415: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-03T16:45:13.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:13 smithi146 ceph-mon[32357]: pgmap v415: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-03T16:45:13.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:13 smithi134 ceph-mon[31708]: pgmap v415: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-03T16:45:14.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.775+0000 7f269b600700 1 -- 172.21.15.81:0/3681994673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2694106080 msgr2=0x7f2694112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:14.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.775+0000 7f269b600700 1 --2- 172.21.15.81:0/3681994673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2694106080 0x7f2694112590 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f268c00b0a0 tx=0x7f268c00b3b0 comp rx=0 tx=0).stop 2024-05-03T16:45:14.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.775+0000 7f269b600700 1 -- 172.21.15.81:0/3681994673 shutdown_connections 2024-05-03T16:45:14.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.775+0000 7f269b600700 1 --2- 172.21.15.81:0/3681994673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f269410b6c0 0x7f269410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:14.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.775+0000 7f269b600700 1 --2- 172.21.15.81:0/3681994673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2694106080 0x7f2694112590 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:14.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.775+0000 7f269b600700 1 --2- 172.21.15.81:0/3681994673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26941056c0 0x7f2694105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:14.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.775+0000 7f269b600700 1 -- 172.21.15.81:0/3681994673 >> 172.21.15.81:0/3681994673 conn(0x7f26941011b0 msgr2=0x7f26941035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:14.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.776+0000 7f269b600700 1 -- 172.21.15.81:0/3681994673 shutdown_connections 2024-05-03T16:45:14.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.776+0000 7f269b600700 1 -- 172.21.15.81:0/3681994673 wait complete. 2024-05-03T16:45:14.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.777+0000 7f269b600700 1 Processor -- start 2024-05-03T16:45:14.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.777+0000 7f269b600700 1 -- start start 2024-05-03T16:45:14.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.777+0000 7f269b600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26941056c0 0x7f269419bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:14.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.777+0000 7f269b600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2694106080 0x7f269419c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:14.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.777+0000 7f269b600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f269410b6c0 0x7f26941a0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:14.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.777+0000 7f269b600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2694115750 con 0x7f269410b6c0 2024-05-03T16:45:14.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.777+0000 7f269b600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f26941155d0 con 0x7f2694106080 2024-05-03T16:45:14.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.777+0000 7f269b600700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f26941158d0 con 0x7f26941056c0 2024-05-03T16:45:14.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.778+0000 7f2699600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f269410b6c0 0x7f26941a0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:14.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.778+0000 7f2699600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f269410b6c0 0x7f26941a0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32814/0 (socket says 172.21.15.81:32814) 2024-05-03T16:45:14.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.778+0000 7f2699600700 1 -- 172.21.15.81:0/4221426788 learned_addr learned my addr 172.21.15.81:0/4221426788 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:45:14.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.778+0000 7f2698c00700 1 --2- 172.21.15.81:0/4221426788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26941056c0 0x7f269419bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:14.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.778+0000 7f2693e00700 1 --2- 172.21.15.81:0/4221426788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2694106080 0x7f269419c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:14.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.778+0000 7f2699600700 1 -- 172.21.15.81:0/4221426788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26941056c0 msgr2=0x7f269419bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:14.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.778+0000 7f2699600700 1 --2- 172.21.15.81:0/4221426788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26941056c0 0x7f269419bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:14.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.778+0000 7f2699600700 1 -- 172.21.15.81:0/4221426788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2694106080 msgr2=0x7f269419c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:14.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.778+0000 7f2699600700 1 --2- 172.21.15.81:0/4221426788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2694106080 0x7f269419c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:14.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.778+0000 7f2699600700 1 -- 172.21.15.81:0/4221426788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26941a0c20 con 0x7f269410b6c0 2024-05-03T16:45:14.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.778+0000 7f2698c00700 1 --2- 172.21.15.81:0/4221426788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26941056c0 0x7f269419bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:45:14.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.778+0000 7f2699600700 1 --2- 172.21.15.81:0/4221426788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f269410b6c0 0x7f26941a0520 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f268c0062a0 tx=0x7f268c004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:14.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.779+0000 7f2691600700 1 -- 172.21.15.81:0/4221426788 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c021070 con 0x7f269410b6c0 2024-05-03T16:45:14.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.779+0000 7f2691600700 1 -- 172.21.15.81:0/4221426788 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f268c007d00 con 0x7f269410b6c0 2024-05-03T16:45:14.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.779+0000 7f269b600700 1 -- 172.21.15.81:0/4221426788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26941a0eb0 con 0x7f269410b6c0 2024-05-03T16:45:14.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.779+0000 7f2691600700 1 -- 172.21.15.81:0/4221426788 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c005280 con 0x7f269410b6c0 2024-05-03T16:45:14.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.779+0000 7f269b600700 1 -- 172.21.15.81:0/4221426788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26941a87d0 con 0x7f269410b6c0 2024-05-03T16:45:14.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.780+0000 7f269b600700 1 -- 172.21.15.81:0/4221426788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2694106e00 con 0x7f269410b6c0 2024-05-03T16:45:14.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.782+0000 7f2691600700 1 -- 172.21.15.81:0/4221426788 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f268c024070 con 0x7f269410b6c0 2024-05-03T16:45:14.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.784+0000 7f2691600700 1 --2- 172.21.15.81:0/4221426788 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f267c0b2900 0x7f267c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:14.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.784+0000 7f2691600700 1 -- 172.21.15.81:0/4221426788 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f268c0e3c50 con 0x7f269410b6c0 2024-05-03T16:45:14.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.784+0000 7f2698c00700 1 --2- 172.21.15.81:0/4221426788 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f267c0b2900 0x7f267c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:14.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.785+0000 7f2698c00700 1 --2- 172.21.15.81:0/4221426788 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f267c0b2900 0x7f267c0b4dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2688005fd0 tx=0x7f268800a5e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:14.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:14.788+0000 7f2691600700 1 -- 172.21.15.81:0/4221426788 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f268c0ab5f0 con 0x7f269410b6c0 2024-05-03T16:45:15.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:15.022+0000 7f269b600700 1 -- 172.21.15.81:0/4221426788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f269402e510 con 0x7f269410b6c0 2024-05-03T16:45:15.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:15.025+0000 7f2691600700 1 -- 172.21.15.81:0/4221426788 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24767 (secure 0 0 0) 0x7f268c0aaef0 con 0x7f269410b6c0 2024-05-03T16:45:15.028 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:45:15.028 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":91,"fsid":"8988869e-096a-11ef-bc97-c7b262605968","created":"2024-05-03T16:32:56.440204+0000","modified":"2024-05-03T16:45:06.079032+0000","last_up_change":"2024-05-03T16:42:31.768974+0000","last_in_change":"2024-05-03T16:42:06.989688+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T16:37:18.271939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T16:43:50.469793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T16:43:54.708564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T16:44:09.064474+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"957b05dc-dfb9-4561-8800-b7ec0aba679d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6803","nonce":1639968055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6805","nonce":1639968055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6809","nonce":1639968055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6807","nonce":1639968055}]},"public_addr":"172.21.15.81:6803/1639968055","cluster_addr":"172.21.15.81:6805/1639968055","heartbeat_back_addr":"172.21.15.81:6809/1639968055","heartbeat_front_addr":"172.21.15.81:6807/1639968055","state":["exists","up"]},{"osd":1,"uuid":"3bb199cd-b4d0-4c67-b98f-2106336dd57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6801","nonce":1928503491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6803","nonce":1928503491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6807","nonce":1928503491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6805","nonce":1928503491}]},"public_addr":"172.21.15.134:6801/1928503491","cluster_addr":"172.21.15.134:6803/1928503491","heartbeat_back_addr":"172.21.15.134:6807/1928503491","heartbeat_front_addr":"172.21.15.134:6805/1928503491","state":["exists","up"]},{"osd":2,"uuid":"79ec9995-50e8-4eaf-935a-39a479925734","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6801","nonce":1233108455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6803","nonce":1233108455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6807","nonce":1233108455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6805","nonce":1233108455}]},"public_addr":"172.21.15.146:6801/1233108455","cluster_addr":"172.21.15.146:6803/1233108455","heartbeat_back_addr":"172.21.15.146:6807/1233108455","heartbeat_front_addr":"172.21.15.146:6805/1233108455","state":["exists","up"]},{"osd":3,"uuid":"2d38f4e7-73c3-4e70-9f87-d44da28db452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6811","nonce":4128709465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6813","nonce":4128709465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6817","nonce":4128709465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6815","nonce":4128709465}]},"public_addr":"172.21.15.81:6811/4128709465","cluster_addr":"172.21.15.81:6813/4128709465","heartbeat_back_addr":"172.21.15.81:6817/4128709465","heartbeat_front_addr":"172.21.15.81:6815/4128709465","state":["exists","up"]},{"osd":4,"uuid":"3837a136-a25b-4cb9-aa82-084b477c67d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6809","nonce":1498616220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6811","nonce":1498616220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6815","nonce":1498616220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6813","nonce":1498616220}]},"public_addr":"172.21.15.134:6809/1498616220","cluster_addr":"172.21.15.134:6811/1498616220","heartbeat_back_addr":"172.21.15.134:6815/1498616220","heartbeat_front_addr":"172.21.15.134:6813/1498616220","state":["exists","up"]},{"osd":5,"uuid":"2e783d2e-c181-41a9-97de-f17705a201bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6809","nonce":1276988922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6811","nonce":1276988922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6815","nonce":1276988922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6813","nonce":1276988922}]},"public_addr":"172.21.15.146:6809/1276988922","cluster_addr":"172.21.15.146:6811/1276988922","heartbeat_back_addr":"172.21.15.146:6815/1276988922","heartbeat_front_addr":"172.21.15.146:6813/1276988922","state":["exists","up"]},{"osd":6,"uuid":"6faebdbf-7820-42e5-b07c-15db11f278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6819","nonce":3319125020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6821","nonce":3319125020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6825","nonce":3319125020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6823","nonce":3319125020}]},"public_addr":"172.21.15.81:6819/3319125020","cluster_addr":"172.21.15.81:6821/3319125020","heartbeat_back_addr":"172.21.15.81:6825/3319125020","heartbeat_front_addr":"172.21.15.81:6823/3319125020","state":["exists","up"]},{"osd":7,"uuid":"ec4b6b84-6c5f-4d07-a747-06610b2cd345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6817","nonce":3241993481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6819","nonce":3241993481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6823","nonce":3241993481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6821","nonce":3241993481}]},"public_addr":"172.21.15.134:6817/3241993481","cluster_addr":"172.21.15.134:6819/3241993481","heartbeat_back_addr":"172.21.15.134:6823/3241993481","heartbeat_front_addr":"172.21.15.134:6821/3241993481","state":["exists","up"]},{"osd":8,"uuid":"02b1b0fd-837c-4c29-bedb-54fa2ee7531d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6817","nonce":2423161684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6819","nonce":2423161684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6823","nonce":2423161684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6821","nonce":2423161684}]},"public_addr":"172.21.15.146:6817/2423161684","cluster_addr":"172.21.15.146:6819/2423161684","heartbeat_back_addr":"172.21.15.146:6823/2423161684","heartbeat_front_addr":"172.21.15.146:6821/2423161684","state":["exists","up"]},{"osd":9,"uuid":"46713a8e-743d-44d5-babe-c01d3179afcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6827","nonce":873909886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6829","nonce":873909886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6833","nonce":873909886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6831","nonce":873909886}]},"public_addr":"172.21.15.81:6827/873909886","cluster_addr":"172.21.15.81:6829/873909886","heartbeat_back_addr":"172.21.15.81:6833/873909886","heartbeat_front_addr":"172.21.15.81:6831/873909886","state":["exists","up"]},{"osd":10,"uuid":"12fcae89-30af-436b-a513-3998303da93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6825","nonce":1183629038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6827","nonce":1183629038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6831","nonce":1183629038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6829","nonce":1183629038}]},"public_addr":"172.21.15.134:6825/1183629038","cluster_addr":"172.21.15.134:6827/1183629038","heartbeat_back_addr":"172.21.15.134:6831/1183629038","heartbeat_front_addr":"172.21.15.134:6829/1183629038","state":["exists","up"]},{"osd":11,"uuid":"a543f42c-61da-4a93-b16b-a2891a4ef873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6825","nonce":2627233639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6827","nonce":2627233639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6831","nonce":2627233639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6829","nonce":2627233639}]},"public_addr":"172.21.15.146:6825/2627233639","cluster_addr":"172.21.15.146:6827/2627233639","heartbeat_back_addr":"172.21.15.146:6831/2627233639","heartbeat_front_addr":"172.21.15.146:6829/2627233639","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:08.411954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:41.459869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:15.068172+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:49.711273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:23.231811+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:57.917964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:39:32.982397+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:07.434610+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:43.606108+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:19.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:54.917284+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:42:30.525217+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6801/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/2237510960":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6801/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/3199433706":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1689714816":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/2777950369":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/1982866220":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1112375028":"2024-05-04T16:33:30.274051+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T16:45:15.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:15.028+0000 7f269b600700 1 -- 172.21.15.81:0/4221426788 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f267c0b2900 msgr2=0x7f267c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:15.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:15.028+0000 7f269b600700 1 --2- 172.21.15.81:0/4221426788 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f267c0b2900 0x7f267c0b4dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2688005fd0 tx=0x7f268800a5e0 comp rx=0 tx=0).stop 2024-05-03T16:45:15.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:15.028+0000 7f269b600700 1 -- 172.21.15.81:0/4221426788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f269410b6c0 msgr2=0x7f26941a0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:15.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:15.028+0000 7f269b600700 1 --2- 172.21.15.81:0/4221426788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f269410b6c0 0x7f26941a0520 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f268c0062a0 tx=0x7f268c004ed0 comp rx=0 tx=0).stop 2024-05-03T16:45:15.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:15.028+0000 7f269b600700 1 -- 172.21.15.81:0/4221426788 shutdown_connections 2024-05-03T16:45:15.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:15.028+0000 7f269b600700 1 --2- 172.21.15.81:0/4221426788 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f267c0b2900 0x7f267c0b4dc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:15.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:15.028+0000 7f269b600700 1 --2- 172.21.15.81:0/4221426788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26941056c0 0x7f269419bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:15.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:15.028+0000 7f269b600700 1 --2- 172.21.15.81:0/4221426788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f269410b6c0 0x7f26941a0520 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:15.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:15.028+0000 7f269b600700 1 --2- 172.21.15.81:0/4221426788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2694106080 0x7f269419c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:15.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:15.028+0000 7f269b600700 1 -- 172.21.15.81:0/4221426788 >> 172.21.15.81:0/4221426788 conn(0x7f26941011b0 msgr2=0x7f2694101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:15.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:15.028+0000 7f269b600700 1 -- 172.21.15.81:0/4221426788 shutdown_connections 2024-05-03T16:45:15.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:15.029+0000 7f269b600700 1 -- 172.21.15.81:0/4221426788 wait complete. 2024-05-03T16:45:15.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:15 smithi081 ceph-mon[28640]: pgmap v416: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 110 B/s wr, 0 op/s 2024-05-03T16:45:15.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:15 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/4221426788' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:45:15.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:15 smithi146 ceph-mon[32357]: pgmap v416: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 110 B/s wr, 0 op/s 2024-05-03T16:45:15.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:15 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/4221426788' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:45:15.906 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-05-03T16:45:15.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:15 smithi134 ceph-mon[31708]: pgmap v416: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 110 B/s wr, 0 op/s 2024-05-03T16:45:15.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:15 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/4221426788' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:45:16.353 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:45:17.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:17 smithi081 ceph-mon[28640]: pgmap v417: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 100 B/s wr, 0 op/s 2024-05-03T16:45:17.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:17 smithi146 ceph-mon[32357]: pgmap v417: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 100 B/s wr, 0 op/s 2024-05-03T16:45:17.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:17 smithi134 ceph-mon[31708]: pgmap v417: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 100 B/s wr, 0 op/s 2024-05-03T16:45:18.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.648+0000 7fdef7e00700 1 -- 172.21.15.81:0/2550469514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef00756d0 msgr2=0x7fdef0075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:18.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.648+0000 7fdef7e00700 1 --2- 172.21.15.81:0/2550469514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef00756d0 0x7fdef0075ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdee4009990 tx=0x7fdee4009ca0 comp rx=0 tx=0).stop 2024-05-03T16:45:18.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.648+0000 7fdef7e00700 1 -- 172.21.15.81:0/2550469514 shutdown_connections 2024-05-03T16:45:18.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.648+0000 7fdef7e00700 1 --2- 172.21.15.81:0/2550469514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdef010fea0 0x7fdef0112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:18.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.648+0000 7fdef7e00700 1 --2- 172.21.15.81:0/2550469514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef00756d0 0x7fdef0075ab0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:18.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.648+0000 7fdef7e00700 1 --2- 172.21.15.81:0/2550469514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdef0075ff0 0x7fdef010f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:18.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.648+0000 7fdef7e00700 1 -- 172.21.15.81:0/2550469514 >> 172.21.15.81:0/2550469514 conn(0x7fdef007a600 msgr2=0x7fdef007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:18.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.648+0000 7fdef7e00700 1 -- 172.21.15.81:0/2550469514 shutdown_connections 2024-05-03T16:45:18.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.648+0000 7fdef7e00700 1 -- 172.21.15.81:0/2550469514 wait complete. 2024-05-03T16:45:18.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.650+0000 7fdef7e00700 1 Processor -- start 2024-05-03T16:45:18.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.650+0000 7fdef7e00700 1 -- start start 2024-05-03T16:45:18.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.650+0000 7fdef7e00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdef00756d0 0x7fdef01a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:18.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.651+0000 7fdef7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdef0075ff0 0x7fdef01a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:18.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.651+0000 7fdef7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef010fea0 0x7fdef019bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:18.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.651+0000 7fdef7e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdef0115740 con 0x7fdef010fea0 2024-05-03T16:45:18.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.651+0000 7fdef7e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdef01155c0 con 0x7fdef0075ff0 2024-05-03T16:45:18.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.651+0000 7fdef7e00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdef01158c0 con 0x7fdef00756d0 2024-05-03T16:45:18.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.651+0000 7fdef5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef010fea0 0x7fdef019bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:18.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.651+0000 7fdef5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef010fea0 0x7fdef019bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40920/0 (socket says 172.21.15.81:40920) 2024-05-03T16:45:18.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.651+0000 7fdef5e00700 1 -- 172.21.15.81:0/3452646565 learned_addr learned my addr 172.21.15.81:0/3452646565 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:45:18.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.651+0000 7fdef5400700 1 --2- 172.21.15.81:0/3452646565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdef00756d0 0x7fdef01a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:18.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.651+0000 7fdef4a00700 1 --2- 172.21.15.81:0/3452646565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdef0075ff0 0x7fdef01a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:18.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.651+0000 7fdef5e00700 1 -- 172.21.15.81:0/3452646565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdef00756d0 msgr2=0x7fdef01a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:18.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.651+0000 7fdef5e00700 1 --2- 172.21.15.81:0/3452646565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdef00756d0 0x7fdef01a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:18.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.651+0000 7fdef5e00700 1 -- 172.21.15.81:0/3452646565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdef0075ff0 msgr2=0x7fdef01a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:18.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.651+0000 7fdef5e00700 1 --2- 172.21.15.81:0/3452646565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdef0075ff0 0x7fdef01a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:18.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.651+0000 7fdef5e00700 1 -- 172.21.15.81:0/3452646565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef019c220 con 0x7fdef010fea0 2024-05-03T16:45:18.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.651+0000 7fdef5400700 1 --2- 172.21.15.81:0/3452646565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdef00756d0 0x7fdef01a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:45:18.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.651+0000 7fdef4a00700 1 --2- 172.21.15.81:0/3452646565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdef0075ff0 0x7fdef01a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:45:18.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.652+0000 7fdef5e00700 1 --2- 172.21.15.81:0/3452646565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef010fea0 0x7fdef019bac0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdee8007d70 tx=0x7fdee800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:18.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.652+0000 7fdeee000700 1 -- 172.21.15.81:0/3452646565 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee8016020 con 0x7fdef010fea0 2024-05-03T16:45:18.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.652+0000 7fdeee000700 1 -- 172.21.15.81:0/3452646565 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdee800ad40 con 0x7fdef010fea0 2024-05-03T16:45:18.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.652+0000 7fdef7e00700 1 -- 172.21.15.81:0/3452646565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef019c510 con 0x7fdef010fea0 2024-05-03T16:45:18.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.652+0000 7fdeee000700 1 -- 172.21.15.81:0/3452646565 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee80115e0 con 0x7fdef010fea0 2024-05-03T16:45:18.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.652+0000 7fdef7e00700 1 -- 172.21.15.81:0/3452646565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef01a87d0 con 0x7fdef010fea0 2024-05-03T16:45:18.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.653+0000 7fdef7e00700 1 -- 172.21.15.81:0/3452646565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdef006a190 con 0x7fdef010fea0 2024-05-03T16:45:18.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.656+0000 7fdeee000700 1 -- 172.21.15.81:0/3452646565 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fdee8019020 con 0x7fdef010fea0 2024-05-03T16:45:18.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.657+0000 7fdeee000700 1 --2- 172.21.15.81:0/3452646565 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fded80b2880 0x7fded80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:18.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.657+0000 7fdeee000700 1 -- 172.21.15.81:0/3452646565 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fdee80e25f0 con 0x7fdef010fea0 2024-05-03T16:45:18.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.657+0000 7fdef5400700 1 --2- 172.21.15.81:0/3452646565 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fded80b2880 0x7fded80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:18.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.658+0000 7fdef5400700 1 --2- 172.21.15.81:0/3452646565 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fded80b2880 0x7fded80b4d40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdee400b5c0 tx=0x7fdee4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:18.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.661+0000 7fdeee000700 1 -- 172.21.15.81:0/3452646565 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fdee8020020 con 0x7fdef010fea0 2024-05-03T16:45:18.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:18.943+0000 7fdef7e00700 1 -- 172.21.15.81:0/3452646565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fdef002e510 con 0x7fdef010fea0 2024-05-03T16:45:19.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:19.513+0000 7fdeee000700 1 -- 172.21.15.81:0/3452646565 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7fdee80a9f00 con 0x7fdef010fea0 2024-05-03T16:45:19.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:19.518+0000 7fdef7e00700 1 -- 172.21.15.81:0/3452646565 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fded80b2880 msgr2=0x7fded80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:19.518+0000 7fdef7e00700 1 --2- 172.21.15.81:0/3452646565 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fded80b2880 0x7fded80b4d40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdee400b5c0 tx=0x7fdee4005fb0 comp rx=0 tx=0).stop 2024-05-03T16:45:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:19.518+0000 7fdef7e00700 1 -- 172.21.15.81:0/3452646565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef010fea0 msgr2=0x7fdef019bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:19.518+0000 7fdef7e00700 1 --2- 172.21.15.81:0/3452646565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef010fea0 0x7fdef019bac0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdee8007d70 tx=0x7fdee800a340 comp rx=0 tx=0).stop 2024-05-03T16:45:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:19.518+0000 7fdef7e00700 1 -- 172.21.15.81:0/3452646565 shutdown_connections 2024-05-03T16:45:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:19.518+0000 7fdef7e00700 1 --2- 172.21.15.81:0/3452646565 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fded80b2880 0x7fded80b4d40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:19.518+0000 7fdef7e00700 1 --2- 172.21.15.81:0/3452646565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdef00756d0 0x7fdef01a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:19.518+0000 7fdef7e00700 1 --2- 172.21.15.81:0/3452646565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef010fea0 0x7fdef019bac0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:19.518+0000 7fdef7e00700 1 --2- 172.21.15.81:0/3452646565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdef0075ff0 0x7fdef01a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:19.518+0000 7fdef7e00700 1 -- 172.21.15.81:0/3452646565 >> 172.21.15.81:0/3452646565 conn(0x7fdef007a600 msgr2=0x7fdef01007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:19.518+0000 7fdef7e00700 1 -- 172.21.15.81:0/3452646565 shutdown_connections 2024-05-03T16:45:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:19.518+0000 7fdef7e00700 1 -- 172.21.15.81:0/3452646565 wait complete. 2024-05-03T16:45:19.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:19 smithi146 ceph-mon[32357]: pgmap v418: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:45:19.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:19 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3452646565' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-03T16:45:19.926 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:19 smithi081 ceph-mon[28640]: pgmap v418: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:45:19.926 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:19 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3452646565' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-03T16:45:19.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:19 smithi134 ceph-mon[31708]: pgmap v418: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:45:19.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:19 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3452646565' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-03T16:45:20.346 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-05-03T16:45:20.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-05-03T16:45:20.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:20 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3452646565' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-03T16:45:20.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:20 smithi081 ceph-mon[28640]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T16:45:20.786 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:45:20.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:20 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3452646565' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-03T16:45:20.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:20 smithi146 ceph-mon[32357]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T16:45:20.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:20 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3452646565' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-03T16:45:20.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:20 smithi134 ceph-mon[31708]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T16:45:21.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:21 smithi081 ceph-mon[28640]: pgmap v419: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:45:21.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:21 smithi146 ceph-mon[32357]: pgmap v419: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:45:21.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:21 smithi134 ceph-mon[31708]: pgmap v419: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:45:23.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:22.999+0000 7f6c0b200700 1 -- 172.21.15.81:0/291465984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c0c101aa0 msgr2=0x7f6c0c101e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:23.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:22.999+0000 7f6c0b200700 1 --2- 172.21.15.81:0/291465984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c0c101aa0 0x7f6c0c101e80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc009990 tx=0x7f6bfc009ca0 comp rx=0 tx=0).stop 2024-05-03T16:45:23.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:22.999+0000 7f6c0b200700 1 -- 172.21.15.81:0/291465984 shutdown_connections 2024-05-03T16:45:23.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:22.999+0000 7f6c0b200700 1 --2- 172.21.15.81:0/291465984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c0c10da20 0x7f6c0c10fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:23.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:22.999+0000 7f6c0b200700 1 --2- 172.21.15.81:0/291465984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c0c101aa0 0x7f6c0c101e80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:23.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:22.999+0000 7f6c0b200700 1 --2- 172.21.15.81:0/291465984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0c1023c0 0x7f6c0c10d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:23.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:22.999+0000 7f6c0b200700 1 -- 172.21.15.81:0/291465984 >> 172.21.15.81:0/291465984 conn(0x7f6c0c077140 msgr2=0x7f6c0c077550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:23.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:22.999+0000 7f6c0b200700 1 -- 172.21.15.81:0/291465984 shutdown_connections 2024-05-03T16:45:23.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:22.999+0000 7f6c0b200700 1 -- 172.21.15.81:0/291465984 wait complete. 2024-05-03T16:45:23.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.000+0000 7f6c0b200700 1 Processor -- start 2024-05-03T16:45:23.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.000+0000 7f6c0b200700 1 -- start start 2024-05-03T16:45:23.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.001+0000 7f6c0b200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0c101aa0 0x7f6c0c19f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:23.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.001+0000 7f6c0b200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c0c1023c0 0x7f6c0c19fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:23.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.001+0000 7f6c0b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c0c10da20 0x7f6c0c199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:23.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.001+0000 7f6c0b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c113480 con 0x7f6c0c10da20 2024-05-03T16:45:23.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.001+0000 7f6c0b200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c113300 con 0x7f6c0c1023c0 2024-05-03T16:45:23.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.001+0000 7f6c0b200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c113600 con 0x7f6c0c101aa0 2024-05-03T16:45:23.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.001+0000 7f6c0a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c0c10da20 0x7f6c0c199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:23.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.001+0000 7f6c0a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c0c10da20 0x7f6c0c199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40936/0 (socket says 172.21.15.81:40936) 2024-05-03T16:45:23.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.001+0000 7f6c0a800700 1 -- 172.21.15.81:0/462955535 learned_addr learned my addr 172.21.15.81:0/462955535 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:45:23.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.001+0000 7f6c09400700 1 --2- 172.21.15.81:0/462955535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c0c1023c0 0x7f6c0c19fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:23.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.001+0000 7f6c09e00700 1 --2- 172.21.15.81:0/462955535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0c101aa0 0x7f6c0c19f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:23.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.002+0000 7f6c0a800700 1 -- 172.21.15.81:0/462955535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0c101aa0 msgr2=0x7f6c0c19f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:23.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.002+0000 7f6c0a800700 1 --2- 172.21.15.81:0/462955535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0c101aa0 0x7f6c0c19f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:23.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.002+0000 7f6c0a800700 1 -- 172.21.15.81:0/462955535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c0c1023c0 msgr2=0x7f6c0c19fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:23.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.002+0000 7f6c0a800700 1 --2- 172.21.15.81:0/462955535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c0c1023c0 0x7f6c0c19fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:23.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.002+0000 7f6c0a800700 1 -- 172.21.15.81:0/462955535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c0c19a020 con 0x7f6c0c10da20 2024-05-03T16:45:23.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.002+0000 7f6c0a800700 1 --2- 172.21.15.81:0/462955535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c0c10da20 0x7f6c0c199840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6c04007ee0 tx=0x7f6c0400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:23.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.002+0000 7f6c02a00700 1 -- 172.21.15.81:0/462955535 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0400dbd0 con 0x7f6c0c10da20 2024-05-03T16:45:23.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.002+0000 7f6c02a00700 1 -- 172.21.15.81:0/462955535 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c0400dd70 con 0x7f6c0c10da20 2024-05-03T16:45:23.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.002+0000 7f6c02a00700 1 -- 172.21.15.81:0/462955535 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c040058d0 con 0x7f6c0c10da20 2024-05-03T16:45:23.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.002+0000 7f6c0b200700 1 -- 172.21.15.81:0/462955535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c0c19a310 con 0x7f6c0c10da20 2024-05-03T16:45:23.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.002+0000 7f6c0b200700 1 -- 172.21.15.81:0/462955535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c0c1a6520 con 0x7f6c0c10da20 2024-05-03T16:45:23.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.004+0000 7f6c0b200700 1 -- 172.21.15.81:0/462955535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c0c102a60 con 0x7f6c0c10da20 2024-05-03T16:45:23.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.006+0000 7f6c02a00700 1 -- 172.21.15.81:0/462955535 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f6c0401a020 con 0x7f6c0c10da20 2024-05-03T16:45:23.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.008+0000 7f6c02a00700 1 --2- 172.21.15.81:0/462955535 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f6bf00b2900 0x7f6bf00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:23.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.009+0000 7f6c02a00700 1 -- 172.21.15.81:0/462955535 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f6c040e23f0 con 0x7f6c0c10da20 2024-05-03T16:45:23.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.009+0000 7f6c09e00700 1 --2- 172.21.15.81:0/462955535 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f6bf00b2900 0x7f6bf00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:23.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.010+0000 7f6c09e00700 1 --2- 172.21.15.81:0/462955535 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f6bf00b2900 0x7f6bf00b4dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00b5c0 tx=0x7f6bfc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:23.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.011+0000 7f6c02a00700 1 -- 172.21.15.81:0/462955535 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f6c04010070 con 0x7f6c0c10da20 2024-05-03T16:45:23.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.299+0000 7f6c0b200700 1 -- 172.21.15.81:0/462955535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f6c0c02e510 con 0x7f6c0c10da20 2024-05-03T16:45:23.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.537+0000 7f6c02a00700 1 -- 172.21.15.81:0/462955535 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f6c040a9d00 con 0x7f6c0c10da20 2024-05-03T16:45:23.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.541+0000 7f6c0b200700 1 -- 172.21.15.81:0/462955535 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f6bf00b2900 msgr2=0x7f6bf00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:23.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.541+0000 7f6c0b200700 1 --2- 172.21.15.81:0/462955535 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f6bf00b2900 0x7f6bf00b4dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00b5c0 tx=0x7f6bfc01a040 comp rx=0 tx=0).stop 2024-05-03T16:45:23.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.541+0000 7f6c0b200700 1 -- 172.21.15.81:0/462955535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c0c10da20 msgr2=0x7f6c0c199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:23.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.541+0000 7f6c0b200700 1 --2- 172.21.15.81:0/462955535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c0c10da20 0x7f6c0c199840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6c04007ee0 tx=0x7f6c0400d3b0 comp rx=0 tx=0).stop 2024-05-03T16:45:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.541+0000 7f6c0b200700 1 -- 172.21.15.81:0/462955535 shutdown_connections 2024-05-03T16:45:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.541+0000 7f6c0b200700 1 --2- 172.21.15.81:0/462955535 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f6bf00b2900 0x7f6bf00b4dc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.541+0000 7f6c0b200700 1 --2- 172.21.15.81:0/462955535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0c101aa0 0x7f6c0c19f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.541+0000 7f6c0b200700 1 --2- 172.21.15.81:0/462955535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c0c10da20 0x7f6c0c199840 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.541+0000 7f6c0b200700 1 --2- 172.21.15.81:0/462955535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c0c1023c0 0x7f6c0c19fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.541+0000 7f6c0b200700 1 -- 172.21.15.81:0/462955535 >> 172.21.15.81:0/462955535 conn(0x7f6c0c077140 msgr2=0x7f6c0c0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.541+0000 7f6c0b200700 1 -- 172.21.15.81:0/462955535 shutdown_connections 2024-05-03T16:45:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:23.541+0000 7f6c0b200700 1 -- 172.21.15.81:0/462955535 wait complete. 2024-05-03T16:45:23.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:23 smithi081 ceph-mon[28640]: pgmap v420: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:45:23.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:23 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/462955535' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-03T16:45:23.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:23 smithi146 ceph-mon[32357]: pgmap v420: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:45:23.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:23 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/462955535' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-03T16:45:23.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:23 smithi134 ceph-mon[31708]: pgmap v420: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:45:23.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:23 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/462955535' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-03T16:45:24.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-05-03T16:45:24.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:24 smithi081 ceph-mon[28640]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-03T16:45:24.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:24 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/462955535' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-03T16:45:24.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:24 smithi081 ceph-mon[28640]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-03T16:45:24.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:24 smithi081 ceph-mon[28640]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T16:45:24.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:24 smithi081 ceph-mon[28640]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-03T16:45:24.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:24 smithi081 ceph-mon[28640]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-03T16:45:24.895 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:45:24.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:24 smithi134 ceph-mon[31708]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-03T16:45:24.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:24 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/462955535' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-03T16:45:24.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:24 smithi134 ceph-mon[31708]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-03T16:45:24.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:24 smithi134 ceph-mon[31708]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T16:45:24.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:24 smithi134 ceph-mon[31708]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-03T16:45:24.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:24 smithi134 ceph-mon[31708]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-03T16:45:24.967 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 16:45:24 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-b[62229]: 2024-05-03T16:45:24.678+0000 7f4c9ac00700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-05-03T16:45:25.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:24 smithi146 ceph-mon[32357]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-03T16:45:25.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:24 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/462955535' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-03T16:45:25.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:24 smithi146 ceph-mon[32357]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-03T16:45:25.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:24 smithi146 ceph-mon[32357]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T16:45:25.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:24 smithi146 ceph-mon[32357]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-03T16:45:25.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:24 smithi146 ceph-mon[32357]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-03T16:45:25.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:25 smithi081 ceph-mon[28640]: pgmap v421: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:45:25.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:25 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] up:active 2024-05-03T16:45:25.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:25 smithi081 ceph-mon[28640]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-03T16:45:25.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:25 smithi081 ceph-mon[28640]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-03T16:45:25.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:25 smithi081 ceph-mon[28640]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-05-03T16:45:25.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:25 smithi081 ceph-mon[28640]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-05-03T16:45:25.868 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:25 smithi134 ceph-mon[31708]: pgmap v421: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:45:25.869 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:25 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] up:active 2024-05-03T16:45:25.869 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:25 smithi134 ceph-mon[31708]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-03T16:45:25.869 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:25 smithi134 ceph-mon[31708]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-03T16:45:25.869 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:25 smithi134 ceph-mon[31708]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-05-03T16:45:25.869 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:25 smithi134 ceph-mon[31708]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-05-03T16:45:26.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:25 smithi146 ceph-mon[32357]: pgmap v421: 129 pgs: 129 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T16:45:26.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:25 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] up:active 2024-05-03T16:45:26.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:25 smithi146 ceph-mon[32357]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-03T16:45:26.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:25 smithi146 ceph-mon[32357]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-03T16:45:26.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:25 smithi146 ceph-mon[32357]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-05-03T16:45:26.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:25 smithi146 ceph-mon[32357]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-05-03T16:45:26.661 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:26 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] up:active 2024-05-03T16:45:26.661 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:26 smithi081 ceph-mon[28640]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-03T16:45:26.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:26 smithi081 ceph-mon[28640]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-05-03T16:45:26.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:26 smithi081 ceph-mon[28640]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:creating} 8 up:standby 2024-05-03T16:45:26.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:26 smithi081 ceph-mon[28640]: daemon mds.k is now active in filesystem cephfs as rank 3 2024-05-03T16:45:26.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:26 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] up:active 2024-05-03T16:45:26.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:26 smithi134 ceph-mon[31708]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-03T16:45:26.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:26 smithi134 ceph-mon[31708]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-05-03T16:45:26.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:26 smithi134 ceph-mon[31708]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:creating} 8 up:standby 2024-05-03T16:45:26.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:26 smithi134 ceph-mon[31708]: daemon mds.k is now active in filesystem cephfs as rank 3 2024-05-03T16:45:27.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:26 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] up:active 2024-05-03T16:45:27.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:26 smithi146 ceph-mon[32357]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-03T16:45:27.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:26 smithi146 ceph-mon[32357]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-05-03T16:45:27.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:26 smithi146 ceph-mon[32357]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:creating} 8 up:standby 2024-05-03T16:45:27.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:26 smithi146 ceph-mon[32357]: daemon mds.k is now active in filesystem cephfs as rank 3 2024-05-03T16:45:27.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.259+0000 7f0643e00700 1 -- 172.21.15.81:0/2572486809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f063c10fb60 msgr2=0x7f063c10ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:27.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.259+0000 7f0643e00700 1 --2- 172.21.15.81:0/2572486809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f063c10fb60 0x7f063c10ff40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0630009990 tx=0x7f0630009ca0 comp rx=0 tx=0).stop 2024-05-03T16:45:27.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.259+0000 7f0643e00700 1 -- 172.21.15.81:0/2572486809 shutdown_connections 2024-05-03T16:45:27.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.259+0000 7f0643e00700 1 --2- 172.21.15.81:0/2572486809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f063c10a490 0x7f063c1169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:27.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.259+0000 7f0643e00700 1 --2- 172.21.15.81:0/2572486809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f063c10fb60 0x7f063c10ff40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:27.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.259+0000 7f0643e00700 1 --2- 172.21.15.81:0/2572486809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f063c109ad0 0x7f063c109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:27.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.259+0000 7f0643e00700 1 -- 172.21.15.81:0/2572486809 >> 172.21.15.81:0/2572486809 conn(0x7f063c076c70 msgr2=0x7f063c1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:27.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.259+0000 7f0643e00700 1 -- 172.21.15.81:0/2572486809 shutdown_connections 2024-05-03T16:45:27.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.259+0000 7f0643e00700 1 -- 172.21.15.81:0/2572486809 wait complete. 2024-05-03T16:45:27.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.260+0000 7f0643e00700 1 Processor -- start 2024-05-03T16:45:27.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.260+0000 7f0643e00700 1 -- start start 2024-05-03T16:45:27.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.261+0000 7f0643e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f063c109ad0 0x7f063c1a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:27.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.261+0000 7f0643e00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f063c10a490 0x7f063c1a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:27.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.261+0000 7f0643e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f063c10fb60 0x7f063c1a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:27.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.261+0000 7f0643e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f063c119b70 con 0x7f063c109ad0 2024-05-03T16:45:27.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.261+0000 7f0643e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f063c1199f0 con 0x7f063c10fb60 2024-05-03T16:45:27.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.261+0000 7f0643e00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f063c119cf0 con 0x7f063c10a490 2024-05-03T16:45:27.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.261+0000 7f0641400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f063c109ad0 0x7f063c1a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:27.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.261+0000 7f0641400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f063c109ad0 0x7f063c1a0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56716/0 (socket says 172.21.15.81:56716) 2024-05-03T16:45:27.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.261+0000 7f0641400700 1 -- 172.21.15.81:0/1958236458 learned_addr learned my addr 172.21.15.81:0/1958236458 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:45:27.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.261+0000 7f0641e00700 1 --2- 172.21.15.81:0/1958236458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f063c10fb60 0x7f063c1a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:27.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.261+0000 7f0640a00700 1 --2- 172.21.15.81:0/1958236458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f063c10a490 0x7f063c1a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:27.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.262+0000 7f0641400700 1 -- 172.21.15.81:0/1958236458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f063c10a490 msgr2=0x7f063c1a05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:27.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.262+0000 7f0641400700 1 --2- 172.21.15.81:0/1958236458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f063c10a490 0x7f063c1a05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:27.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.262+0000 7f0641400700 1 -- 172.21.15.81:0/1958236458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f063c10fb60 msgr2=0x7f063c1a4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:27.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.262+0000 7f0641400700 1 --2- 172.21.15.81:0/1958236458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f063c10fb60 0x7f063c1a4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:27.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.262+0000 7f0641400700 1 -- 172.21.15.81:0/1958236458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063c1a5090 con 0x7f063c109ad0 2024-05-03T16:45:27.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.262+0000 7f0641e00700 1 --2- 172.21.15.81:0/1958236458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f063c10fb60 0x7f063c1a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:45:27.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.262+0000 7f0641400700 1 --2- 172.21.15.81:0/1958236458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f063c109ad0 0x7f063c1a0080 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0630006010 tx=0x7f063000bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:27.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.262+0000 7f063a000700 1 -- 172.21.15.81:0/1958236458 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0630027070 con 0x7f063c109ad0 2024-05-03T16:45:27.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.262+0000 7f0643e00700 1 -- 172.21.15.81:0/1958236458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f063c1a5320 con 0x7f063c109ad0 2024-05-03T16:45:27.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.262+0000 7f063a000700 1 -- 172.21.15.81:0/1958236458 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0630022470 con 0x7f063c109ad0 2024-05-03T16:45:27.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.262+0000 7f063a000700 1 -- 172.21.15.81:0/1958236458 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0630017650 con 0x7f063c109ad0 2024-05-03T16:45:27.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.263+0000 7f0643e00700 1 -- 172.21.15.81:0/1958236458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f063c1acc00 con 0x7f063c109ad0 2024-05-03T16:45:27.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.264+0000 7f0643e00700 1 -- 172.21.15.81:0/1958236458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f063c112060 con 0x7f063c109ad0 2024-05-03T16:45:27.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.270+0000 7f063a000700 1 -- 172.21.15.81:0/1958236458 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0630009d10 con 0x7f063c109ad0 2024-05-03T16:45:27.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.271+0000 7f063a000700 1 --2- 172.21.15.81:0/1958236458 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f06240b2880 0x7f06240b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:27.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.271+0000 7f063a000700 1 -- 172.21.15.81:0/1958236458 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f06300e35e0 con 0x7f063c109ad0 2024-05-03T16:45:27.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.271+0000 7f0640a00700 1 --2- 172.21.15.81:0/1958236458 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f06240b2880 0x7f06240b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:27.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.272+0000 7f0640a00700 1 --2- 172.21.15.81:0/1958236458 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f06240b2880 0x7f06240b4d40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0628005fd0 tx=0x7f0628005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:27.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.275+0000 7f063a000700 1 -- 172.21.15.81:0/1958236458 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0630013070 con 0x7f063c109ad0 2024-05-03T16:45:27.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.560+0000 7f0643e00700 1 -- 172.21.15.81:0/1958236458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f063c1a13e0 con 0x7f063c109ad0 2024-05-03T16:45:27.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.605+0000 7f063a000700 1 -- 172.21.15.81:0/1958236458 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7f06300aaf80 con 0x7f063c109ad0 2024-05-03T16:45:27.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.609+0000 7f0643e00700 1 -- 172.21.15.81:0/1958236458 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f06240b2880 msgr2=0x7f06240b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:27.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.609+0000 7f0643e00700 1 --2- 172.21.15.81:0/1958236458 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f06240b2880 0x7f06240b4d40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0628005fd0 tx=0x7f0628005f60 comp rx=0 tx=0).stop 2024-05-03T16:45:27.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.609+0000 7f0643e00700 1 -- 172.21.15.81:0/1958236458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f063c109ad0 msgr2=0x7f063c1a0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:27.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.609+0000 7f0643e00700 1 --2- 172.21.15.81:0/1958236458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f063c109ad0 0x7f063c1a0080 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0630006010 tx=0x7f063000bfc0 comp rx=0 tx=0).stop 2024-05-03T16:45:27.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.609+0000 7f0643e00700 1 -- 172.21.15.81:0/1958236458 shutdown_connections 2024-05-03T16:45:27.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.609+0000 7f0643e00700 1 --2- 172.21.15.81:0/1958236458 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f06240b2880 0x7f06240b4d40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:27.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.609+0000 7f0643e00700 1 --2- 172.21.15.81:0/1958236458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f063c10fb60 0x7f063c1a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:27.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.609+0000 7f0643e00700 1 --2- 172.21.15.81:0/1958236458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f063c109ad0 0x7f063c1a0080 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:27.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.609+0000 7f0643e00700 1 --2- 172.21.15.81:0/1958236458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f063c10a490 0x7f063c1a05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:27.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.609+0000 7f0643e00700 1 -- 172.21.15.81:0/1958236458 >> 172.21.15.81:0/1958236458 conn(0x7f063c076c70 msgr2=0x7f063c0772d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:27.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.609+0000 7f0643e00700 1 -- 172.21.15.81:0/1958236458 shutdown_connections 2024-05-03T16:45:27.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:27.609+0000 7f0643e00700 1 -- 172.21.15.81:0/1958236458 wait complete. 2024-05-03T16:45:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:27 smithi134 ceph-mon[31708]: pgmap v422: 129 pgs: 129 active+clean; 584 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 5 op/s 2024-05-03T16:45:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:27 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] up:active 2024-05-03T16:45:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:27 smithi134 ceph-mon[31708]: daemon mds.i assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-03T16:45:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:27 smithi134 ceph-mon[31708]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-03T16:45:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:27 smithi134 ceph-mon[31708]: Cluster is now healthy 2024-05-03T16:45:27.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:27 smithi134 ceph-mon[31708]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:active} 8 up:standby 2024-05-03T16:45:27.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:27 smithi134 ceph-mon[31708]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-03T16:45:27.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:27 smithi134 ceph-mon[31708]: daemon mds.i is now active in filesystem cephfs as rank 4 2024-05-03T16:45:27.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:27 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/1958236458' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-03T16:45:27.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:27 smithi081 ceph-mon[28640]: pgmap v422: 129 pgs: 129 active+clean; 584 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 5 op/s 2024-05-03T16:45:27.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:27 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] up:active 2024-05-03T16:45:27.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:27 smithi081 ceph-mon[28640]: daemon mds.i assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-03T16:45:27.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:27 smithi081 ceph-mon[28640]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-03T16:45:27.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:27 smithi081 ceph-mon[28640]: Cluster is now healthy 2024-05-03T16:45:27.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:27 smithi081 ceph-mon[28640]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:active} 8 up:standby 2024-05-03T16:45:27.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:27 smithi081 ceph-mon[28640]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-03T16:45:27.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:27 smithi081 ceph-mon[28640]: daemon mds.i is now active in filesystem cephfs as rank 4 2024-05-03T16:45:27.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:27 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1958236458' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-03T16:45:28.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:27 smithi146 ceph-mon[32357]: pgmap v422: 129 pgs: 129 active+clean; 584 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 5 op/s 2024-05-03T16:45:28.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:27 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] up:active 2024-05-03T16:45:28.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:27 smithi146 ceph-mon[32357]: daemon mds.i assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-03T16:45:28.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:27 smithi146 ceph-mon[32357]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-03T16:45:28.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:27 smithi146 ceph-mon[32357]: Cluster is now healthy 2024-05-03T16:45:28.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:27 smithi146 ceph-mon[32357]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:active} 8 up:standby 2024-05-03T16:45:28.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:27 smithi146 ceph-mon[32357]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-03T16:45:28.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:27 smithi146 ceph-mon[32357]: daemon mds.i is now active in filesystem cephfs as rank 4 2024-05-03T16:45:28.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:27 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/1958236458' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-03T16:45:28.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-05-03T16:45:28.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:28 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1958236458' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-03T16:45:28.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:28 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] up:active 2024-05-03T16:45:28.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:28 smithi081 ceph-mon[28640]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-03T16:45:28.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:28 smithi081 ceph-mon[28640]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T16:45:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:45:28.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:28 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/1958236458' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-03T16:45:28.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:28 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] up:active 2024-05-03T16:45:28.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:28 smithi134 ceph-mon[31708]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-03T16:45:28.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:28 smithi134 ceph-mon[31708]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T16:45:29.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:28 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/1958236458' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-03T16:45:29.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:28 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] up:active 2024-05-03T16:45:29.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:28 smithi146 ceph-mon[32357]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-03T16:45:29.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:28 smithi146 ceph-mon[32357]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T16:45:29.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:29 smithi081 ceph-mon[28640]: pgmap v423: 129 pgs: 129 active+clean; 585 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 3.0 KiB/s wr, 10 op/s 2024-05-03T16:45:29.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:29 smithi134 ceph-mon[31708]: pgmap v423: 129 pgs: 129 active+clean; 585 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 3.0 KiB/s wr, 10 op/s 2024-05-03T16:45:29.967 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 16:45:29 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-b[62229]: 2024-05-03T16:45:29.679+0000 7f4c9ac00700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-05-03T16:45:29.967 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 16:45:29 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-b[62229]: 2024-05-03T16:45:29.679+0000 7f4c9ac00700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-05-03T16:45:29.967 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 16:45:29 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-b[62229]: 2024-05-03T16:45:29.679+0000 7f4c9ac00700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-05-03T16:45:30.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:29 smithi146 ceph-mon[32357]: pgmap v423: 129 pgs: 129 active+clean; 585 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 3.0 KiB/s wr, 10 op/s 2024-05-03T16:45:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.248+0000 7f0952c00700 1 -- 172.21.15.81:0/125437989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c114670 msgr2=0x7f094c116a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.248+0000 7f0952c00700 1 --2- 172.21.15.81:0/125437989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c114670 0x7f094c116a60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f094400b0a0 tx=0x7f094400b3b0 comp rx=0 tx=0).stop 2024-05-03T16:45:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.249+0000 7f0952c00700 1 -- 172.21.15.81:0/125437989 shutdown_connections 2024-05-03T16:45:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.249+0000 7f0952c00700 1 --2- 172.21.15.81:0/125437989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c114670 0x7f094c116a60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.249+0000 7f0952c00700 1 --2- 172.21.15.81:0/125437989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f094c0756d0 0x7f094c075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.249+0000 7f0952c00700 1 --2- 172.21.15.81:0/125437989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f094c075ff0 0x7f094c114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.249+0000 7f0952c00700 1 -- 172.21.15.81:0/125437989 >> 172.21.15.81:0/125437989 conn(0x7f094c07a600 msgr2=0x7f094c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.249+0000 7f0952c00700 1 -- 172.21.15.81:0/125437989 shutdown_connections 2024-05-03T16:45:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.249+0000 7f0952c00700 1 -- 172.21.15.81:0/125437989 wait complete. 2024-05-03T16:45:31.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.250+0000 7f0952c00700 1 Processor -- start 2024-05-03T16:45:31.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.250+0000 7f0952c00700 1 -- start start 2024-05-03T16:45:31.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.251+0000 7f0952c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c0756d0 0x7f094c19ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:31.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.251+0000 7f0952c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f094c075ff0 0x7f094c1a0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:31.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.251+0000 7f0952c00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f094c114670 0x7f094c1a4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:31.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.251+0000 7f0952c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f094c119af0 con 0x7f094c0756d0 2024-05-03T16:45:31.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.251+0000 7f0952c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f094c119970 con 0x7f094c075ff0 2024-05-03T16:45:31.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.251+0000 7f0952c00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f094c119c70 con 0x7f094c114670 2024-05-03T16:45:31.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.251+0000 7f094be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c0756d0 0x7f094c19ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:31.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.251+0000 7f094be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c0756d0 0x7f094c19ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56734/0 (socket says 172.21.15.81:56734) 2024-05-03T16:45:31.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.252+0000 7f094be00700 1 -- 172.21.15.81:0/2825692110 learned_addr learned my addr 172.21.15.81:0/2825692110 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:45:31.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.252+0000 7f0950c00700 1 --2- 172.21.15.81:0/2825692110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f094c114670 0x7f094c1a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:31.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.252+0000 7f094b400700 1 --2- 172.21.15.81:0/2825692110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f094c075ff0 0x7f094c1a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:31.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.252+0000 7f094be00700 1 -- 172.21.15.81:0/2825692110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f094c114670 msgr2=0x7f094c1a4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:31.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.252+0000 7f094be00700 1 --2- 172.21.15.81:0/2825692110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f094c114670 0x7f094c1a4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:31.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.252+0000 7f094be00700 1 -- 172.21.15.81:0/2825692110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f094c075ff0 msgr2=0x7f094c1a0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:31.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.252+0000 7f094be00700 1 --2- 172.21.15.81:0/2825692110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f094c075ff0 0x7f094c1a0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:31.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.252+0000 7f094be00700 1 -- 172.21.15.81:0/2825692110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094c1a4f50 con 0x7f094c0756d0 2024-05-03T16:45:31.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.252+0000 7f094be00700 1 --2- 172.21.15.81:0/2825692110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c0756d0 0x7f094c19ff40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f093c00c9b0 tx=0x7f093c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:31.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.253+0000 7f0948c00700 1 -- 172.21.15.81:0/2825692110 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c007b00 con 0x7f094c0756d0 2024-05-03T16:45:31.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.253+0000 7f0952c00700 1 -- 172.21.15.81:0/2825692110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f094c1a5240 con 0x7f094c0756d0 2024-05-03T16:45:31.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.253+0000 7f0948c00700 1 -- 172.21.15.81:0/2825692110 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f093c007ca0 con 0x7f094c0756d0 2024-05-03T16:45:31.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.253+0000 7f0952c00700 1 -- 172.21.15.81:0/2825692110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f094c1acac0 con 0x7f094c0756d0 2024-05-03T16:45:31.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.253+0000 7f0948c00700 1 -- 172.21.15.81:0/2825692110 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c004a30 con 0x7f094c0756d0 2024-05-03T16:45:31.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.254+0000 7f0952c00700 1 -- 172.21.15.81:0/2825692110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f094c06a190 con 0x7f094c0756d0 2024-05-03T16:45:31.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.256+0000 7f0948c00700 1 -- 172.21.15.81:0/2825692110 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f093c004c90 con 0x7f094c0756d0 2024-05-03T16:45:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.258+0000 7f0948c00700 1 --2- 172.21.15.81:0/2825692110 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f09300b2880 0x7f09300b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.258+0000 7f0948c00700 1 -- 172.21.15.81:0/2825692110 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f093c0e26b0 con 0x7f094c0756d0 2024-05-03T16:45:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.258+0000 7f094b400700 1 --2- 172.21.15.81:0/2825692110 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f09300b2880 0x7f09300b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:31.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.259+0000 7f094b400700 1 --2- 172.21.15.81:0/2825692110 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f09300b2880 0x7f09300b4d40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0938005fd0 tx=0x7f093800af20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.262+0000 7f0948c00700 1 -- 172.21.15.81:0/2825692110 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f093c014030 con 0x7f094c0756d0 2024-05-03T16:45:31.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.545+0000 7f0952c00700 1 -- 172.21.15.81:0/2825692110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f094c1acd50 con 0x7f094c0756d0 2024-05-03T16:45:31.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.628+0000 7f0948c00700 1 -- 172.21.15.81:0/2825692110 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v29) ==== 115+0+0 (secure 0 0 0) 0x7f093c0a9fc0 con 0x7f094c0756d0 2024-05-03T16:45:31.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.631+0000 7f0952c00700 1 -- 172.21.15.81:0/2825692110 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f09300b2880 msgr2=0x7f09300b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:31.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.631+0000 7f0952c00700 1 --2- 172.21.15.81:0/2825692110 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f09300b2880 0x7f09300b4d40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0938005fd0 tx=0x7f093800af20 comp rx=0 tx=0).stop 2024-05-03T16:45:31.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.631+0000 7f0952c00700 1 -- 172.21.15.81:0/2825692110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c0756d0 msgr2=0x7f094c19ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:31.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.631+0000 7f0952c00700 1 --2- 172.21.15.81:0/2825692110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c0756d0 0x7f094c19ff40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f093c00c9b0 tx=0x7f093c00cd70 comp rx=0 tx=0).stop 2024-05-03T16:45:31.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.632+0000 7f0952c00700 1 -- 172.21.15.81:0/2825692110 shutdown_connections 2024-05-03T16:45:31.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.632+0000 7f0952c00700 1 --2- 172.21.15.81:0/2825692110 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f09300b2880 0x7f09300b4d40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:31.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.632+0000 7f0952c00700 1 --2- 172.21.15.81:0/2825692110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f094c114670 0x7f094c1a4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:31.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.632+0000 7f0952c00700 1 --2- 172.21.15.81:0/2825692110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f094c0756d0 0x7f094c19ff40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:31.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.632+0000 7f0952c00700 1 --2- 172.21.15.81:0/2825692110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f094c075ff0 0x7f094c1a0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:31.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.632+0000 7f0952c00700 1 -- 172.21.15.81:0/2825692110 >> 172.21.15.81:0/2825692110 conn(0x7f094c07a600 msgr2=0x7f094c1133c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:31.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.632+0000 7f0952c00700 1 -- 172.21.15.81:0/2825692110 shutdown_connections 2024-05-03T16:45:31.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:31.632+0000 7f0952c00700 1 -- 172.21.15.81:0/2825692110 wait complete. 2024-05-03T16:45:31.865 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:31 smithi081 ceph-mon[28640]: pgmap v424: 129 pgs: 129 active+clean; 586 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-05-03T16:45:31.865 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:31 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2825692110' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-03T16:45:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:31 smithi134 ceph-mon[31708]: pgmap v424: 129 pgs: 129 active+clean; 586 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-05-03T16:45:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:31 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2825692110' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-03T16:45:32.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:31 smithi146 ceph-mon[32357]: pgmap v424: 129 pgs: 129 active+clean; 586 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-05-03T16:45:32.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:31 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2825692110' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-03T16:45:32.574 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-05-03T16:45:32.574 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-05-03T16:45:32.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:32 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2825692110' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-03T16:45:32.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:32 smithi134 ceph-mon[31708]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T16:45:32.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:32 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2825692110' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-03T16:45:32.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:32 smithi081 ceph-mon[28640]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T16:45:32.998 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:45:33.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:32 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2825692110' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-03T16:45:33.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:32 smithi146 ceph-mon[32357]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T16:45:33.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:33 smithi134 ceph-mon[31708]: pgmap v425: 129 pgs: 129 active+clean; 587 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-05-03T16:45:33.968 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:33 smithi081 ceph-mon[28640]: pgmap v425: 129 pgs: 129 active+clean; 587 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-05-03T16:45:34.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:33 smithi146 ceph-mon[32357]: pgmap v425: 129 pgs: 129 active+clean; 587 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-05-03T16:45:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.246+0000 7fd5a9c00700 1 -- 172.21.15.81:0/3486989718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a410da10 msgr2=0x7fd5a410fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.246+0000 7fd5a9c00700 1 --2- 172.21.15.81:0/3486989718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a410da10 0x7fd5a410fe80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00b0a0 tx=0x7fd59c00b3b0 comp rx=0 tx=0).stop 2024-05-03T16:45:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.247+0000 7fd5a9c00700 1 -- 172.21.15.81:0/3486989718 shutdown_connections 2024-05-03T16:45:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.247+0000 7fd5a9c00700 1 --2- 172.21.15.81:0/3486989718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a410da10 0x7fd5a410fe80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.247+0000 7fd5a9c00700 1 --2- 172.21.15.81:0/3486989718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5a4104630 0x7fd5a4104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.247+0000 7fd5a9c00700 1 --2- 172.21.15.81:0/3486989718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a4104f50 0x7fd5a410d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.247+0000 7fd5a9c00700 1 -- 172.21.15.81:0/3486989718 >> 172.21.15.81:0/3486989718 conn(0x7fd5a40fddc0 msgr2=0x7fd5a41001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.247+0000 7fd5a9c00700 1 -- 172.21.15.81:0/3486989718 shutdown_connections 2024-05-03T16:45:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.247+0000 7fd5a9c00700 1 -- 172.21.15.81:0/3486989718 wait complete. 2024-05-03T16:45:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.248+0000 7fd5a9c00700 1 Processor -- start 2024-05-03T16:45:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.248+0000 7fd5a9c00700 1 -- start start 2024-05-03T16:45:35.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.248+0000 7fd5a9c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a4104630 0x7fd5a419f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.248+0000 7fd5a9c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5a4104f50 0x7fd5a419fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.248+0000 7fd5a9c00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a410da10 0x7fd5a4199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.248+0000 7fd5a9c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a41134e0 con 0x7fd5a4104630 2024-05-03T16:45:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.248+0000 7fd5a9c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a4113360 con 0x7fd5a4104f50 2024-05-03T16:45:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.248+0000 7fd5a9c00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a4113660 con 0x7fd5a410da10 2024-05-03T16:45:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.249+0000 7fd5a3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a4104630 0x7fd5a419f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.249+0000 7fd5a3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a4104630 0x7fd5a419f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56748/0 (socket says 172.21.15.81:56748) 2024-05-03T16:45:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.249+0000 7fd5a3e00700 1 -- 172.21.15.81:0/2203486202 learned_addr learned my addr 172.21.15.81:0/2203486202 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:45:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.249+0000 7fd5a9200700 1 --2- 172.21.15.81:0/2203486202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a410da10 0x7fd5a4199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.249+0000 7fd5a3400700 1 --2- 172.21.15.81:0/2203486202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5a4104f50 0x7fd5a419fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.249+0000 7fd5a3e00700 1 -- 172.21.15.81:0/2203486202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a410da10 msgr2=0x7fd5a4199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.249+0000 7fd5a3e00700 1 --2- 172.21.15.81:0/2203486202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a410da10 0x7fd5a4199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.249+0000 7fd5a3e00700 1 -- 172.21.15.81:0/2203486202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5a4104f50 msgr2=0x7fd5a419fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.249+0000 7fd5a3e00700 1 --2- 172.21.15.81:0/2203486202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5a4104f50 0x7fd5a419fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.249+0000 7fd5a3e00700 1 -- 172.21.15.81:0/2203486202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a4199fe0 con 0x7fd5a4104630 2024-05-03T16:45:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.250+0000 7fd5a3e00700 1 --2- 172.21.15.81:0/2203486202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a4104630 0x7fd5a419f680 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd59400d950 tx=0x7fd59400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.250+0000 7fd5a0c00700 1 -- 172.21.15.81:0/2203486202 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd594016070 con 0x7fd5a4104630 2024-05-03T16:45:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.250+0000 7fd5a0c00700 1 -- 172.21.15.81:0/2203486202 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd594010460 con 0x7fd5a4104630 2024-05-03T16:45:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.250+0000 7fd5a0c00700 1 -- 172.21.15.81:0/2203486202 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59400f620 con 0x7fd5a4104630 2024-05-03T16:45:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.251+0000 7fd5a9c00700 1 -- 172.21.15.81:0/2203486202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a419a2d0 con 0x7fd5a4104630 2024-05-03T16:45:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.251+0000 7fd5a9c00700 1 -- 172.21.15.81:0/2203486202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a41a64e0 con 0x7fd5a4104630 2024-05-03T16:45:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.252+0000 7fd5a9c00700 1 -- 172.21.15.81:0/2203486202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5a406b9c0 con 0x7fd5a4104630 2024-05-03T16:45:35.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.254+0000 7fd5a0c00700 1 -- 172.21.15.81:0/2203486202 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd594019070 con 0x7fd5a4104630 2024-05-03T16:45:35.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.256+0000 7fd5a0c00700 1 --2- 172.21.15.81:0/2203486202 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd5880b2880 0x7fd5880b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:35.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.256+0000 7fd5a0c00700 1 -- 172.21.15.81:0/2203486202 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fd5940e20b0 con 0x7fd5a4104630 2024-05-03T16:45:35.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.256+0000 7fd5a3400700 1 --2- 172.21.15.81:0/2203486202 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd5880b2880 0x7fd5880b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:35.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.257+0000 7fd5a3400700 1 --2- 172.21.15.81:0/2203486202 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd5880b2880 0x7fd5880b4d40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4110100 tx=0x7fd59000b590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:35.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.260+0000 7fd5a0c00700 1 -- 172.21.15.81:0/2203486202 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd594020070 con 0x7fd5a4104630 2024-05-03T16:45:35.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.522+0000 7fd5a9c00700 1 -- 172.21.15.81:0/2203486202 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fd5a40638e0 con 0x7fd5880b2880 2024-05-03T16:45:35.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.590+0000 7fd5a0c00700 1 -- 172.21.15.81:0/2203486202 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd5a40638e0 con 0x7fd5880b2880 2024-05-03T16:45:35.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.593+0000 7fd5a9c00700 1 -- 172.21.15.81:0/2203486202 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd5880b2880 msgr2=0x7fd5880b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:35.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.593+0000 7fd5a9c00700 1 --2- 172.21.15.81:0/2203486202 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd5880b2880 0x7fd5880b4d40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4110100 tx=0x7fd59000b590 comp rx=0 tx=0).stop 2024-05-03T16:45:35.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.593+0000 7fd5a9c00700 1 -- 172.21.15.81:0/2203486202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a4104630 msgr2=0x7fd5a419f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:35.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.593+0000 7fd5a9c00700 1 --2- 172.21.15.81:0/2203486202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a4104630 0x7fd5a419f680 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd59400d950 tx=0x7fd59400dd10 comp rx=0 tx=0).stop 2024-05-03T16:45:35.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.593+0000 7fd5a9c00700 1 -- 172.21.15.81:0/2203486202 shutdown_connections 2024-05-03T16:45:35.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.593+0000 7fd5a9c00700 1 --2- 172.21.15.81:0/2203486202 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd5880b2880 0x7fd5880b4d40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:35.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.593+0000 7fd5a9c00700 1 --2- 172.21.15.81:0/2203486202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a410da10 0x7fd5a4199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:35.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.593+0000 7fd5a9c00700 1 --2- 172.21.15.81:0/2203486202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a4104630 0x7fd5a419f680 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:35.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.593+0000 7fd5a9c00700 1 --2- 172.21.15.81:0/2203486202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5a4104f50 0x7fd5a419fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:35.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.593+0000 7fd5a9c00700 1 -- 172.21.15.81:0/2203486202 >> 172.21.15.81:0/2203486202 conn(0x7fd5a40fddc0 msgr2=0x7fd5a40fea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:35.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.594+0000 7fd5a9c00700 1 -- 172.21.15.81:0/2203486202 shutdown_connections 2024-05-03T16:45:35.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:35.594+0000 7fd5a9c00700 1 -- 172.21.15.81:0/2203486202 wait complete. 2024-05-03T16:45:35.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:35 smithi134 ceph-mon[31708]: pgmap v426: 129 pgs: 129 active+clean; 587 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-03T16:45:35.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:35 smithi081 ceph-mon[28640]: pgmap v426: 129 pgs: 129 active+clean; 587 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-03T16:45:35.991 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:45:35 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:45:35.534+0000 7f8e4a000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-03T16:45:35.991 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:45:35 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:45:35.534+0000 7f8e4a000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-03T16:45:35.991 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:45:35 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:45:35.534+0000 7f8e4a000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-03T16:45:35.991 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:45:35 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:45:35.534+0000 7f8e4a000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-03T16:45:35.991 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 16:45:35 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T16:45:35.534+0000 7f8e4a000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-03T16:45:36.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:35 smithi146 ceph-mon[32357]: pgmap v426: 129 pgs: 129 active+clean; 587 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-03T16:45:36.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-03T16:45:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:45:36.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:36 smithi134 ceph-mon[31708]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:45:36.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:36 smithi081 ceph-mon[28640]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:45:37.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:36 smithi146 ceph-mon[32357]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:45:37.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:37 smithi134 ceph-mon[31708]: pgmap v427: 129 pgs: 129 active+clean; 593 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 KiB/s wr, 23 op/s 2024-05-03T16:45:37.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:37 smithi134 ceph-mon[31708]: mgrmap e17: x(active, since 11m), standbys: z, y 2024-05-03T16:45:37.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:37 smithi081 ceph-mon[28640]: pgmap v427: 129 pgs: 129 active+clean; 593 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 KiB/s wr, 23 op/s 2024-05-03T16:45:37.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:37 smithi081 ceph-mon[28640]: mgrmap e17: x(active, since 11m), standbys: z, y 2024-05-03T16:45:38.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:37 smithi146 ceph-mon[32357]: pgmap v427: 129 pgs: 129 active+clean; 593 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 KiB/s wr, 23 op/s 2024-05-03T16:45:38.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:37 smithi146 ceph-mon[32357]: mgrmap e17: x(active, since 11m), standbys: z, y 2024-05-03T16:45:39.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.206+0000 7ff9bc400700 1 -- 172.21.15.81:0/3567337532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b4103750 msgr2=0x7ff9b4103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.206+0000 7ff9bc400700 1 --2- 172.21.15.81:0/3567337532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b4103750 0x7ff9b4103b30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80099c0 tx=0x7ff9a8009cd0 comp rx=0 tx=0).stop 2024-05-03T16:45:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.206+0000 7ff9bc400700 1 -- 172.21.15.81:0/3567337532 shutdown_connections 2024-05-03T16:45:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.206+0000 7ff9bc400700 1 --2- 172.21.15.81:0/3567337532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9b4108850 0x7ff9b41103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.206+0000 7ff9bc400700 1 --2- 172.21.15.81:0/3567337532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b4103750 0x7ff9b4103b30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.206+0000 7ff9bc400700 1 --2- 172.21.15.81:0/3567337532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9b4104100 0x7ff9b4108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.206+0000 7ff9bc400700 1 -- 172.21.15.81:0/3567337532 >> 172.21.15.81:0/3567337532 conn(0x7ff9b407a600 msgr2=0x7ff9b407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.206+0000 7ff9bc400700 1 -- 172.21.15.81:0/3567337532 shutdown_connections 2024-05-03T16:45:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.206+0000 7ff9bc400700 1 -- 172.21.15.81:0/3567337532 wait complete. 2024-05-03T16:45:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.207+0000 7ff9bc400700 1 Processor -- start 2024-05-03T16:45:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.207+0000 7ff9bc400700 1 -- start start 2024-05-03T16:45:39.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.208+0000 7ff9bc400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b4103750 0x7ff9b40757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:39.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.208+0000 7ff9bc400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9b4104100 0x7ff9b4075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:39.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.208+0000 7ff9bc400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9b4108850 0x7ff9b4076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:39.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.208+0000 7ff9bc400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b41134d0 con 0x7ff9b4103750 2024-05-03T16:45:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.208+0000 7ff9bc400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b4113350 con 0x7ff9b4104100 2024-05-03T16:45:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.208+0000 7ff9bc400700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b4113650 con 0x7ff9b4108850 2024-05-03T16:45:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.208+0000 7ff9b9a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b4103750 0x7ff9b40757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.208+0000 7ff9b9a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b4103750 0x7ff9b40757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35054/0 (socket says 172.21.15.81:35054) 2024-05-03T16:45:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.208+0000 7ff9b9a00700 1 -- 172.21.15.81:0/4248750633 learned_addr learned my addr 172.21.15.81:0/4248750633 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:45:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.208+0000 7ff9ba400700 1 --2- 172.21.15.81:0/4248750633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9b4108850 0x7ff9b4076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.208+0000 7ff9b9000700 1 --2- 172.21.15.81:0/4248750633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9b4104100 0x7ff9b4075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.209+0000 7ff9b9a00700 1 -- 172.21.15.81:0/4248750633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9b4108850 msgr2=0x7ff9b4076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.209+0000 7ff9b9a00700 1 --2- 172.21.15.81:0/4248750633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9b4108850 0x7ff9b4076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.209+0000 7ff9b9a00700 1 -- 172.21.15.81:0/4248750633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9b4104100 msgr2=0x7ff9b4075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.209+0000 7ff9b9a00700 1 --2- 172.21.15.81:0/4248750633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9b4104100 0x7ff9b4075ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.209+0000 7ff9b9a00700 1 -- 172.21.15.81:0/4248750633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b41a7ed0 con 0x7ff9b4103750 2024-05-03T16:45:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.209+0000 7ff9ba400700 1 --2- 172.21.15.81:0/4248750633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9b4108850 0x7ff9b4076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:45:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.209+0000 7ff9b9a00700 1 --2- 172.21.15.81:0/4248750633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b4103750 0x7ff9b40757a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800f690 tx=0x7ff9a800f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.209+0000 7ff9b2000700 1 -- 172.21.15.81:0/4248750633 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8027070 con 0x7ff9b4103750 2024-05-03T16:45:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.209+0000 7ff9b2000700 1 -- 172.21.15.81:0/4248750633 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9a80056d0 con 0x7ff9b4103750 2024-05-03T16:45:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.209+0000 7ff9b2000700 1 -- 172.21.15.81:0/4248750633 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80173f0 con 0x7ff9b4103750 2024-05-03T16:45:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.209+0000 7ff9bc400700 1 -- 172.21.15.81:0/4248750633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b41a8160 con 0x7ff9b4103750 2024-05-03T16:45:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.209+0000 7ff9bc400700 1 -- 172.21.15.81:0/4248750633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b41a8610 con 0x7ff9b4103750 2024-05-03T16:45:39.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.211+0000 7ff9bc400700 1 -- 172.21.15.81:0/4248750633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b410ba90 con 0x7ff9b4103750 2024-05-03T16:45:39.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.213+0000 7ff9b2000700 1 -- 172.21.15.81:0/4248750633 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff9a802a070 con 0x7ff9b4103750 2024-05-03T16:45:39.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.214+0000 7ff9b2000700 1 --2- 172.21.15.81:0/4248750633 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff99c0b2990 0x7ff99c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:39.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.214+0000 7ff9b2000700 1 -- 172.21.15.81:0/4248750633 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7ff9a80e3360 con 0x7ff9b4103750 2024-05-03T16:45:39.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.214+0000 7ff9b9000700 1 --2- 172.21.15.81:0/4248750633 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff99c0b2990 0x7ff99c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:39.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.215+0000 7ff9b9000700 1 --2- 172.21.15.81:0/4248750633 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff99c0b2990 0x7ff99c0b4e50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4103030 tx=0x7ff9a0005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:39.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.219+0000 7ff9b2000700 1 -- 172.21.15.81:0/4248750633 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff9a8013070 con 0x7ff9b4103750 2024-05-03T16:45:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.485+0000 7ff9bc400700 1 -- 172.21.15.81:0/4248750633 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff9b40638e0 con 0x7ff99c0b2990 2024-05-03T16:45:39.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.560+0000 7ff9b2000700 1 -- 172.21.15.81:0/4248750633 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff9b40638e0 con 0x7ff99c0b2990 2024-05-03T16:45:39.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.564+0000 7ff9bc400700 1 -- 172.21.15.81:0/4248750633 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff99c0b2990 msgr2=0x7ff99c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:39.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.564+0000 7ff9bc400700 1 --2- 172.21.15.81:0/4248750633 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff99c0b2990 0x7ff99c0b4e50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4103030 tx=0x7ff9a0005d50 comp rx=0 tx=0).stop 2024-05-03T16:45:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.564+0000 7ff9bc400700 1 -- 172.21.15.81:0/4248750633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b4103750 msgr2=0x7ff9b40757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.564+0000 7ff9bc400700 1 --2- 172.21.15.81:0/4248750633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b4103750 0x7ff9b40757a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800f690 tx=0x7ff9a800f770 comp rx=0 tx=0).stop 2024-05-03T16:45:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.564+0000 7ff9bc400700 1 -- 172.21.15.81:0/4248750633 shutdown_connections 2024-05-03T16:45:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.564+0000 7ff9bc400700 1 --2- 172.21.15.81:0/4248750633 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff99c0b2990 0x7ff99c0b4e50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.564+0000 7ff9bc400700 1 --2- 172.21.15.81:0/4248750633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9b4108850 0x7ff9b4076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.564+0000 7ff9bc400700 1 --2- 172.21.15.81:0/4248750633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b4103750 0x7ff9b40757a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.564+0000 7ff9bc400700 1 --2- 172.21.15.81:0/4248750633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9b4104100 0x7ff9b4075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.564+0000 7ff9bc400700 1 -- 172.21.15.81:0/4248750633 >> 172.21.15.81:0/4248750633 conn(0x7ff9b407a600 msgr2=0x7ff9b41016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.564+0000 7ff9bc400700 1 -- 172.21.15.81:0/4248750633 shutdown_connections 2024-05-03T16:45:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:39.564+0000 7ff9bc400700 1 -- 172.21.15.81:0/4248750633 wait complete. 2024-05-03T16:45:39.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:39 smithi081 ceph-mon[28640]: pgmap v428: 129 pgs: 129 active+clean; 593 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.2 KiB/s wr, 18 op/s 2024-05-03T16:45:39.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:39 smithi134 ceph-mon[31708]: pgmap v428: 129 pgs: 129 active+clean; 593 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.2 KiB/s wr, 18 op/s 2024-05-03T16:45:40.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:39 smithi146 ceph-mon[32357]: pgmap v428: 129 pgs: 129 active+clean; 593 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.2 KiB/s wr, 18 op/s 2024-05-03T16:45:40.440 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-03T16:45:40.873 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:45:40.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:40 smithi134 ceph-mon[31708]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:45:40.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:40 smithi081 ceph-mon[28640]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:45:41.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:40 smithi146 ceph-mon[32357]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:45:41.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:41 smithi134 ceph-mon[31708]: pgmap v429: 129 pgs: 129 active+clean; 593 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.0 KiB/s wr, 15 op/s 2024-05-03T16:45:41.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:41 smithi081 ceph-mon[28640]: pgmap v429: 129 pgs: 129 active+clean; 593 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.0 KiB/s wr, 15 op/s 2024-05-03T16:45:42.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:41 smithi146 ceph-mon[32357]: pgmap v429: 129 pgs: 129 active+clean; 593 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.0 KiB/s wr, 15 op/s 2024-05-03T16:45:43.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.111+0000 7f5cd8000700 1 -- 172.21.15.81:0/2916800256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cd01056c0 msgr2=0x7f5cd0105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:43.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.111+0000 7f5cd8000700 1 --2- 172.21.15.81:0/2916800256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cd01056c0 0x7f5cd0105b40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc009990 tx=0x7f5cbc009ca0 comp rx=0 tx=0).stop 2024-05-03T16:45:43.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.111+0000 7f5cd8000700 1 -- 172.21.15.81:0/2916800256 shutdown_connections 2024-05-03T16:45:43.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.111+0000 7f5cd8000700 1 --2- 172.21.15.81:0/2916800256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cd010b6c0 0x7f5cd010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:43.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.111+0000 7f5cd8000700 1 --2- 172.21.15.81:0/2916800256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cd0106080 0x7f5cd0112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:43.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.111+0000 7f5cd8000700 1 --2- 172.21.15.81:0/2916800256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cd01056c0 0x7f5cd0105b40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:43.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.111+0000 7f5cd8000700 1 -- 172.21.15.81:0/2916800256 >> 172.21.15.81:0/2916800256 conn(0x7f5cd01011b0 msgr2=0x7f5cd01035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:43.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.111+0000 7f5cd8000700 1 -- 172.21.15.81:0/2916800256 shutdown_connections 2024-05-03T16:45:43.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.111+0000 7f5cd8000700 1 -- 172.21.15.81:0/2916800256 wait complete. 2024-05-03T16:45:43.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.112+0000 7f5cd8000700 1 Processor -- start 2024-05-03T16:45:43.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.112+0000 7f5cd8000700 1 -- start start 2024-05-03T16:45:43.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.113+0000 7f5cd8000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cd01056c0 0x7f5cd019bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:43.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.113+0000 7f5cd8000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cd0106080 0x7f5cd019c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:43.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.113+0000 7f5cd8000700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cd010b6c0 0x7f5cd01a0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:43.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.113+0000 7f5cd8000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd0115760 con 0x7f5cd0106080 2024-05-03T16:45:43.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.113+0000 7f5cd8000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd01155e0 con 0x7f5cd01056c0 2024-05-03T16:45:43.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.113+0000 7f5cd8000700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd01158e0 con 0x7f5cd010b6c0 2024-05-03T16:45:43.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.113+0000 7f5cd4c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cd0106080 0x7f5cd019c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:43.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.113+0000 7f5cd4c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cd0106080 0x7f5cd019c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35072/0 (socket says 172.21.15.81:35072) 2024-05-03T16:45:43.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.113+0000 7f5cd4c00700 1 -- 172.21.15.81:0/4132184055 learned_addr learned my addr 172.21.15.81:0/4132184055 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:45:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.114+0000 7f5cd6000700 1 --2- 172.21.15.81:0/4132184055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cd010b6c0 0x7f5cd01a0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.114+0000 7f5cd5600700 1 --2- 172.21.15.81:0/4132184055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cd01056c0 0x7f5cd019bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.114+0000 7f5cd4c00700 1 -- 172.21.15.81:0/4132184055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cd010b6c0 msgr2=0x7f5cd01a0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.114+0000 7f5cd4c00700 1 --2- 172.21.15.81:0/4132184055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cd010b6c0 0x7f5cd01a0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.114+0000 7f5cd4c00700 1 -- 172.21.15.81:0/4132184055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cd01056c0 msgr2=0x7f5cd019bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.114+0000 7f5cd4c00700 1 --2- 172.21.15.81:0/4132184055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cd01056c0 0x7f5cd019bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.114+0000 7f5cd4c00700 1 -- 172.21.15.81:0/4132184055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd01a0c10 con 0x7f5cd0106080 2024-05-03T16:45:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.114+0000 7f5cd6000700 1 --2- 172.21.15.81:0/4132184055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cd010b6c0 0x7f5cd01a0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:45:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.114+0000 7f5cd5600700 1 --2- 172.21.15.81:0/4132184055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cd01056c0 0x7f5cd019bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:45:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.114+0000 7f5cd4c00700 1 --2- 172.21.15.81:0/4132184055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cd0106080 0x7f5cd019c150 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc0057a0 tx=0x7f5cbc0036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.114+0000 7f5cce000700 1 -- 172.21.15.81:0/4132184055 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc027070 con 0x7f5cd0106080 2024-05-03T16:45:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.114+0000 7f5cce000700 1 -- 172.21.15.81:0/4132184055 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cbc00fc80 con 0x7f5cd0106080 2024-05-03T16:45:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.114+0000 7f5cd8000700 1 -- 172.21.15.81:0/4132184055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cd01a0ea0 con 0x7f5cd0106080 2024-05-03T16:45:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.114+0000 7f5cce000700 1 -- 172.21.15.81:0/4132184055 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc022d60 con 0x7f5cd0106080 2024-05-03T16:45:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.114+0000 7f5cd8000700 1 -- 172.21.15.81:0/4132184055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cd01a87c0 con 0x7f5cd0106080 2024-05-03T16:45:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.116+0000 7f5cd8000700 1 -- 172.21.15.81:0/4132184055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cd006a190 con 0x7f5cd0106080 2024-05-03T16:45:43.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.118+0000 7f5cce000700 1 -- 172.21.15.81:0/4132184055 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5cbc02a070 con 0x7f5cd0106080 2024-05-03T16:45:43.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.120+0000 7f5cce000700 1 --2- 172.21.15.81:0/4132184055 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5cb80b2910 0x7f5cb80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:43.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.120+0000 7f5cce000700 1 -- 172.21.15.81:0/4132184055 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f5cbc0e34d0 con 0x7f5cd0106080 2024-05-03T16:45:43.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.120+0000 7f5cd5600700 1 --2- 172.21.15.81:0/4132184055 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5cb80b2910 0x7f5cb80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:43.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.121+0000 7f5cd5600700 1 --2- 172.21.15.81:0/4132184055 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5cb80b2910 0x7f5cb80b4dd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5cc400baa0 tx=0x7f5cc4005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:43.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.124+0000 7f5cce000700 1 -- 172.21.15.81:0/4132184055 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f5cbc013070 con 0x7f5cd0106080 2024-05-03T16:45:43.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.399+0000 7f5cd8000700 1 -- 172.21.15.81:0/4132184055 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f5cd019cf70 con 0x7f5cb80b2910 2024-05-03T16:45:43.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.413+0000 7f5cce000700 1 -- 172.21.15.81:0/4132184055 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f5cd019cf70 con 0x7f5cb80b2910 2024-05-03T16:45:43.414 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/qa/sv_0/3d1cfc25-1840-433b-9b1c-49134d271492 2024-05-03T16:45:43.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.415+0000 7f5cd8000700 1 -- 172.21.15.81:0/4132184055 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5cb80b2910 msgr2=0x7f5cb80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:43.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.415+0000 7f5cd8000700 1 --2- 172.21.15.81:0/4132184055 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5cb80b2910 0x7f5cb80b4dd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5cc400baa0 tx=0x7f5cc4005db0 comp rx=0 tx=0).stop 2024-05-03T16:45:43.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.416+0000 7f5cd8000700 1 -- 172.21.15.81:0/4132184055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cd0106080 msgr2=0x7f5cd019c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.416+0000 7f5cd8000700 1 --2- 172.21.15.81:0/4132184055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cd0106080 0x7f5cd019c150 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc0057a0 tx=0x7f5cbc0036f0 comp rx=0 tx=0).stop 2024-05-03T16:45:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.416+0000 7f5cd8000700 1 -- 172.21.15.81:0/4132184055 shutdown_connections 2024-05-03T16:45:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.416+0000 7f5cd8000700 1 --2- 172.21.15.81:0/4132184055 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5cb80b2910 0x7f5cb80b4dd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.416+0000 7f5cd8000700 1 --2- 172.21.15.81:0/4132184055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cd010b6c0 0x7f5cd01a0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.416+0000 7f5cd8000700 1 --2- 172.21.15.81:0/4132184055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cd01056c0 0x7f5cd019bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.416+0000 7f5cd8000700 1 --2- 172.21.15.81:0/4132184055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cd0106080 0x7f5cd019c150 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.416+0000 7f5cd8000700 1 -- 172.21.15.81:0/4132184055 >> 172.21.15.81:0/4132184055 conn(0x7f5cd01011b0 msgr2=0x7f5cd01016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.416+0000 7f5cd8000700 1 -- 172.21.15.81:0/4132184055 shutdown_connections 2024-05-03T16:45:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:43.416+0000 7f5cd8000700 1 -- 172.21.15.81:0/4132184055 wait complete. 2024-05-03T16:45:43.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:43 smithi134 ceph-mon[31708]: pgmap v430: 129 pgs: 129 active+clean; 607 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.4 KiB/s wr, 13 op/s 2024-05-03T16:45:43.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:43 smithi081 ceph-mon[28640]: pgmap v430: 129 pgs: 129 active+clean; 607 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.4 KiB/s wr, 13 op/s 2024-05-03T16:45:44.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:43 smithi146 ceph-mon[32357]: pgmap v430: 129 pgs: 129 active+clean; 607 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.4 KiB/s wr, 13 op/s 2024-05-03T16:45:44.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-03T16:45:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:45:44.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:44 smithi081 ceph-mon[28640]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:45:45.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:44 smithi146 ceph-mon[32357]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:45:45.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:44 smithi134 ceph-mon[31708]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:45:45.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:45 smithi081 ceph-mon[28640]: pgmap v431: 129 pgs: 129 active+clean; 607 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-05-03T16:45:46.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:45 smithi146 ceph-mon[32357]: pgmap v431: 129 pgs: 129 active+clean; 607 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-05-03T16:45:46.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:45 smithi134 ceph-mon[31708]: pgmap v431: 129 pgs: 129 active+clean; 607 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-05-03T16:45:47.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.021+0000 7ff821400700 1 -- 172.21.15.81:0/3450165433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c06bb70 msgr2=0x7ff81c06bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:47.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.021+0000 7ff821400700 1 --2- 172.21.15.81:0/3450165433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c06bb70 0x7ff81c06bff0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff808009990 tx=0x7ff808009ca0 comp rx=0 tx=0).stop 2024-05-03T16:45:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.021+0000 7ff821400700 1 -- 172.21.15.81:0/3450165433 shutdown_connections 2024-05-03T16:45:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.021+0000 7ff821400700 1 --2- 172.21.15.81:0/3450165433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff81c109530 0x7ff81c109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.021+0000 7ff821400700 1 --2- 172.21.15.81:0/3450165433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff81c06c530 0x7ff81c110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.021+0000 7ff821400700 1 --2- 172.21.15.81:0/3450165433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c06bb70 0x7ff81c06bff0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.021+0000 7ff821400700 1 -- 172.21.15.81:0/3450165433 >> 172.21.15.81:0/3450165433 conn(0x7ff81c079350 msgr2=0x7ff81c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.021+0000 7ff821400700 1 -- 172.21.15.81:0/3450165433 shutdown_connections 2024-05-03T16:45:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.021+0000 7ff821400700 1 -- 172.21.15.81:0/3450165433 wait complete. 2024-05-03T16:45:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.022+0000 7ff821400700 1 Processor -- start 2024-05-03T16:45:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.023+0000 7ff821400700 1 -- start start 2024-05-03T16:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.023+0000 7ff821400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c06bb70 0x7ff81c1a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.023+0000 7ff821400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff81c06c530 0x7ff81c1a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.023+0000 7ff821400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff81c109530 0x7ff81c19bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.023+0000 7ff821400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c113560 con 0x7ff81c06bb70 2024-05-03T16:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.023+0000 7ff821400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c1133e0 con 0x7ff81c109530 2024-05-03T16:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.023+0000 7ff821400700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c1136e0 con 0x7ff81c06c530 2024-05-03T16:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.023+0000 7ff81a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c06bb70 0x7ff81c1a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.023+0000 7ff81a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c06bb70 0x7ff81c1a1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59176/0 (socket says 172.21.15.81:59176) 2024-05-03T16:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.023+0000 7ff81a800700 1 -- 172.21.15.81:0/679620127 learned_addr learned my addr 172.21.15.81:0/679620127 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.024+0000 7ff819e00700 1 --2- 172.21.15.81:0/679620127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff81c06c530 0x7ff81c1a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.024+0000 7ff81b200700 1 --2- 172.21.15.81:0/679620127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff81c109530 0x7ff81c19bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.024+0000 7ff81a800700 1 -- 172.21.15.81:0/679620127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff81c06c530 msgr2=0x7ff81c1a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.024+0000 7ff81a800700 1 --2- 172.21.15.81:0/679620127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff81c06c530 0x7ff81c1a1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.024+0000 7ff81a800700 1 -- 172.21.15.81:0/679620127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff81c109530 msgr2=0x7ff81c19bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.024+0000 7ff81a800700 1 --2- 172.21.15.81:0/679620127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff81c109530 0x7ff81c19bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.024+0000 7ff81a800700 1 -- 172.21.15.81:0/679620127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81c19c240 con 0x7ff81c06bb70 2024-05-03T16:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.024+0000 7ff81a800700 1 --2- 172.21.15.81:0/679620127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c06bb70 0x7ff81c1a1920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff80c00d980 tx=0x7ff80c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.025+0000 7ff813400700 1 -- 172.21.15.81:0/679620127 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80c017070 con 0x7ff81c06bb70 2024-05-03T16:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.025+0000 7ff813400700 1 -- 172.21.15.81:0/679620127 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff80c004830 con 0x7ff81c06bb70 2024-05-03T16:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.025+0000 7ff813400700 1 -- 172.21.15.81:0/679620127 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80c0053a0 con 0x7ff81c06bb70 2024-05-03T16:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.025+0000 7ff821400700 1 -- 172.21.15.81:0/679620127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff81c19c530 con 0x7ff81c06bb70 2024-05-03T16:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.025+0000 7ff821400700 1 -- 172.21.15.81:0/679620127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff81c1a87f0 con 0x7ff81c06bb70 2024-05-03T16:45:47.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.026+0000 7ff821400700 1 -- 172.21.15.81:0/679620127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff81c104bf0 con 0x7ff81c06bb70 2024-05-03T16:45:47.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.028+0000 7ff813400700 1 -- 172.21.15.81:0/679620127 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff80c0049e0 con 0x7ff81c06bb70 2024-05-03T16:45:47.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.030+0000 7ff813400700 1 --2- 172.21.15.81:0/679620127 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff8000b2990 0x7ff8000b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.030+0000 7ff813400700 1 -- 172.21.15.81:0/679620127 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7ff80c0e2670 con 0x7ff81c06bb70 2024-05-03T16:45:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.030+0000 7ff819e00700 1 --2- 172.21.15.81:0/679620127 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff8000b2990 0x7ff8000b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.031+0000 7ff819e00700 1 --2- 172.21.15.81:0/679620127 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff8000b2990 0x7ff8000b4e50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff80800b5c0 tx=0x7ff80801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:47.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.034+0000 7ff813400700 1 -- 172.21.15.81:0/679620127 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff80c020020 con 0x7ff81c06bb70 2024-05-03T16:45:47.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.306+0000 7ff821400700 1 -- 172.21.15.81:0/679620127 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff81c1019b0 con 0x7ff8000b2990 2024-05-03T16:45:47.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.373+0000 7ff813400700 1 -- 172.21.15.81:0/679620127 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff81c1019b0 con 0x7ff8000b2990 2024-05-03T16:45:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.376+0000 7ff821400700 1 -- 172.21.15.81:0/679620127 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff8000b2990 msgr2=0x7ff8000b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.376+0000 7ff821400700 1 --2- 172.21.15.81:0/679620127 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff8000b2990 0x7ff8000b4e50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff80800b5c0 tx=0x7ff80801a040 comp rx=0 tx=0).stop 2024-05-03T16:45:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.376+0000 7ff821400700 1 -- 172.21.15.81:0/679620127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c06bb70 msgr2=0x7ff81c1a1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.376+0000 7ff821400700 1 --2- 172.21.15.81:0/679620127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c06bb70 0x7ff81c1a1920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff80c00d980 tx=0x7ff80c00dd40 comp rx=0 tx=0).stop 2024-05-03T16:45:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.376+0000 7ff821400700 1 -- 172.21.15.81:0/679620127 shutdown_connections 2024-05-03T16:45:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.376+0000 7ff821400700 1 --2- 172.21.15.81:0/679620127 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff8000b2990 0x7ff8000b4e50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:47.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.376+0000 7ff821400700 1 --2- 172.21.15.81:0/679620127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff81c109530 0x7ff81c19bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:47.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.376+0000 7ff821400700 1 --2- 172.21.15.81:0/679620127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c06bb70 0x7ff81c1a1920 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:47.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.376+0000 7ff821400700 1 --2- 172.21.15.81:0/679620127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff81c06c530 0x7ff81c1a1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:47.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.376+0000 7ff821400700 1 -- 172.21.15.81:0/679620127 >> 172.21.15.81:0/679620127 conn(0x7ff81c079350 msgr2=0x7ff81c1012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:47.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.377+0000 7ff821400700 1 -- 172.21.15.81:0/679620127 shutdown_connections 2024-05-03T16:45:47.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:47.377+0000 7ff821400700 1 -- 172.21.15.81:0/679620127 wait complete. 2024-05-03T16:45:47.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:47 smithi081 ceph-mon[28640]: pgmap v432: 129 pgs: 129 active+clean; 613 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2024-05-03T16:45:48.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:47 smithi146 ceph-mon[32357]: pgmap v432: 129 pgs: 129 active+clean; 613 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2024-05-03T16:45:48.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:47 smithi134 ceph-mon[31708]: pgmap v432: 129 pgs: 129 active+clean; 613 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2024-05-03T16:45:48.355 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-03T16:45:48.802 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:45:48.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:48 smithi081 ceph-mon[28640]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:45:49.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:48 smithi146 ceph-mon[32357]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:45:49.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:48 smithi134 ceph-mon[31708]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:45:50.000 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:49 smithi081 ceph-mon[28640]: pgmap v433: 129 pgs: 129 active+clean; 613 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-05-03T16:45:50.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:49 smithi146 ceph-mon[32357]: pgmap v433: 129 pgs: 129 active+clean; 613 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-05-03T16:45:50.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:49 smithi134 ceph-mon[31708]: pgmap v433: 129 pgs: 129 active+clean; 613 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-05-03T16:45:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.153+0000 7fb370e00700 1 -- 172.21.15.81:0/4209648270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb36c0756d0 msgr2=0x7fb36c075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:51.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.153+0000 7fb370e00700 1 --2- 172.21.15.81:0/4209648270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb36c0756d0 0x7fb36c075ab0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb35c00b0a0 tx=0x7fb35c00b3b0 comp rx=0 tx=0).stop 2024-05-03T16:45:51.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.153+0000 7fb370e00700 1 -- 172.21.15.81:0/4209648270 shutdown_connections 2024-05-03T16:45:51.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.153+0000 7fb370e00700 1 --2- 172.21.15.81:0/4209648270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb36c114670 0x7fb36c116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:51.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.153+0000 7fb370e00700 1 --2- 172.21.15.81:0/4209648270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb36c0756d0 0x7fb36c075ab0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:51.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.153+0000 7fb370e00700 1 --2- 172.21.15.81:0/4209648270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb36c075ff0 0x7fb36c114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:51.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.153+0000 7fb370e00700 1 -- 172.21.15.81:0/4209648270 >> 172.21.15.81:0/4209648270 conn(0x7fb36c07a600 msgr2=0x7fb36c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:51.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.153+0000 7fb370e00700 1 -- 172.21.15.81:0/4209648270 shutdown_connections 2024-05-03T16:45:51.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.153+0000 7fb370e00700 1 -- 172.21.15.81:0/4209648270 wait complete. 2024-05-03T16:45:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.154+0000 7fb370e00700 1 Processor -- start 2024-05-03T16:45:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.154+0000 7fb370e00700 1 -- start start 2024-05-03T16:45:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.155+0000 7fb370e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb36c0756d0 0x7fb36c1a0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.155+0000 7fb370e00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb36c075ff0 0x7fb36c1a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.155+0000 7fb370e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb36c114670 0x7fb36c1a4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.155+0000 7fb370e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb36c119b20 con 0x7fb36c0756d0 2024-05-03T16:45:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.155+0000 7fb370e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb36c1199a0 con 0x7fb36c114670 2024-05-03T16:45:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.155+0000 7fb370e00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb36c119ca0 con 0x7fb36c075ff0 2024-05-03T16:45:51.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.155+0000 7fb369e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb36c0756d0 0x7fb36c1a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:51.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.155+0000 7fb369e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb36c0756d0 0x7fb36c1a0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59196/0 (socket says 172.21.15.81:59196) 2024-05-03T16:45:51.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.155+0000 7fb369e00700 1 -- 172.21.15.81:0/722137883 learned_addr learned my addr 172.21.15.81:0/722137883 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:45:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.155+0000 7fb369e00700 1 -- 172.21.15.81:0/722137883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb36c075ff0 msgr2=0x7fb36c1a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.155+0000 7fb369e00700 1 --2- 172.21.15.81:0/722137883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb36c075ff0 0x7fb36c1a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.155+0000 7fb369e00700 1 -- 172.21.15.81:0/722137883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb36c114670 msgr2=0x7fb36c1a4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.155+0000 7fb369e00700 1 --2- 172.21.15.81:0/722137883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb36c114670 0x7fb36c1a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.155+0000 7fb369e00700 1 -- 172.21.15.81:0/722137883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb36c1a5060 con 0x7fb36c0756d0 2024-05-03T16:45:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.156+0000 7fb369e00700 1 --2- 172.21.15.81:0/722137883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb36c0756d0 0x7fb36c1a0050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0062a0 tx=0x7fb35c004e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.156+0000 7fb363400700 1 -- 172.21.15.81:0/722137883 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35c021070 con 0x7fb36c0756d0 2024-05-03T16:45:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.156+0000 7fb370e00700 1 -- 172.21.15.81:0/722137883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb36c1a52f0 con 0x7fb36c0756d0 2024-05-03T16:45:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.156+0000 7fb363400700 1 -- 172.21.15.81:0/722137883 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb35c007c80 con 0x7fb36c0756d0 2024-05-03T16:45:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.156+0000 7fb363400700 1 -- 172.21.15.81:0/722137883 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35c0052a0 con 0x7fb36c0756d0 2024-05-03T16:45:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.156+0000 7fb370e00700 1 -- 172.21.15.81:0/722137883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb36c1acbd0 con 0x7fb36c0756d0 2024-05-03T16:45:51.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.158+0000 7fb370e00700 1 -- 172.21.15.81:0/722137883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb36c06a190 con 0x7fb36c0756d0 2024-05-03T16:45:51.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.160+0000 7fb363400700 1 -- 172.21.15.81:0/722137883 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb35c024070 con 0x7fb36c0756d0 2024-05-03T16:45:51.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.161+0000 7fb363400700 1 --2- 172.21.15.81:0/722137883 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb3500b2990 0x7fb3500b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:51.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.162+0000 7fb363400700 1 -- 172.21.15.81:0/722137883 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fb35c00f020 con 0x7fb36c0756d0 2024-05-03T16:45:51.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.162+0000 7fb361400700 1 --2- 172.21.15.81:0/722137883 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb3500b2990 0x7fb3500b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:51.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.162+0000 7fb361400700 1 --2- 172.21.15.81:0/722137883 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb3500b2990 0x7fb3500b4e50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb354005950 tx=0x7fb3540058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:51.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.166+0000 7fb363400700 1 -- 172.21.15.81:0/722137883 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb35c02b020 con 0x7fb36c0756d0 2024-05-03T16:45:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.448+0000 7fb370e00700 1 -- 172.21.15.81:0/722137883 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fb36c110820 con 0x7fb3500b2990 2024-05-03T16:45:51.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.460+0000 7fb363400700 1 -- 172.21.15.81:0/722137883 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fb36c110820 con 0x7fb3500b2990 2024-05-03T16:45:51.462 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/qa/sv_1/3a2e58b8-1b4d-4246-9496-5348649f5674 2024-05-03T16:45:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.463+0000 7fb370e00700 1 -- 172.21.15.81:0/722137883 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb3500b2990 msgr2=0x7fb3500b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.463+0000 7fb370e00700 1 --2- 172.21.15.81:0/722137883 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb3500b2990 0x7fb3500b4e50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb354005950 tx=0x7fb3540058e0 comp rx=0 tx=0).stop 2024-05-03T16:45:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.463+0000 7fb370e00700 1 -- 172.21.15.81:0/722137883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb36c0756d0 msgr2=0x7fb36c1a0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.463+0000 7fb370e00700 1 --2- 172.21.15.81:0/722137883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb36c0756d0 0x7fb36c1a0050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0062a0 tx=0x7fb35c004e80 comp rx=0 tx=0).stop 2024-05-03T16:45:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.463+0000 7fb370e00700 1 -- 172.21.15.81:0/722137883 shutdown_connections 2024-05-03T16:45:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.463+0000 7fb370e00700 1 --2- 172.21.15.81:0/722137883 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb3500b2990 0x7fb3500b4e50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.463+0000 7fb370e00700 1 --2- 172.21.15.81:0/722137883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb36c114670 0x7fb36c1a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.463+0000 7fb370e00700 1 --2- 172.21.15.81:0/722137883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb36c0756d0 0x7fb36c1a0050 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.463+0000 7fb370e00700 1 --2- 172.21.15.81:0/722137883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb36c075ff0 0x7fb36c1a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.463+0000 7fb370e00700 1 -- 172.21.15.81:0/722137883 >> 172.21.15.81:0/722137883 conn(0x7fb36c07a600 msgr2=0x7fb36c110110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.463+0000 7fb370e00700 1 -- 172.21.15.81:0/722137883 shutdown_connections 2024-05-03T16:45:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:51.463+0000 7fb370e00700 1 -- 172.21.15.81:0/722137883 wait complete. 2024-05-03T16:45:52.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:51 smithi146 ceph-mon[32357]: pgmap v434: 129 pgs: 129 active+clean; 613 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-05-03T16:45:52.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:51 smithi134 ceph-mon[31708]: pgmap v434: 129 pgs: 129 active+clean; 613 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-05-03T16:45:52.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:51 smithi081 ceph-mon[28640]: pgmap v434: 129 pgs: 129 active+clean; 613 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-05-03T16:45:52.551 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T16:45:52.996 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:45:53.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:52 smithi146 ceph-mon[32357]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:45:53.146 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:52 smithi081 ceph-mon[28640]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:45:53.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:52 smithi134 ceph-mon[31708]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:45:53.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:53 smithi081 ceph-mon[28640]: pgmap v435: 129 pgs: 129 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-05-03T16:45:54.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:53 smithi146 ceph-mon[32357]: pgmap v435: 129 pgs: 129 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-05-03T16:45:54.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:53 smithi134 ceph-mon[31708]: pgmap v435: 129 pgs: 129 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-05-03T16:45:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.438+0000 7f64e0a00700 1 -- 172.21.15.81:0/2414697396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc0756d0 msgr2=0x7f64dc075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.438+0000 7f64e0a00700 1 --2- 172.21.15.81:0/2414697396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc0756d0 0x7f64dc075ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f64cc00b0a0 tx=0x7f64cc00b3b0 comp rx=0 tx=0).stop 2024-05-03T16:45:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.438+0000 7f64e0a00700 1 -- 172.21.15.81:0/2414697396 shutdown_connections 2024-05-03T16:45:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.438+0000 7f64e0a00700 1 --2- 172.21.15.81:0/2414697396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64dc114670 0x7f64dc116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.438+0000 7f64e0a00700 1 --2- 172.21.15.81:0/2414697396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc0756d0 0x7f64dc075ab0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.438+0000 7f64e0a00700 1 --2- 172.21.15.81:0/2414697396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64dc075ff0 0x7f64dc114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.438+0000 7f64e0a00700 1 -- 172.21.15.81:0/2414697396 >> 172.21.15.81:0/2414697396 conn(0x7f64dc07a600 msgr2=0x7f64dc07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.439+0000 7f64e0a00700 1 -- 172.21.15.81:0/2414697396 shutdown_connections 2024-05-03T16:45:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.439+0000 7f64e0a00700 1 -- 172.21.15.81:0/2414697396 wait complete. 2024-05-03T16:45:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.440+0000 7f64e0a00700 1 Processor -- start 2024-05-03T16:45:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.440+0000 7f64e0a00700 1 -- start start 2024-05-03T16:45:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.440+0000 7f64e0a00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64dc0756d0 0x7f64dc19ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.440+0000 7f64e0a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64dc075ff0 0x7f64dc1a0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.440+0000 7f64e0a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc114670 0x7f64dc1a48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.440+0000 7f64e0a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f64dc119b10 con 0x7f64dc114670 2024-05-03T16:45:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.440+0000 7f64e0a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f64dc119990 con 0x7f64dc075ff0 2024-05-03T16:45:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.440+0000 7f64e0a00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f64dc119c90 con 0x7f64dc0756d0 2024-05-03T16:45:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.441+0000 7f64da800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc114670 0x7f64dc1a48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.441+0000 7f64da800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc114670 0x7f64dc1a48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59212/0 (socket says 172.21.15.81:59212) 2024-05-03T16:45:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.441+0000 7f64da800700 1 -- 172.21.15.81:0/2999770730 learned_addr learned my addr 172.21.15.81:0/2999770730 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:45:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.441+0000 7f64d9e00700 1 --2- 172.21.15.81:0/2999770730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64dc0756d0 0x7f64dc19ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.441+0000 7f64d1400700 1 --2- 172.21.15.81:0/2999770730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64dc075ff0 0x7f64dc1a0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.441+0000 7f64da800700 1 -- 172.21.15.81:0/2999770730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64dc0756d0 msgr2=0x7f64dc19ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.441+0000 7f64da800700 1 --2- 172.21.15.81:0/2999770730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64dc0756d0 0x7f64dc19ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.441+0000 7f64da800700 1 -- 172.21.15.81:0/2999770730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64dc075ff0 msgr2=0x7f64dc1a0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.441+0000 7f64da800700 1 --2- 172.21.15.81:0/2999770730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64dc075ff0 0x7f64dc1a0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.441+0000 7f64da800700 1 -- 172.21.15.81:0/2999770730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64dc1a4ff0 con 0x7f64dc114670 2024-05-03T16:45:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.441+0000 7f64d9e00700 1 --2- 172.21.15.81:0/2999770730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64dc0756d0 0x7f64dc19ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:45:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.441+0000 7f64da800700 1 --2- 172.21.15.81:0/2999770730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc114670 0x7f64dc1a48b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f64d400c970 tx=0x7f64d400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.442+0000 7f64d3400700 1 -- 172.21.15.81:0/2999770730 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d4007b00 con 0x7f64dc114670 2024-05-03T16:45:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.442+0000 7f64e0a00700 1 -- 172.21.15.81:0/2999770730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64dc1a52e0 con 0x7f64dc114670 2024-05-03T16:45:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.442+0000 7f64d3400700 1 -- 172.21.15.81:0/2999770730 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f64d400ce50 con 0x7f64dc114670 2024-05-03T16:45:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.442+0000 7f64d3400700 1 -- 172.21.15.81:0/2999770730 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d4005430 con 0x7f64dc114670 2024-05-03T16:45:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.442+0000 7f64e0a00700 1 -- 172.21.15.81:0/2999770730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64dc1acb60 con 0x7f64dc114670 2024-05-03T16:45:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.443+0000 7f64e0a00700 1 -- 172.21.15.81:0/2999770730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64dc06a190 con 0x7f64dc114670 2024-05-03T16:45:55.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.445+0000 7f64d3400700 1 -- 172.21.15.81:0/2999770730 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f64d4004750 con 0x7f64dc114670 2024-05-03T16:45:55.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.447+0000 7f64d3400700 1 --2- 172.21.15.81:0/2999770730 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f64c00b2990 0x7f64c00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:55.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.447+0000 7f64d3400700 1 -- 172.21.15.81:0/2999770730 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f64d40e2690 con 0x7f64dc114670 2024-05-03T16:45:55.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.447+0000 7f64d9e00700 1 --2- 172.21.15.81:0/2999770730 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f64c00b2990 0x7f64c00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:55.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.448+0000 7f64d9e00700 1 --2- 172.21.15.81:0/2999770730 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f64c00b2990 0x7f64c00b4e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f64cc00b830 tx=0x7f64cc006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:55.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.449+0000 7f64d3400700 1 -- 172.21.15.81:0/2999770730 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f64d4014030 con 0x7f64dc114670 2024-05-03T16:45:55.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.732+0000 7f64e0a00700 1 -- 172.21.15.81:0/2999770730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64dc1a1340 con 0x7f64dc114670 2024-05-03T16:45:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.734+0000 7f64d3400700 1 -- 172.21.15.81:0/2999770730 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f64dc1a1340 con 0x7f64dc114670 2024-05-03T16:45:55.735 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:45:55.736 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/886382058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":886382058},{"type":"v1","addr":"172.21.15.81:6835","nonce":886382058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3285208793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3285208793},{"type":"v1","addr":"172.21.15.81:6837","nonce":3285208793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T16:43:58.734681+0000","modified":"2024-05-03T16:45:31.547191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34466,"mds_1":34439,"mds_2":34418,"mds_3":34400,"mds_4":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3710454674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3710454674},{"type":"v1","addr":"172.21.15.81:6839","nonce":3710454674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1174252889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1174252889},{"type":"v1","addr":"172.21.15.81:6841","nonce":1174252889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1900581381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1900581381},{"type":"v1","addr":"172.21.15.146:6833","nonce":1900581381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/3514751933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3514751933},{"type":"v1","addr":"172.21.15.146:6835","nonce":3514751933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6837/971814714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":971814714},{"type":"v1","addr":"172.21.15.146:6837","nonce":971814714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":32,"addr":"172.21.15.146:6839/3770312555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":3770312555},{"type":"v1","addr":"172.21.15.146:6839","nonce":3770312555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34400":{"gid":34400,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.134:6833/749392804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":749392804},{"type":"v1","addr":"172.21.15.134:6833","nonce":749392804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34418":{"gid":34418,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.134:6835/3681203129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3681203129},{"type":"v1","addr":"172.21.15.134:6835","nonce":3681203129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34439":{"gid":34439,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.134:6837/2915415754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2915415754},{"type":"v1","addr":"172.21.15.134:6837","nonce":2915415754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34466":{"gid":34466,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2061491127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2061491127},{"type":"v1","addr":"172.21.15.134:6839","nonce":2061491127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34466,"qdb_cluster":[24481,34400,34466,34439,34418]},"id":1}]} 2024-05-03T16:45:55.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.737+0000 7f64e0a00700 1 -- 172.21.15.81:0/2999770730 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f64c00b2990 msgr2=0x7f64c00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.737+0000 7f64e0a00700 1 --2- 172.21.15.81:0/2999770730 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f64c00b2990 0x7f64c00b4e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f64cc00b830 tx=0x7f64cc006210 comp rx=0 tx=0).stop 2024-05-03T16:45:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.737+0000 7f64e0a00700 1 -- 172.21.15.81:0/2999770730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc114670 msgr2=0x7f64dc1a48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.737+0000 7f64e0a00700 1 --2- 172.21.15.81:0/2999770730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc114670 0x7f64dc1a48b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f64d400c970 tx=0x7f64d400cd30 comp rx=0 tx=0).stop 2024-05-03T16:45:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.737+0000 7f64e0a00700 1 -- 172.21.15.81:0/2999770730 shutdown_connections 2024-05-03T16:45:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.737+0000 7f64e0a00700 1 --2- 172.21.15.81:0/2999770730 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f64c00b2990 0x7f64c00b4e50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.737+0000 7f64e0a00700 1 --2- 172.21.15.81:0/2999770730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64dc0756d0 0x7f64dc19ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.737+0000 7f64e0a00700 1 --2- 172.21.15.81:0/2999770730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc114670 0x7f64dc1a48b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.737+0000 7f64e0a00700 1 --2- 172.21.15.81:0/2999770730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64dc075ff0 0x7f64dc1a0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.737+0000 7f64e0a00700 1 -- 172.21.15.81:0/2999770730 >> 172.21.15.81:0/2999770730 conn(0x7f64dc07a600 msgr2=0x7f64dc113580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.737+0000 7f64e0a00700 1 -- 172.21.15.81:0/2999770730 shutdown_connections 2024-05-03T16:45:55.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:55.737+0000 7f64e0a00700 1 -- 172.21.15.81:0/2999770730 wait complete. 2024-05-03T16:45:55.740 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 29 2024-05-03T16:45:55.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:55 smithi081 ceph-mon[28640]: pgmap v436: 129 pgs: 129 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-05-03T16:45:55.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:55 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2999770730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:45:56.020 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:55 smithi134 ceph-mon[31708]: pgmap v436: 129 pgs: 129 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-05-03T16:45:56.020 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:55 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2999770730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:45:56.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:55 smithi146 ceph-mon[32357]: pgmap v436: 129 pgs: 129 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-05-03T16:45:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:55 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2999770730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:45:56.589 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T16:45:57.034 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:45:57.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:57 smithi081 ceph-mon[28640]: pgmap v437: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-05-03T16:45:58.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:57 smithi146 ceph-mon[32357]: pgmap v437: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-05-03T16:45:58.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:57 smithi134 ceph-mon[31708]: pgmap v437: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-05-03T16:45:59.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:58 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:45:59.158 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:58 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:45:59.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:58 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:45:59.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.323+0000 7f92d4600700 1 -- 172.21.15.81:0/3048092607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc06bb40 msgr2=0x7f92cc110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:59.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.323+0000 7f92d4600700 1 --2- 172.21.15.81:0/3048092607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc06bb40 0x7f92cc110330 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f92c4009990 tx=0x7f92c4009ca0 comp rx=0 tx=0).stop 2024-05-03T16:45:59.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.323+0000 7f92d4600700 1 -- 172.21.15.81:0/3048092607 shutdown_connections 2024-05-03T16:45:59.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.323+0000 7f92d4600700 1 --2- 172.21.15.81:0/3048092607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92cc109510 0x7f92cc1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:59.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.323+0000 7f92d4600700 1 --2- 172.21.15.81:0/3048092607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc06bb40 0x7f92cc110330 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:59.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.323+0000 7f92d4600700 1 --2- 172.21.15.81:0/3048092607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92cc06b180 0x7f92cc06b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:59.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.323+0000 7f92d4600700 1 -- 172.21.15.81:0/3048092607 >> 172.21.15.81:0/3048092607 conn(0x7f92cc079350 msgr2=0x7f92cc079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:59.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.323+0000 7f92d4600700 1 -- 172.21.15.81:0/3048092607 shutdown_connections 2024-05-03T16:45:59.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.323+0000 7f92d4600700 1 -- 172.21.15.81:0/3048092607 wait complete. 2024-05-03T16:45:59.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.324+0000 7f92d4600700 1 Processor -- start 2024-05-03T16:45:59.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.324+0000 7f92d4600700 1 -- start start 2024-05-03T16:45:59.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.325+0000 7f92d4600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92cc06b180 0x7f92cc10a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:59.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.325+0000 7f92d4600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92cc06bb40 0x7f92cc10a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:59.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.325+0000 7f92d4600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc109510 0x7f92cc10adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:59.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.325+0000 7f92d4600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc113540 con 0x7f92cc109510 2024-05-03T16:45:59.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.325+0000 7f92d4600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc1133c0 con 0x7f92cc06bb40 2024-05-03T16:45:59.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.325+0000 7f92d4600700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc1136c0 con 0x7f92cc06b180 2024-05-03T16:45:59.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.325+0000 7f92d2600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc109510 0x7f92cc10adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:59.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.325+0000 7f92d2600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc109510 0x7f92cc10adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40594/0 (socket says 172.21.15.81:40594) 2024-05-03T16:45:59.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.325+0000 7f92d2600700 1 -- 172.21.15.81:0/698511860 learned_addr learned my addr 172.21.15.81:0/698511860 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:45:59.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.325+0000 7f92d1c00700 1 --2- 172.21.15.81:0/698511860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92cc06b180 0x7f92cc10a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:59.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.325+0000 7f92d1200700 1 --2- 172.21.15.81:0/698511860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92cc06bb40 0x7f92cc10a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:59.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.326+0000 7f92d2600700 1 -- 172.21.15.81:0/698511860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92cc06b180 msgr2=0x7f92cc10a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:59.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.326+0000 7f92d2600700 1 --2- 172.21.15.81:0/698511860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92cc06b180 0x7f92cc10a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:59.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.326+0000 7f92d2600700 1 -- 172.21.15.81:0/698511860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92cc06bb40 msgr2=0x7f92cc10a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:59.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.326+0000 7f92d2600700 1 --2- 172.21.15.81:0/698511860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92cc06bb40 0x7f92cc10a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:59.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.326+0000 7f92d2600700 1 -- 172.21.15.81:0/698511860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92cc1ac2c0 con 0x7f92cc109510 2024-05-03T16:45:59.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.326+0000 7f92d2600700 1 --2- 172.21.15.81:0/698511860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc109510 0x7f92cc10adc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f92c4005b40 tx=0x7f92c4009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:59.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.326+0000 7f92ca000700 1 -- 172.21.15.81:0/698511860 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c4027070 con 0x7f92cc109510 2024-05-03T16:45:59.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.326+0000 7f92ca000700 1 -- 172.21.15.81:0/698511860 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f92c400fc00 con 0x7f92cc109510 2024-05-03T16:45:59.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.326+0000 7f92d4600700 1 -- 172.21.15.81:0/698511860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92cc1ac550 con 0x7f92cc109510 2024-05-03T16:45:59.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.326+0000 7f92ca000700 1 -- 172.21.15.81:0/698511860 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c4022cd0 con 0x7f92cc109510 2024-05-03T16:45:59.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.326+0000 7f92d4600700 1 -- 172.21.15.81:0/698511860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92cc1ac9a0 con 0x7f92cc109510 2024-05-03T16:45:59.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.328+0000 7f92d4600700 1 -- 172.21.15.81:0/698511860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92cc104bd0 con 0x7f92cc109510 2024-05-03T16:45:59.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.332+0000 7f92ca000700 1 -- 172.21.15.81:0/698511860 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f92c402a070 con 0x7f92cc109510 2024-05-03T16:45:59.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.333+0000 7f92ca000700 1 --2- 172.21.15.81:0/698511860 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f92b40b2990 0x7f92b40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:45:59.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.333+0000 7f92ca000700 1 -- 172.21.15.81:0/698511860 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f92c40e3940 con 0x7f92cc109510 2024-05-03T16:45:59.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.333+0000 7f92d1c00700 1 --2- 172.21.15.81:0/698511860 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f92b40b2990 0x7f92b40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:45:59.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.334+0000 7f92ca000700 1 -- 172.21.15.81:0/698511860 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f92c4031080 con 0x7f92cc109510 2024-05-03T16:45:59.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.334+0000 7f92d1c00700 1 --2- 172.21.15.81:0/698511860 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f92b40b2990 0x7f92b40b4e50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f92c00076e0 tx=0x7f92c0007670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:45:59.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.591+0000 7f92d4600700 1 -- 172.21.15.81:0/698511860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92cc1acd90 con 0x7f92cc109510 2024-05-03T16:45:59.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.593+0000 7f92ca000700 1 -- 172.21.15.81:0/698511860 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24767 (secure 0 0 0) 0x7f92c4013070 con 0x7f92cc109510 2024-05-03T16:45:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:45:59.595 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":91,"fsid":"8988869e-096a-11ef-bc97-c7b262605968","created":"2024-05-03T16:32:56.440204+0000","modified":"2024-05-03T16:45:06.079032+0000","last_up_change":"2024-05-03T16:42:31.768974+0000","last_in_change":"2024-05-03T16:42:06.989688+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T16:37:18.271939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T16:43:50.469793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T16:43:54.708564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T16:44:09.064474+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"957b05dc-dfb9-4561-8800-b7ec0aba679d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6803","nonce":1639968055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6805","nonce":1639968055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6809","nonce":1639968055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6807","nonce":1639968055}]},"public_addr":"172.21.15.81:6803/1639968055","cluster_addr":"172.21.15.81:6805/1639968055","heartbeat_back_addr":"172.21.15.81:6809/1639968055","heartbeat_front_addr":"172.21.15.81:6807/1639968055","state":["exists","up"]},{"osd":1,"uuid":"3bb199cd-b4d0-4c67-b98f-2106336dd57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6801","nonce":1928503491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6803","nonce":1928503491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6807","nonce":1928503491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6805","nonce":1928503491}]},"public_addr":"172.21.15.134:6801/1928503491","cluster_addr":"172.21.15.134:6803/1928503491","heartbeat_back_addr":"172.21.15.134:6807/1928503491","heartbeat_front_addr":"172.21.15.134:6805/1928503491","state":["exists","up"]},{"osd":2,"uuid":"79ec9995-50e8-4eaf-935a-39a479925734","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6801","nonce":1233108455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6803","nonce":1233108455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6807","nonce":1233108455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6805","nonce":1233108455}]},"public_addr":"172.21.15.146:6801/1233108455","cluster_addr":"172.21.15.146:6803/1233108455","heartbeat_back_addr":"172.21.15.146:6807/1233108455","heartbeat_front_addr":"172.21.15.146:6805/1233108455","state":["exists","up"]},{"osd":3,"uuid":"2d38f4e7-73c3-4e70-9f87-d44da28db452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6811","nonce":4128709465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6813","nonce":4128709465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6817","nonce":4128709465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6815","nonce":4128709465}]},"public_addr":"172.21.15.81:6811/4128709465","cluster_addr":"172.21.15.81:6813/4128709465","heartbeat_back_addr":"172.21.15.81:6817/4128709465","heartbeat_front_addr":"172.21.15.81:6815/4128709465","state":["exists","up"]},{"osd":4,"uuid":"3837a136-a25b-4cb9-aa82-084b477c67d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6809","nonce":1498616220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6811","nonce":1498616220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6815","nonce":1498616220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6813","nonce":1498616220}]},"public_addr":"172.21.15.134:6809/1498616220","cluster_addr":"172.21.15.134:6811/1498616220","heartbeat_back_addr":"172.21.15.134:6815/1498616220","heartbeat_front_addr":"172.21.15.134:6813/1498616220","state":["exists","up"]},{"osd":5,"uuid":"2e783d2e-c181-41a9-97de-f17705a201bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6809","nonce":1276988922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6811","nonce":1276988922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6815","nonce":1276988922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6813","nonce":1276988922}]},"public_addr":"172.21.15.146:6809/1276988922","cluster_addr":"172.21.15.146:6811/1276988922","heartbeat_back_addr":"172.21.15.146:6815/1276988922","heartbeat_front_addr":"172.21.15.146:6813/1276988922","state":["exists","up"]},{"osd":6,"uuid":"6faebdbf-7820-42e5-b07c-15db11f278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6819","nonce":3319125020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6821","nonce":3319125020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6825","nonce":3319125020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6823","nonce":3319125020}]},"public_addr":"172.21.15.81:6819/3319125020","cluster_addr":"172.21.15.81:6821/3319125020","heartbeat_back_addr":"172.21.15.81:6825/3319125020","heartbeat_front_addr":"172.21.15.81:6823/3319125020","state":["exists","up"]},{"osd":7,"uuid":"ec4b6b84-6c5f-4d07-a747-06610b2cd345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6817","nonce":3241993481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6819","nonce":3241993481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6823","nonce":3241993481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6821","nonce":3241993481}]},"public_addr":"172.21.15.134:6817/3241993481","cluster_addr":"172.21.15.134:6819/3241993481","heartbeat_back_addr":"172.21.15.134:6823/3241993481","heartbeat_front_addr":"172.21.15.134:6821/3241993481","state":["exists","up"]},{"osd":8,"uuid":"02b1b0fd-837c-4c29-bedb-54fa2ee7531d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6817","nonce":2423161684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6819","nonce":2423161684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6823","nonce":2423161684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6821","nonce":2423161684}]},"public_addr":"172.21.15.146:6817/2423161684","cluster_addr":"172.21.15.146:6819/2423161684","heartbeat_back_addr":"172.21.15.146:6823/2423161684","heartbeat_front_addr":"172.21.15.146:6821/2423161684","state":["exists","up"]},{"osd":9,"uuid":"46713a8e-743d-44d5-babe-c01d3179afcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6827","nonce":873909886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6829","nonce":873909886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6833","nonce":873909886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6831","nonce":873909886}]},"public_addr":"172.21.15.81:6827/873909886","cluster_addr":"172.21.15.81:6829/873909886","heartbeat_back_addr":"172.21.15.81:6833/873909886","heartbeat_front_addr":"172.21.15.81:6831/873909886","state":["exists","up"]},{"osd":10,"uuid":"12fcae89-30af-436b-a513-3998303da93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6825","nonce":1183629038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6827","nonce":1183629038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6831","nonce":1183629038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6829","nonce":1183629038}]},"public_addr":"172.21.15.134:6825/1183629038","cluster_addr":"172.21.15.134:6827/1183629038","heartbeat_back_addr":"172.21.15.134:6831/1183629038","heartbeat_front_addr":"172.21.15.134:6829/1183629038","state":["exists","up"]},{"osd":11,"uuid":"a543f42c-61da-4a93-b16b-a2891a4ef873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6825","nonce":2627233639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6827","nonce":2627233639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6831","nonce":2627233639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6829","nonce":2627233639}]},"public_addr":"172.21.15.146:6825/2627233639","cluster_addr":"172.21.15.146:6827/2627233639","heartbeat_back_addr":"172.21.15.146:6831/2627233639","heartbeat_front_addr":"172.21.15.146:6829/2627233639","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:08.411954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:41.459869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:15.068172+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:49.711273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:23.231811+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:57.917964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:39:32.982397+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:07.434610+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:43.606108+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:19.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:54.917284+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:42:30.525217+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6801/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/2237510960":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6801/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/3199433706":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1689714816":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/2777950369":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/1982866220":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1112375028":"2024-05-04T16:33:30.274051+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T16:45:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.597+0000 7f92d4600700 1 -- 172.21.15.81:0/698511860 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f92b40b2990 msgr2=0x7f92b40b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.597+0000 7f92d4600700 1 --2- 172.21.15.81:0/698511860 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f92b40b2990 0x7f92b40b4e50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f92c00076e0 tx=0x7f92c0007670 comp rx=0 tx=0).stop 2024-05-03T16:45:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.597+0000 7f92d4600700 1 -- 172.21.15.81:0/698511860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc109510 msgr2=0x7f92cc10adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:45:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.597+0000 7f92d4600700 1 --2- 172.21.15.81:0/698511860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc109510 0x7f92cc10adc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f92c4005b40 tx=0x7f92c4009ee0 comp rx=0 tx=0).stop 2024-05-03T16:45:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.597+0000 7f92d4600700 1 -- 172.21.15.81:0/698511860 shutdown_connections 2024-05-03T16:45:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.597+0000 7f92d4600700 1 --2- 172.21.15.81:0/698511860 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f92b40b2990 0x7f92b40b4e50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.597+0000 7f92d4600700 1 --2- 172.21.15.81:0/698511860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92cc06b180 0x7f92cc10a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.597+0000 7f92d4600700 1 --2- 172.21.15.81:0/698511860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc109510 0x7f92cc10adc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.597+0000 7f92d4600700 1 --2- 172.21.15.81:0/698511860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92cc06bb40 0x7f92cc10a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:45:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.597+0000 7f92d4600700 1 -- 172.21.15.81:0/698511860 >> 172.21.15.81:0/698511860 conn(0x7f92cc079350 msgr2=0x7f92cc10e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:45:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.597+0000 7f92d4600700 1 -- 172.21.15.81:0/698511860 shutdown_connections 2024-05-03T16:45:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:45:59.597+0000 7f92d4600700 1 -- 172.21.15.81:0/698511860 wait complete. 2024-05-03T16:45:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:59 smithi081 ceph-mon[28640]: pgmap v438: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-03T16:45:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:45:59 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/698511860' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:46:00.040 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:59 smithi134 ceph-mon[31708]: pgmap v438: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-03T16:46:00.040 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:45:59 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/698511860' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:46:00.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:59 smithi146 ceph-mon[32357]: pgmap v438: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-03T16:46:00.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:45:59 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/698511860' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:46:00.624 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-03T16:46:00.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-03T16:46:01.415 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:01.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:01 smithi081 ceph-mon[28640]: pgmap v439: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-05-03T16:46:01.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:01 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:01.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:01 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:01.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:01 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:01.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:01 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:02.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:01 smithi146 ceph-mon[32357]: pgmap v439: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-05-03T16:46:02.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:01 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:02.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:01 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:02.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:01 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:02.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:01 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:01 smithi134 ceph-mon[31708]: pgmap v439: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-05-03T16:46:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:01 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:01 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:01 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:01 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:03.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.742+0000 7fccae400700 1 -- 172.21.15.81:0/318992692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcca806bad0 msgr2=0x7fcca810fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:03.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.742+0000 7fccae400700 1 --2- 172.21.15.81:0/318992692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcca806bad0 0x7fcca810fa10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000b0a0 tx=0x7fcc9000b3b0 comp rx=0 tx=0).stop 2024-05-03T16:46:03.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.742+0000 7fccae400700 1 -- 172.21.15.81:0/318992692 shutdown_connections 2024-05-03T16:46:03.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.742+0000 7fccae400700 1 --2- 172.21.15.81:0/318992692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcca810ff50 0x7fcca8112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:03.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.742+0000 7fccae400700 1 --2- 172.21.15.81:0/318992692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcca806b1b0 0x7fcca806b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:03.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.742+0000 7fccae400700 1 --2- 172.21.15.81:0/318992692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcca806bad0 0x7fcca810fa10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:03.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.742+0000 7fccae400700 1 -- 172.21.15.81:0/318992692 >> 172.21.15.81:0/318992692 conn(0x7fcca8079350 msgr2=0x7fcca8079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:03.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.743+0000 7fccae400700 1 -- 172.21.15.81:0/318992692 shutdown_connections 2024-05-03T16:46:03.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.743+0000 7fccae400700 1 -- 172.21.15.81:0/318992692 wait complete. 2024-05-03T16:46:03.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.744+0000 7fccae400700 1 Processor -- start 2024-05-03T16:46:03.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.744+0000 7fccae400700 1 -- start start 2024-05-03T16:46:03.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.744+0000 7fccae400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcca806b1b0 0x7fcca819bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:03.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.744+0000 7fccae400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcca806bad0 0x7fcca819c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:03.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.744+0000 7fccae400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcca810ff50 0x7fcca81a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:03.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.744+0000 7fccae400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcca8115790 con 0x7fcca806bad0 2024-05-03T16:46:03.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.744+0000 7fccae400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcca8115610 con 0x7fcca810ff50 2024-05-03T16:46:03.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.744+0000 7fccae400700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcca8115910 con 0x7fcca806b1b0 2024-05-03T16:46:03.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.745+0000 7fcca6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcca806bad0 0x7fcca819c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:03.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.745+0000 7fcca6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcca806bad0 0x7fcca819c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40604/0 (socket says 172.21.15.81:40604) 2024-05-03T16:46:03.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.745+0000 7fcca6a00700 1 -- 172.21.15.81:0/2706833952 learned_addr learned my addr 172.21.15.81:0/2706833952 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:46:03.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.745+0000 7fcca7400700 1 --2- 172.21.15.81:0/2706833952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcca806b1b0 0x7fcca819bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:03.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.745+0000 7fcca7e00700 1 --2- 172.21.15.81:0/2706833952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcca810ff50 0x7fcca81a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:03.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.745+0000 7fcca6a00700 1 -- 172.21.15.81:0/2706833952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcca806b1b0 msgr2=0x7fcca819bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:03.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.745+0000 7fcca6a00700 1 --2- 172.21.15.81:0/2706833952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcca806b1b0 0x7fcca819bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:03.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.745+0000 7fcca6a00700 1 -- 172.21.15.81:0/2706833952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcca810ff50 msgr2=0x7fcca81a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:03.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.745+0000 7fcca6a00700 1 --2- 172.21.15.81:0/2706833952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcca810ff50 0x7fcca81a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:03.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.745+0000 7fcca6a00700 1 -- 172.21.15.81:0/2706833952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca81a0db0 con 0x7fcca806bad0 2024-05-03T16:46:03.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.746+0000 7fcca6a00700 1 --2- 172.21.15.81:0/2706833952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcca806bad0 0x7fcca819c2e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000b070 tx=0x7fcc90004e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:03.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.746+0000 7fcc9fe00700 1 -- 172.21.15.81:0/2706833952 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc90021070 con 0x7fcca806bad0 2024-05-03T16:46:03.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.746+0000 7fcc9fe00700 1 -- 172.21.15.81:0/2706833952 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc90007c80 con 0x7fcca806bad0 2024-05-03T16:46:03.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.746+0000 7fcc9fe00700 1 -- 172.21.15.81:0/2706833952 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc900047d0 con 0x7fcca806bad0 2024-05-03T16:46:03.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.746+0000 7fccae400700 1 -- 172.21.15.81:0/2706833952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca81a1040 con 0x7fcca806bad0 2024-05-03T16:46:03.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.746+0000 7fccae400700 1 -- 172.21.15.81:0/2706833952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca81a8920 con 0x7fcca806bad0 2024-05-03T16:46:03.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.748+0000 7fccae400700 1 -- 172.21.15.81:0/2706833952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca81029c0 con 0x7fcca806bad0 2024-05-03T16:46:03.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.750+0000 7fcc9fe00700 1 -- 172.21.15.81:0/2706833952 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fcc90003a00 con 0x7fcca806bad0 2024-05-03T16:46:03.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.751+0000 7fcc9fe00700 1 --2- 172.21.15.81:0/2706833952 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fcc880b2990 0x7fcc880b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:03.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.751+0000 7fcc9fe00700 1 -- 172.21.15.81:0/2706833952 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fcc9000f020 con 0x7fcca806bad0 2024-05-03T16:46:03.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.751+0000 7fcca7400700 1 --2- 172.21.15.81:0/2706833952 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fcc880b2990 0x7fcc880b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:03.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.752+0000 7fcca7400700 1 --2- 172.21.15.81:0/2706833952 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fcc880b2990 0x7fcc880b4e50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcc98005950 tx=0x7fcc980058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:03.756+0000 7fcc9fe00700 1 -- 172.21.15.81:0/2706833952 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fcc9002a020 con 0x7fcca806bad0 2024-05-03T16:46:04.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:04.011+0000 7fccae400700 1 -- 172.21.15.81:0/2706833952 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcca819d100 con 0x7fcc880b2990 2024-05-03T16:46:04.013 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:03 smithi081 ceph-mon[28640]: pgmap v440: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-05-03T16:46:04.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:04.025+0000 7fcc9fe00700 1 -- 172.21.15.81:0/2706833952 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340441 (secure 0 0 0) 0x7fcca819d100 con 0x7fcc880b2990 2024-05-03T16:46:04.032 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:46:04.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:04.032+0000 7fccae400700 1 -- 172.21.15.81:0/2706833952 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fcc880b2990 msgr2=0x7fcc880b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:04.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:04.032+0000 7fccae400700 1 --2- 172.21.15.81:0/2706833952 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fcc880b2990 0x7fcc880b4e50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcc98005950 tx=0x7fcc980058e0 comp rx=0 tx=0).stop 2024-05-03T16:46:04.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:04.032+0000 7fccae400700 1 -- 172.21.15.81:0/2706833952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcca806bad0 msgr2=0x7fcca819c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:04.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:04.032+0000 7fccae400700 1 --2- 172.21.15.81:0/2706833952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcca806bad0 0x7fcca819c2e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000b070 tx=0x7fcc90004e00 comp rx=0 tx=0).stop 2024-05-03T16:46:04.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:04.032+0000 7fccae400700 1 -- 172.21.15.81:0/2706833952 shutdown_connections 2024-05-03T16:46:04.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:04.032+0000 7fccae400700 1 --2- 172.21.15.81:0/2706833952 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fcc880b2990 0x7fcc880b4e50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:04.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:04.032+0000 7fccae400700 1 --2- 172.21.15.81:0/2706833952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcca806b1b0 0x7fcca819bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:04.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:04.032+0000 7fccae400700 1 --2- 172.21.15.81:0/2706833952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcca810ff50 0x7fcca81a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:04.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:04.032+0000 7fccae400700 1 --2- 172.21.15.81:0/2706833952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcca806bad0 0x7fcca819c2e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:04.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:04.032+0000 7fccae400700 1 -- 172.21.15.81:0/2706833952 >> 172.21.15.81:0/2706833952 conn(0x7fcca8079350 msgr2=0x7fcca81115e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:04.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:04.033+0000 7fccae400700 1 -- 172.21.15.81:0/2706833952 shutdown_connections 2024-05-03T16:46:04.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:04.033+0000 7fccae400700 1 -- 172.21.15.81:0/2706833952 wait complete. 2024-05-03T16:46:04.036 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-03T16:46:04.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:03 smithi146 ceph-mon[32357]: pgmap v440: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-05-03T16:46:04.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:03 smithi134 ceph-mon[31708]: pgmap v440: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-05-03T16:46:05.034 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":440,"stamp":"2024-05-03T16:46:02.329427+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651542,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":444,"num_read_kb":317,"num_write":368,"num_write_kb":2284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952456,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359448,"kb_used_data":14456,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124582376,"statfs":{"total":1151940427776,"available":1151572353024,"internally_reserved":0,"allocated":14802944,"data_stored":8230304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23782,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":90,"num_write":15,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006746"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.105518+0000","last_change":"2024-05-03T16:43:55.937413+0000","last_active":"2024-05-03T16:45:06.105518+0000","last_peered":"2024-05-03T16:45:06.105518+0000","last_clean":"2024-05-03T16:45:06.105518+0000","last_became_active":"2024-05-03T16:43:55.935792+0000","last_became_peered":"2024-05-03T16:43:55.935792+0000","last_unstale":"2024-05-03T16:45:06.105518+0000","last_undegraded":"2024-05-03T16:45:06.105518+0000","last_fullsized":"2024-05-03T16:45:06.105518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:42:51.277432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170992+0000","last_change":"2024-05-03T16:43:55.950299+0000","last_active":"2024-05-03T16:45:06.170992+0000","last_peered":"2024-05-03T16:45:06.170992+0000","last_clean":"2024-05-03T16:45:06.170992+0000","last_became_active":"2024-05-03T16:43:55.948163+0000","last_became_peered":"2024-05-03T16:43:55.948163+0000","last_unstale":"2024-05-03T16:45:06.170992+0000","last_undegraded":"2024-05-03T16:45:06.170992+0000","last_fullsized":"2024-05-03T16:45:06.170992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:39:33.225914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169889+0000","last_change":"2024-05-03T16:43:55.942136+0000","last_active":"2024-05-03T16:45:06.169889+0000","last_peered":"2024-05-03T16:45:06.169889+0000","last_clean":"2024-05-03T16:45:06.169889+0000","last_became_active":"2024-05-03T16:43:55.941402+0000","last_became_peered":"2024-05-03T16:43:55.941402+0000","last_unstale":"2024-05-03T16:45:06.169889+0000","last_undegraded":"2024-05-03T16:45:06.169889+0000","last_fullsized":"2024-05-03T16:45:06.169889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:50:19.328978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.108202+0000","last_change":"2024-05-03T16:43:55.940573+0000","last_active":"2024-05-03T16:45:06.108202+0000","last_peered":"2024-05-03T16:45:06.108202+0000","last_clean":"2024-05-03T16:45:06.108202+0000","last_became_active":"2024-05-03T16:43:55.939406+0000","last_became_peered":"2024-05-03T16:43:55.939406+0000","last_unstale":"2024-05-03T16:45:06.108202+0000","last_undegraded":"2024-05-03T16:45:06.108202+0000","last_fullsized":"2024-05-03T16:45:06.108202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:29:35.290602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.108653+0000","last_change":"2024-05-03T16:43:55.937068+0000","last_active":"2024-05-03T16:45:06.108653+0000","last_peered":"2024-05-03T16:45:06.108653+0000","last_clean":"2024-05-03T16:45:06.108653+0000","last_became_active":"2024-05-03T16:43:55.934858+0000","last_became_peered":"2024-05-03T16:43:55.934858+0000","last_unstale":"2024-05-03T16:45:06.108653+0000","last_undegraded":"2024-05-03T16:45:06.108653+0000","last_fullsized":"2024-05-03T16:45:06.108653+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:50:41.839587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.105009+0000","last_change":"2024-05-03T16:43:55.936367+0000","last_active":"2024-05-03T16:45:06.105009+0000","last_peered":"2024-05-03T16:45:06.105009+0000","last_clean":"2024-05-03T16:45:06.105009+0000","last_became_active":"2024-05-03T16:43:55.936045+0000","last_became_peered":"2024-05-03T16:43:55.936045+0000","last_unstale":"2024-05-03T16:45:06.105009+0000","last_undegraded":"2024-05-03T16:45:06.105009+0000","last_fullsized":"2024-05-03T16:45:06.105009+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:34.718036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169804+0000","last_change":"2024-05-03T16:43:55.947918+0000","last_active":"2024-05-03T16:45:06.169804+0000","last_peered":"2024-05-03T16:45:06.169804+0000","last_clean":"2024-05-03T16:45:06.169804+0000","last_became_active":"2024-05-03T16:43:55.947541+0000","last_became_peered":"2024-05-03T16:43:55.947541+0000","last_unstale":"2024-05-03T16:45:06.169804+0000","last_undegraded":"2024-05-03T16:45:06.169804+0000","last_fullsized":"2024-05-03T16:45:06.169804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:11:53.101483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172748+0000","last_change":"2024-05-03T16:43:55.947104+0000","last_active":"2024-05-03T16:45:06.172748+0000","last_peered":"2024-05-03T16:45:06.172748+0000","last_clean":"2024-05-03T16:45:06.172748+0000","last_became_active":"2024-05-03T16:43:55.946733+0000","last_became_peered":"2024-05-03T16:43:55.946733+0000","last_unstale":"2024-05-03T16:45:06.172748+0000","last_undegraded":"2024-05-03T16:45:06.172748+0000","last_fullsized":"2024-05-03T16:45:06.172748+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:00:49.865951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.101894+0000","last_change":"2024-05-03T16:43:55.935238+0000","last_active":"2024-05-03T16:45:06.101894+0000","last_peered":"2024-05-03T16:45:06.101894+0000","last_clean":"2024-05-03T16:45:06.101894+0000","last_became_active":"2024-05-03T16:43:55.934821+0000","last_became_peered":"2024-05-03T16:43:55.934821+0000","last_unstale":"2024-05-03T16:45:06.101894+0000","last_undegraded":"2024-05-03T16:45:06.101894+0000","last_fullsized":"2024-05-03T16:45:06.101894+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:53:00.895000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.106705+0000","last_change":"2024-05-03T16:43:55.940084+0000","last_active":"2024-05-03T16:45:06.106705+0000","last_peered":"2024-05-03T16:45:06.106705+0000","last_clean":"2024-05-03T16:45:06.106705+0000","last_became_active":"2024-05-03T16:43:55.939788+0000","last_became_peered":"2024-05-03T16:43:55.939788+0000","last_unstale":"2024-05-03T16:45:06.106705+0000","last_undegraded":"2024-05-03T16:45:06.106705+0000","last_fullsized":"2024-05-03T16:45:06.106705+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:05:04.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171334+0000","last_change":"2024-05-03T16:43:55.941343+0000","last_active":"2024-05-03T16:45:06.171334+0000","last_peered":"2024-05-03T16:45:06.171334+0000","last_clean":"2024-05-03T16:45:06.171334+0000","last_became_active":"2024-05-03T16:43:55.940187+0000","last_became_peered":"2024-05-03T16:43:55.940187+0000","last_unstale":"2024-05-03T16:45:06.171334+0000","last_undegraded":"2024-05-03T16:45:06.171334+0000","last_fullsized":"2024-05-03T16:45:06.171334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:56:32.974369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.098277+0000","last_change":"2024-05-03T16:44:06.018850+0000","last_active":"2024-05-03T16:45:06.098277+0000","last_peered":"2024-05-03T16:45:06.098277+0000","last_clean":"2024-05-03T16:45:06.098277+0000","last_became_active":"2024-05-03T16:44:06.018311+0000","last_became_peered":"2024-05-03T16:44:06.018311+0000","last_unstale":"2024-05-03T16:45:06.098277+0000","last_undegraded":"2024-05-03T16:45:06.098277+0000","last_fullsized":"2024-05-03T16:45:06.098277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:02:09.949030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173935+0000","last_change":"2024-05-03T16:43:55.938218+0000","last_active":"2024-05-03T16:45:06.173935+0000","last_peered":"2024-05-03T16:45:06.173935+0000","last_clean":"2024-05-03T16:45:06.173935+0000","last_became_active":"2024-05-03T16:43:55.937559+0000","last_became_peered":"2024-05-03T16:43:55.937559+0000","last_unstale":"2024-05-03T16:45:06.173935+0000","last_undegraded":"2024-05-03T16:45:06.173935+0000","last_fullsized":"2024-05-03T16:45:06.173935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:59:03.766052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171415+0000","last_change":"2024-05-03T16:43:55.950325+0000","last_active":"2024-05-03T16:45:06.171415+0000","last_peered":"2024-05-03T16:45:06.171415+0000","last_clean":"2024-05-03T16:45:06.171415+0000","last_became_active":"2024-05-03T16:43:55.948615+0000","last_became_peered":"2024-05-03T16:43:55.948615+0000","last_unstale":"2024-05-03T16:45:06.171415+0000","last_undegraded":"2024-05-03T16:45:06.171415+0000","last_fullsized":"2024-05-03T16:45:06.171415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:53:06.143381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169397+0000","last_change":"2024-05-03T16:44:06.021139+0000","last_active":"2024-05-03T16:45:06.169397+0000","last_peered":"2024-05-03T16:45:06.169397+0000","last_clean":"2024-05-03T16:45:06.169397+0000","last_became_active":"2024-05-03T16:44:06.020348+0000","last_became_peered":"2024-05-03T16:44:06.020348+0000","last_unstale":"2024-05-03T16:45:06.169397+0000","last_undegraded":"2024-05-03T16:45:06.169397+0000","last_fullsized":"2024-05-03T16:45:06.169397+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:59:45.974113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.098879+0000","last_change":"2024-05-03T16:43:55.934973+0000","last_active":"2024-05-03T16:45:06.098879+0000","last_peered":"2024-05-03T16:45:06.098879+0000","last_clean":"2024-05-03T16:45:06.098879+0000","last_became_active":"2024-05-03T16:43:55.934650+0000","last_became_peered":"2024-05-03T16:43:55.934650+0000","last_unstale":"2024-05-03T16:45:06.098879+0000","last_undegraded":"2024-05-03T16:45:06.098879+0000","last_fullsized":"2024-05-03T16:45:06.098879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:17:05.164194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.106062+0000","last_change":"2024-05-03T16:43:55.937828+0000","last_active":"2024-05-03T16:45:06.106062+0000","last_peered":"2024-05-03T16:45:06.106062+0000","last_clean":"2024-05-03T16:45:06.106062+0000","last_became_active":"2024-05-03T16:43:55.936380+0000","last_became_peered":"2024-05-03T16:43:55.936380+0000","last_unstale":"2024-05-03T16:45:06.106062+0000","last_undegraded":"2024-05-03T16:45:06.106062+0000","last_fullsized":"2024-05-03T16:45:06.106062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:23:17.199501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099034+0000","last_change":"2024-05-03T16:43:55.945162+0000","last_active":"2024-05-03T16:45:06.099034+0000","last_peered":"2024-05-03T16:45:06.099034+0000","last_clean":"2024-05-03T16:45:06.099034+0000","last_became_active":"2024-05-03T16:43:55.944210+0000","last_became_peered":"2024-05-03T16:43:55.944210+0000","last_unstale":"2024-05-03T16:45:06.099034+0000","last_undegraded":"2024-05-03T16:45:06.099034+0000","last_fullsized":"2024-05-03T16:45:06.099034+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:41:57.674653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.101139+0000","last_change":"2024-05-03T16:43:55.939350+0000","last_active":"2024-05-03T16:45:06.101139+0000","last_peered":"2024-05-03T16:45:06.101139+0000","last_clean":"2024-05-03T16:45:06.101139+0000","last_became_active":"2024-05-03T16:43:55.936920+0000","last_became_peered":"2024-05-03T16:43:55.936920+0000","last_unstale":"2024-05-03T16:45:06.101139+0000","last_undegraded":"2024-05-03T16:45:06.101139+0000","last_fullsized":"2024-05-03T16:45:06.101139+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:06:00.716153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099239+0000","last_change":"2024-05-03T16:44:11.090719+0000","last_active":"2024-05-03T16:45:06.099239+0000","last_peered":"2024-05-03T16:45:06.099239+0000","last_clean":"2024-05-03T16:45:06.099239+0000","last_became_active":"2024-05-03T16:44:11.090155+0000","last_became_peered":"2024-05-03T16:44:11.090155+0000","last_unstale":"2024-05-03T16:45:06.099239+0000","last_undegraded":"2024-05-03T16:45:06.099239+0000","last_fullsized":"2024-05-03T16:45:06.099239+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:05:01.406303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'13","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:56.715339+0000","last_change":"2024-05-03T16:44:06.029215+0000","last_active":"2024-05-03T16:45:56.715339+0000","last_peered":"2024-05-03T16:45:56.715339+0000","last_clean":"2024-05-03T16:45:56.715339+0000","last_became_active":"2024-05-03T16:44:06.013972+0000","last_became_peered":"2024-05-03T16:44:06.013972+0000","last_unstale":"2024-05-03T16:45:56.715339+0000","last_undegraded":"2024-05-03T16:45:56.715339+0000","last_fullsized":"2024-05-03T16:45:56.715339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:01:58.464781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099938+0000","last_change":"2024-05-03T16:44:06.023393+0000","last_active":"2024-05-03T16:45:06.099938+0000","last_peered":"2024-05-03T16:45:06.099938+0000","last_clean":"2024-05-03T16:45:06.099938+0000","last_became_active":"2024-05-03T16:44:06.022614+0000","last_became_peered":"2024-05-03T16:44:06.022614+0000","last_unstale":"2024-05-03T16:45:06.099938+0000","last_undegraded":"2024-05-03T16:45:06.099938+0000","last_fullsized":"2024-05-03T16:45:06.099938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:21:04.946792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.105733+0000","last_change":"2024-05-03T16:44:11.094113+0000","last_active":"2024-05-03T16:45:06.105733+0000","last_peered":"2024-05-03T16:45:06.105733+0000","last_clean":"2024-05-03T16:45:06.105733+0000","last_became_active":"2024-05-03T16:44:11.092499+0000","last_became_peered":"2024-05-03T16:44:11.092499+0000","last_unstale":"2024-05-03T16:45:06.105733+0000","last_undegraded":"2024-05-03T16:45:06.105733+0000","last_fullsized":"2024-05-03T16:45:06.105733+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:00:38.261341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:24.587168+0000","last_change":"2024-05-03T16:43:51.837525+0000","last_active":"2024-05-03T16:45:24.587168+0000","last_peered":"2024-05-03T16:45:24.587168+0000","last_clean":"2024-05-03T16:45:24.587168+0000","last_became_active":"2024-05-03T16:43:51.837056+0000","last_became_peered":"2024-05-03T16:43:51.837056+0000","last_unstale":"2024-05-03T16:45:24.587168+0000","last_undegraded":"2024-05-03T16:45:24.587168+0000","last_fullsized":"2024-05-03T16:45:24.587168+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:34:07.077471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170361+0000","last_change":"2024-05-03T16:43:55.933576+0000","last_active":"2024-05-03T16:45:06.170361+0000","last_peered":"2024-05-03T16:45:06.170361+0000","last_clean":"2024-05-03T16:45:06.170361+0000","last_became_active":"2024-05-03T16:43:55.932711+0000","last_became_peered":"2024-05-03T16:43:55.932711+0000","last_unstale":"2024-05-03T16:45:06.170361+0000","last_undegraded":"2024-05-03T16:45:06.170361+0000","last_fullsized":"2024-05-03T16:45:06.170361+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:35:44.769103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.106920+0000","last_change":"2024-05-03T16:44:11.093379+0000","last_active":"2024-05-03T16:45:06.106920+0000","last_peered":"2024-05-03T16:45:06.106920+0000","last_clean":"2024-05-03T16:45:06.106920+0000","last_became_active":"2024-05-03T16:44:11.091280+0000","last_became_peered":"2024-05-03T16:44:11.091280+0000","last_unstale":"2024-05-03T16:45:06.106920+0000","last_undegraded":"2024-05-03T16:45:06.106920+0000","last_fullsized":"2024-05-03T16:45:06.106920+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:20:11.987590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":57,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.616400+0000","last_change":"2024-05-03T16:43:51.820233+0000","last_active":"2024-05-03T16:45:27.616400+0000","last_peered":"2024-05-03T16:45:27.616400+0000","last_clean":"2024-05-03T16:45:27.616400+0000","last_became_active":"2024-05-03T16:43:51.818823+0000","last_became_peered":"2024-05-03T16:43:51.818823+0000","last_unstale":"2024-05-03T16:45:27.616400+0000","last_undegraded":"2024-05-03T16:45:27.616400+0000","last_fullsized":"2024-05-03T16:45:27.616400+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:48:06.135496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099413+0000","last_change":"2024-05-03T16:43:55.946298+0000","last_active":"2024-05-03T16:45:06.099413+0000","last_peered":"2024-05-03T16:45:06.099413+0000","last_clean":"2024-05-03T16:45:06.099413+0000","last_became_active":"2024-05-03T16:43:55.944228+0000","last_became_peered":"2024-05-03T16:43:55.944228+0000","last_unstale":"2024-05-03T16:45:06.099413+0000","last_undegraded":"2024-05-03T16:45:06.099413+0000","last_fullsized":"2024-05-03T16:45:06.099413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:42:50.437264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.106117+0000","last_change":"2024-05-03T16:44:11.086723+0000","last_active":"2024-05-03T16:45:06.106117+0000","last_peered":"2024-05-03T16:45:06.106117+0000","last_clean":"2024-05-03T16:45:06.106117+0000","last_became_active":"2024-05-03T16:44:11.086189+0000","last_became_peered":"2024-05-03T16:44:11.086189+0000","last_unstale":"2024-05-03T16:45:06.106117+0000","last_undegraded":"2024-05-03T16:45:06.106117+0000","last_fullsized":"2024-05-03T16:45:06.106117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:23:41.292942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.633306+0000","last_change":"2024-05-03T16:43:51.817737+0000","last_active":"2024-05-03T16:45:26.633306+0000","last_peered":"2024-05-03T16:45:26.633306+0000","last_clean":"2024-05-03T16:45:26.633306+0000","last_became_active":"2024-05-03T16:43:51.817191+0000","last_became_peered":"2024-05-03T16:43:51.817191+0000","last_unstale":"2024-05-03T16:45:26.633306+0000","last_undegraded":"2024-05-03T16:45:26.633306+0000","last_fullsized":"2024-05-03T16:45:26.633306+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:21:16.875189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.098518+0000","last_change":"2024-05-03T16:44:06.180066+0000","last_active":"2024-05-03T16:45:06.098518+0000","last_peered":"2024-05-03T16:45:06.098518+0000","last_clean":"2024-05-03T16:45:06.098518+0000","last_became_active":"2024-05-03T16:44:06.178981+0000","last_became_peered":"2024-05-03T16:44:06.178981+0000","last_unstale":"2024-05-03T16:45:06.098518+0000","last_undegraded":"2024-05-03T16:45:06.098518+0000","last_fullsized":"2024-05-03T16:45:06.098518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:18:10.683947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.100401+0000","last_change":"2024-05-03T16:44:11.092472+0000","last_active":"2024-05-03T16:45:06.100401+0000","last_peered":"2024-05-03T16:45:06.100401+0000","last_clean":"2024-05-03T16:45:06.100401+0000","last_became_active":"2024-05-03T16:44:11.091225+0000","last_became_peered":"2024-05-03T16:44:11.091225+0000","last_unstale":"2024-05-03T16:45:06.100401+0000","last_undegraded":"2024-05-03T16:45:06.100401+0000","last_fullsized":"2024-05-03T16:45:06.100401+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:24:09.194801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'5","reported_seq":91,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:59.728811+0000","last_change":"2024-05-03T16:44:06.180557+0000","last_active":"2024-05-03T16:45:59.728811+0000","last_peered":"2024-05-03T16:45:59.728811+0000","last_clean":"2024-05-03T16:45:59.728811+0000","last_became_active":"2024-05-03T16:44:06.179612+0000","last_became_peered":"2024-05-03T16:44:06.179612+0000","last_unstale":"2024-05-03T16:45:59.728811+0000","last_undegraded":"2024-05-03T16:45:59.728811+0000","last_fullsized":"2024-05-03T16:45:59.728811+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:39:33.469080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.109308+0000","last_change":"2024-05-03T16:43:55.942416+0000","last_active":"2024-05-03T16:45:06.109308+0000","last_peered":"2024-05-03T16:45:06.109308+0000","last_clean":"2024-05-03T16:45:06.109308+0000","last_became_active":"2024-05-03T16:43:55.942041+0000","last_became_peered":"2024-05-03T16:43:55.942041+0000","last_unstale":"2024-05-03T16:45:06.109308+0000","last_undegraded":"2024-05-03T16:45:06.109308+0000","last_fullsized":"2024-05-03T16:45:06.109308+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:40:29.384354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099884+0000","last_change":"2024-05-03T16:44:11.096209+0000","last_active":"2024-05-03T16:45:06.099884+0000","last_peered":"2024-05-03T16:45:06.099884+0000","last_clean":"2024-05-03T16:45:06.099884+0000","last_became_active":"2024-05-03T16:44:11.095724+0000","last_became_peered":"2024-05-03T16:44:11.095724+0000","last_unstale":"2024-05-03T16:45:06.099884+0000","last_undegraded":"2024-05-03T16:45:06.099884+0000","last_fullsized":"2024-05-03T16:45:06.099884+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:41:30.883988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":57,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:25.605680+0000","last_change":"2024-05-03T16:44:06.021453+0000","last_active":"2024-05-03T16:45:25.605680+0000","last_peered":"2024-05-03T16:45:25.605680+0000","last_clean":"2024-05-03T16:45:25.605680+0000","last_became_active":"2024-05-03T16:44:06.020443+0000","last_became_peered":"2024-05-03T16:44:06.020443+0000","last_unstale":"2024-05-03T16:45:25.605680+0000","last_undegraded":"2024-05-03T16:45:25.605680+0000","last_fullsized":"2024-05-03T16:45:25.605680+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:55:43.435774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171350+0000","last_change":"2024-05-03T16:43:55.938655+0000","last_active":"2024-05-03T16:45:06.171350+0000","last_peered":"2024-05-03T16:45:06.171350+0000","last_clean":"2024-05-03T16:45:06.171350+0000","last_became_active":"2024-05-03T16:43:55.938269+0000","last_became_peered":"2024-05-03T16:43:55.938269+0000","last_unstale":"2024-05-03T16:45:06.171350+0000","last_undegraded":"2024-05-03T16:45:06.171350+0000","last_fullsized":"2024-05-03T16:45:06.171350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:51:42.550932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104665+0000","last_change":"2024-05-03T16:44:11.096724+0000","last_active":"2024-05-03T16:45:06.104665+0000","last_peered":"2024-05-03T16:45:06.104665+0000","last_clean":"2024-05-03T16:45:06.104665+0000","last_became_active":"2024-05-03T16:44:11.095877+0000","last_became_peered":"2024-05-03T16:44:11.095877+0000","last_unstale":"2024-05-03T16:45:06.104665+0000","last_undegraded":"2024-05-03T16:45:06.104665+0000","last_fullsized":"2024-05-03T16:45:06.104665+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:08:46.696046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:24.589838+0000","last_change":"2024-05-03T16:43:51.818919+0000","last_active":"2024-05-03T16:45:24.589838+0000","last_peered":"2024-05-03T16:45:24.589838+0000","last_clean":"2024-05-03T16:45:24.589838+0000","last_became_active":"2024-05-03T16:43:51.817574+0000","last_became_peered":"2024-05-03T16:43:51.817574+0000","last_unstale":"2024-05-03T16:45:24.589838+0000","last_undegraded":"2024-05-03T16:45:24.589838+0000","last_fullsized":"2024-05-03T16:45:24.589838+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:18:17.335988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172429+0000","last_change":"2024-05-03T16:43:55.935647+0000","last_active":"2024-05-03T16:45:06.172429+0000","last_peered":"2024-05-03T16:45:06.172429+0000","last_clean":"2024-05-03T16:45:06.172429+0000","last_became_active":"2024-05-03T16:43:55.935266+0000","last_became_peered":"2024-05-03T16:43:55.935266+0000","last_unstale":"2024-05-03T16:45:06.172429+0000","last_undegraded":"2024-05-03T16:45:06.172429+0000","last_fullsized":"2024-05-03T16:45:06.172429+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:51:48.743197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170825+0000","last_change":"2024-05-03T16:44:11.085588+0000","last_active":"2024-05-03T16:45:06.170825+0000","last_peered":"2024-05-03T16:45:06.170825+0000","last_clean":"2024-05-03T16:45:06.170825+0000","last_became_active":"2024-05-03T16:44:11.084993+0000","last_became_peered":"2024-05-03T16:44:11.084993+0000","last_unstale":"2024-05-03T16:45:06.170825+0000","last_undegraded":"2024-05-03T16:45:06.170825+0000","last_fullsized":"2024-05-03T16:45:06.170825+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:50:42.349365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.628203+0000","last_change":"2024-05-03T16:43:51.828689+0000","last_active":"2024-05-03T16:45:26.628203+0000","last_peered":"2024-05-03T16:45:26.628203+0000","last_clean":"2024-05-03T16:45:26.628203+0000","last_became_active":"2024-05-03T16:43:51.828212+0000","last_became_peered":"2024-05-03T16:43:51.828212+0000","last_unstale":"2024-05-03T16:45:26.628203+0000","last_undegraded":"2024-05-03T16:45:26.628203+0000","last_fullsized":"2024-05-03T16:45:26.628203+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:06:18.947792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.097742+0000","last_change":"2024-05-03T16:43:55.945043+0000","last_active":"2024-05-03T16:45:06.097742+0000","last_peered":"2024-05-03T16:45:06.097742+0000","last_clean":"2024-05-03T16:45:06.097742+0000","last_became_active":"2024-05-03T16:43:55.944702+0000","last_became_peered":"2024-05-03T16:43:55.944702+0000","last_unstale":"2024-05-03T16:45:06.097742+0000","last_undegraded":"2024-05-03T16:45:06.097742+0000","last_fullsized":"2024-05-03T16:45:06.097742+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:28:51.434232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172766+0000","last_change":"2024-05-03T16:44:11.080122+0000","last_active":"2024-05-03T16:45:06.172766+0000","last_peered":"2024-05-03T16:45:06.172766+0000","last_clean":"2024-05-03T16:45:06.172766+0000","last_became_active":"2024-05-03T16:44:11.078792+0000","last_became_peered":"2024-05-03T16:44:11.078792+0000","last_unstale":"2024-05-03T16:45:06.172766+0000","last_undegraded":"2024-05-03T16:45:06.172766+0000","last_fullsized":"2024-05-03T16:45:06.172766+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:43:17.828550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'4","reported_seq":116,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:46:00.729612+0000","last_change":"2024-05-03T16:43:51.823536+0000","last_active":"2024-05-03T16:46:00.729612+0000","last_peered":"2024-05-03T16:46:00.729612+0000","last_clean":"2024-05-03T16:46:00.729612+0000","last_became_active":"2024-05-03T16:43:51.823117+0000","last_became_peered":"2024-05-03T16:43:51.823117+0000","last_unstale":"2024-05-03T16:46:00.729612+0000","last_undegraded":"2024-05-03T16:46:00.729612+0000","last_fullsized":"2024-05-03T16:46:00.729612+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:50:19.990133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.102043+0000","last_change":"2024-05-03T16:43:55.945941+0000","last_active":"2024-05-03T16:45:06.102043+0000","last_peered":"2024-05-03T16:45:06.102043+0000","last_clean":"2024-05-03T16:45:06.102043+0000","last_became_active":"2024-05-03T16:43:55.945173+0000","last_became_peered":"2024-05-03T16:43:55.945173+0000","last_unstale":"2024-05-03T16:45:06.102043+0000","last_undegraded":"2024-05-03T16:45:06.102043+0000","last_fullsized":"2024-05-03T16:45:06.102043+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:39:22.185454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.097412+0000","last_change":"2024-05-03T16:44:11.090040+0000","last_active":"2024-05-03T16:45:06.097412+0000","last_peered":"2024-05-03T16:45:06.097412+0000","last_clean":"2024-05-03T16:45:06.097412+0000","last_became_active":"2024-05-03T16:44:11.089381+0000","last_became_peered":"2024-05-03T16:44:11.089381+0000","last_unstale":"2024-05-03T16:45:06.097412+0000","last_undegraded":"2024-05-03T16:45:06.097412+0000","last_fullsized":"2024-05-03T16:45:06.097412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:13:05.149205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.623147+0000","last_change":"2024-05-03T16:43:51.828726+0000","last_active":"2024-05-03T16:45:26.623147+0000","last_peered":"2024-05-03T16:45:26.623147+0000","last_clean":"2024-05-03T16:45:26.623147+0000","last_became_active":"2024-05-03T16:43:51.827302+0000","last_became_peered":"2024-05-03T16:43:51.827302+0000","last_unstale":"2024-05-03T16:45:26.623147+0000","last_undegraded":"2024-05-03T16:45:26.623147+0000","last_fullsized":"2024-05-03T16:45:26.623147+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:24:03.296019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170542+0000","last_change":"2024-05-03T16:43:55.941142+0000","last_active":"2024-05-03T16:45:06.170542+0000","last_peered":"2024-05-03T16:45:06.170542+0000","last_clean":"2024-05-03T16:45:06.170542+0000","last_became_active":"2024-05-03T16:43:55.940762+0000","last_became_peered":"2024-05-03T16:43:55.940762+0000","last_unstale":"2024-05-03T16:45:06.170542+0000","last_undegraded":"2024-05-03T16:45:06.170542+0000","last_fullsized":"2024-05-03T16:45:06.170542+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:31:38.412076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.107255+0000","last_change":"2024-05-03T16:44:11.091481+0000","last_active":"2024-05-03T16:45:06.107255+0000","last_peered":"2024-05-03T16:45:06.107255+0000","last_clean":"2024-05-03T16:45:06.107255+0000","last_became_active":"2024-05-03T16:44:11.090597+0000","last_became_peered":"2024-05-03T16:44:11.090597+0000","last_unstale":"2024-05-03T16:45:06.107255+0000","last_undegraded":"2024-05-03T16:45:06.107255+0000","last_fullsized":"2024-05-03T16:45:06.107255+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:43:09.390062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:25.605378+0000","last_change":"2024-05-03T16:43:51.837548+0000","last_active":"2024-05-03T16:45:25.605378+0000","last_peered":"2024-05-03T16:45:25.605378+0000","last_clean":"2024-05-03T16:45:25.605378+0000","last_became_active":"2024-05-03T16:43:51.837021+0000","last_became_peered":"2024-05-03T16:43:51.837021+0000","last_unstale":"2024-05-03T16:45:25.605378+0000","last_undegraded":"2024-05-03T16:45:25.605378+0000","last_fullsized":"2024-05-03T16:45:25.605378+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:26:57.384438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.100099+0000","last_change":"2024-05-03T16:43:55.933759+0000","last_active":"2024-05-03T16:45:06.100099+0000","last_peered":"2024-05-03T16:45:06.100099+0000","last_clean":"2024-05-03T16:45:06.100099+0000","last_became_active":"2024-05-03T16:43:55.933026+0000","last_became_peered":"2024-05-03T16:43:55.933026+0000","last_unstale":"2024-05-03T16:45:06.100099+0000","last_undegraded":"2024-05-03T16:45:06.100099+0000","last_fullsized":"2024-05-03T16:45:06.100099+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:28:46.898497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175789+0000","last_change":"2024-05-03T16:45:06.174763+0000","last_active":"2024-05-03T16:45:06.175789+0000","last_peered":"2024-05-03T16:45:06.175789+0000","last_clean":"2024-05-03T16:45:06.175789+0000","last_became_active":"2024-05-03T16:45:06.173268+0000","last_became_peered":"2024-05-03T16:45:06.173268+0000","last_unstale":"2024-05-03T16:45:06.175789+0000","last_undegraded":"2024-05-03T16:45:06.175789+0000","last_fullsized":"2024-05-03T16:45:06.175789+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:42:14.281298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.14","version":"91'33","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:46:00.746057+0000","last_change":"2024-05-03T16:43:51.821086+0000","last_active":"2024-05-03T16:46:00.746057+0000","last_peered":"2024-05-03T16:46:00.746057+0000","last_clean":"2024-05-03T16:46:00.746057+0000","last_became_active":"2024-05-03T16:43:51.820371+0000","last_became_peered":"2024-05-03T16:43:51.820371+0000","last_unstale":"2024-05-03T16:46:00.746057+0000","last_undegraded":"2024-05-03T16:46:00.746057+0000","last_fullsized":"2024-05-03T16:46:00.746057+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:40:51.807045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54127,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":76,"num_read_kb":91,"num_write":35,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.109227+0000","last_change":"2024-05-03T16:43:55.952946+0000","last_active":"2024-05-03T16:45:06.109227+0000","last_peered":"2024-05-03T16:45:06.109227+0000","last_clean":"2024-05-03T16:45:06.109227+0000","last_became_active":"2024-05-03T16:43:55.952587+0000","last_became_peered":"2024-05-03T16:43:55.952587+0000","last_unstale":"2024-05-03T16:45:06.109227+0000","last_undegraded":"2024-05-03T16:45:06.109227+0000","last_fullsized":"2024-05-03T16:45:06.109227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:40:24.944554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170947+0000","last_change":"2024-05-03T16:44:11.088771+0000","last_active":"2024-05-03T16:45:06.170947+0000","last_peered":"2024-05-03T16:45:06.170947+0000","last_clean":"2024-05-03T16:45:06.170947+0000","last_became_active":"2024-05-03T16:44:11.088206+0000","last_became_peered":"2024-05-03T16:44:11.088206+0000","last_unstale":"2024-05-03T16:45:06.170947+0000","last_undegraded":"2024-05-03T16:45:06.170947+0000","last_fullsized":"2024-05-03T16:45:06.170947+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:20:34.876403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.626012+0000","last_change":"2024-05-03T16:44:06.034148+0000","last_active":"2024-05-03T16:45:27.626012+0000","last_peered":"2024-05-03T16:45:27.626012+0000","last_clean":"2024-05-03T16:45:27.626012+0000","last_became_active":"2024-05-03T16:44:06.019766+0000","last_became_peered":"2024-05-03T16:44:06.019766+0000","last_unstale":"2024-05-03T16:45:27.626012+0000","last_undegraded":"2024-05-03T16:45:27.626012+0000","last_fullsized":"2024-05-03T16:45:27.626012+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:05:37.507361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172574+0000","last_change":"2024-05-03T16:43:55.935799+0000","last_active":"2024-05-03T16:45:06.172574+0000","last_peered":"2024-05-03T16:45:06.172574+0000","last_clean":"2024-05-03T16:45:06.172574+0000","last_became_active":"2024-05-03T16:43:55.935500+0000","last_became_peered":"2024-05-03T16:43:55.935500+0000","last_unstale":"2024-05-03T16:45:06.172574+0000","last_undegraded":"2024-05-03T16:45:06.172574+0000","last_fullsized":"2024-05-03T16:45:06.172574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:01:42.624823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.180000+0000","last_change":"2024-05-03T16:45:06.180000+0000","last_active":"2024-05-03T16:45:06.180000+0000","last_peered":"2024-05-03T16:45:06.180000+0000","last_clean":"2024-05-03T16:45:06.180000+0000","last_became_active":"2024-05-03T16:45:06.178226+0000","last_became_peered":"2024-05-03T16:45:06.178226+0000","last_unstale":"2024-05-03T16:45:06.180000+0000","last_undegraded":"2024-05-03T16:45:06.180000+0000","last_fullsized":"2024-05-03T16:45:06.180000+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:12:14.524002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.631154+0000","last_change":"2024-05-03T16:43:51.831435+0000","last_active":"2024-05-03T16:45:26.631154+0000","last_peered":"2024-05-03T16:45:26.631154+0000","last_clean":"2024-05-03T16:45:26.631154+0000","last_became_active":"2024-05-03T16:43:51.830857+0000","last_became_peered":"2024-05-03T16:43:51.830857+0000","last_unstale":"2024-05-03T16:45:26.631154+0000","last_undegraded":"2024-05-03T16:45:26.631154+0000","last_fullsized":"2024-05-03T16:45:26.631154+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:32:36.463798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170881+0000","last_change":"2024-05-03T16:43:55.946511+0000","last_active":"2024-05-03T16:45:06.170881+0000","last_peered":"2024-05-03T16:45:06.170881+0000","last_clean":"2024-05-03T16:45:06.170881+0000","last_became_active":"2024-05-03T16:43:55.946206+0000","last_became_peered":"2024-05-03T16:43:55.946206+0000","last_unstale":"2024-05-03T16:45:06.170881+0000","last_undegraded":"2024-05-03T16:45:06.170881+0000","last_fullsized":"2024-05-03T16:45:06.170881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:08:04.276790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099316+0000","last_change":"2024-05-03T16:44:11.087824+0000","last_active":"2024-05-03T16:45:06.099316+0000","last_peered":"2024-05-03T16:45:06.099316+0000","last_clean":"2024-05-03T16:45:06.099316+0000","last_became_active":"2024-05-03T16:44:11.087408+0000","last_became_peered":"2024-05-03T16:44:11.087408+0000","last_unstale":"2024-05-03T16:45:06.099316+0000","last_undegraded":"2024-05-03T16:45:06.099316+0000","last_fullsized":"2024-05-03T16:45:06.099316+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:18:23.334214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"91'5","reported_seq":84,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:58.725569+0000","last_change":"2024-05-03T16:43:51.824633+0000","last_active":"2024-05-03T16:45:58.725569+0000","last_peered":"2024-05-03T16:45:58.725569+0000","last_clean":"2024-05-03T16:45:58.725569+0000","last_became_active":"2024-05-03T16:43:51.824137+0000","last_became_peered":"2024-05-03T16:43:51.824137+0000","last_unstale":"2024-05-03T16:45:58.725569+0000","last_undegraded":"2024-05-03T16:45:58.725569+0000","last_fullsized":"2024-05-03T16:45:58.725569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:13:25.975252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169584+0000","last_change":"2024-05-03T16:43:55.948878+0000","last_active":"2024-05-03T16:45:06.169584+0000","last_peered":"2024-05-03T16:45:06.169584+0000","last_clean":"2024-05-03T16:45:06.169584+0000","last_became_active":"2024-05-03T16:43:55.947279+0000","last_became_peered":"2024-05-03T16:43:55.947279+0000","last_unstale":"2024-05-03T16:45:06.169584+0000","last_undegraded":"2024-05-03T16:45:06.169584+0000","last_fullsized":"2024-05-03T16:45:06.169584+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:36:46.082725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175012+0000","last_change":"2024-05-03T16:44:11.096329+0000","last_active":"2024-05-03T16:45:06.175012+0000","last_peered":"2024-05-03T16:45:06.175012+0000","last_clean":"2024-05-03T16:45:06.175012+0000","last_became_active":"2024-05-03T16:44:11.091404+0000","last_became_peered":"2024-05-03T16:44:11.091404+0000","last_unstale":"2024-05-03T16:45:06.175012+0000","last_undegraded":"2024-05-03T16:45:06.175012+0000","last_fullsized":"2024-05-03T16:45:06.175012+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:09:12.688840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":62,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.630264+0000","last_change":"2024-05-03T16:43:51.837908+0000","last_active":"2024-05-03T16:45:26.630264+0000","last_peered":"2024-05-03T16:45:26.630264+0000","last_clean":"2024-05-03T16:45:26.630264+0000","last_became_active":"2024-05-03T16:43:51.837334+0000","last_became_peered":"2024-05-03T16:43:51.837334+0000","last_unstale":"2024-05-03T16:45:26.630264+0000","last_undegraded":"2024-05-03T16:45:26.630264+0000","last_fullsized":"2024-05-03T16:45:26.630264+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:08:46.480524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170127+0000","last_change":"2024-05-03T16:43:55.933729+0000","last_active":"2024-05-03T16:45:06.170127+0000","last_peered":"2024-05-03T16:45:06.170127+0000","last_clean":"2024-05-03T16:45:06.170127+0000","last_became_active":"2024-05-03T16:43:55.933211+0000","last_became_peered":"2024-05-03T16:43:55.933211+0000","last_unstale":"2024-05-03T16:45:06.170127+0000","last_undegraded":"2024-05-03T16:45:06.170127+0000","last_fullsized":"2024-05-03T16:45:06.170127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:03:38.814029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169919+0000","last_change":"2024-05-03T16:44:11.077832+0000","last_active":"2024-05-03T16:45:06.169919+0000","last_peered":"2024-05-03T16:45:06.169919+0000","last_clean":"2024-05-03T16:45:06.169919+0000","last_became_active":"2024-05-03T16:44:11.076574+0000","last_became_peered":"2024-05-03T16:44:11.076574+0000","last_unstale":"2024-05-03T16:45:06.169919+0000","last_undegraded":"2024-05-03T16:45:06.169919+0000","last_fullsized":"2024-05-03T16:45:06.169919+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:59:35.354254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:25.575049+0000","last_change":"2024-05-03T16:43:51.818391+0000","last_active":"2024-05-03T16:45:25.575049+0000","last_peered":"2024-05-03T16:45:25.575049+0000","last_clean":"2024-05-03T16:45:25.575049+0000","last_became_active":"2024-05-03T16:43:51.817335+0000","last_became_peered":"2024-05-03T16:43:51.817335+0000","last_unstale":"2024-05-03T16:45:25.575049+0000","last_undegraded":"2024-05-03T16:45:25.575049+0000","last_fullsized":"2024-05-03T16:45:25.575049+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:41:16.610501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104143+0000","last_change":"2024-05-03T16:43:55.948170+0000","last_active":"2024-05-03T16:45:06.104143+0000","last_peered":"2024-05-03T16:45:06.104143+0000","last_clean":"2024-05-03T16:45:06.104143+0000","last_became_active":"2024-05-03T16:43:55.947702+0000","last_became_peered":"2024-05-03T16:43:55.947702+0000","last_unstale":"2024-05-03T16:45:06.104143+0000","last_undegraded":"2024-05-03T16:45:06.104143+0000","last_fullsized":"2024-05-03T16:45:06.104143+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:23:27.614466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.108872+0000","last_change":"2024-05-03T16:44:11.110211+0000","last_active":"2024-05-03T16:45:06.108872+0000","last_peered":"2024-05-03T16:45:06.108872+0000","last_clean":"2024-05-03T16:45:06.108872+0000","last_became_active":"2024-05-03T16:44:11.109387+0000","last_became_peered":"2024-05-03T16:44:11.109387+0000","last_unstale":"2024-05-03T16:45:06.108872+0000","last_undegraded":"2024-05-03T16:45:06.108872+0000","last_fullsized":"2024-05-03T16:45:06.108872+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:00:50.609558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:25.605648+0000","last_change":"2024-05-03T16:43:51.837727+0000","last_active":"2024-05-03T16:45:25.605648+0000","last_peered":"2024-05-03T16:45:25.605648+0000","last_clean":"2024-05-03T16:45:25.605648+0000","last_became_active":"2024-05-03T16:43:51.837226+0000","last_became_peered":"2024-05-03T16:43:51.837226+0000","last_unstale":"2024-05-03T16:45:25.605648+0000","last_undegraded":"2024-05-03T16:45:25.605648+0000","last_fullsized":"2024-05-03T16:45:25.605648+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:52:48.913506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.106165+0000","last_change":"2024-05-03T16:43:55.934403+0000","last_active":"2024-05-03T16:45:06.106165+0000","last_peered":"2024-05-03T16:45:06.106165+0000","last_clean":"2024-05-03T16:45:06.106165+0000","last_became_active":"2024-05-03T16:43:55.933997+0000","last_became_peered":"2024-05-03T16:43:55.933997+0000","last_unstale":"2024-05-03T16:45:06.106165+0000","last_undegraded":"2024-05-03T16:45:06.106165+0000","last_fullsized":"2024-05-03T16:45:06.106165+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:44:36.005567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172933+0000","last_change":"2024-05-03T16:44:11.088757+0000","last_active":"2024-05-03T16:45:06.172933+0000","last_peered":"2024-05-03T16:45:06.172933+0000","last_clean":"2024-05-03T16:45:06.172933+0000","last_became_active":"2024-05-03T16:44:11.088208+0000","last_became_peered":"2024-05-03T16:44:11.088208+0000","last_unstale":"2024-05-03T16:45:06.172933+0000","last_undegraded":"2024-05-03T16:45:06.172933+0000","last_fullsized":"2024-05-03T16:45:06.172933+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:28:27.913357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"91'6","reported_seq":86,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:59.724461+0000","last_change":"2024-05-03T16:43:51.831736+0000","last_active":"2024-05-03T16:45:59.724461+0000","last_peered":"2024-05-03T16:45:59.724461+0000","last_clean":"2024-05-03T16:45:59.724461+0000","last_became_active":"2024-05-03T16:43:51.831282+0000","last_became_peered":"2024-05-03T16:43:51.831282+0000","last_unstale":"2024-05-03T16:45:59.724461+0000","last_undegraded":"2024-05-03T16:45:59.724461+0000","last_fullsized":"2024-05-03T16:45:59.724461+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:43:20.924935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104404+0000","last_change":"2024-05-03T16:43:55.939523+0000","last_active":"2024-05-03T16:45:06.104404+0000","last_peered":"2024-05-03T16:45:06.104404+0000","last_clean":"2024-05-03T16:45:06.104404+0000","last_became_active":"2024-05-03T16:43:55.939040+0000","last_became_peered":"2024-05-03T16:43:55.939040+0000","last_unstale":"2024-05-03T16:45:06.104404+0000","last_undegraded":"2024-05-03T16:45:06.104404+0000","last_fullsized":"2024-05-03T16:45:06.104404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:18:10.014846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175166+0000","last_change":"2024-05-03T16:44:11.110879+0000","last_active":"2024-05-03T16:45:06.175166+0000","last_peered":"2024-05-03T16:45:06.175166+0000","last_clean":"2024-05-03T16:45:06.175166+0000","last_became_active":"2024-05-03T16:44:11.109272+0000","last_became_peered":"2024-05-03T16:44:11.109272+0000","last_unstale":"2024-05-03T16:45:06.175166+0000","last_undegraded":"2024-05-03T16:45:06.175166+0000","last_fullsized":"2024-05-03T16:45:06.175166+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:56:06.145740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171964+0000","last_change":"2024-05-03T16:43:55.943555+0000","last_active":"2024-05-03T16:45:06.171964+0000","last_peered":"2024-05-03T16:45:06.171964+0000","last_clean":"2024-05-03T16:45:06.171964+0000","last_became_active":"2024-05-03T16:43:55.943153+0000","last_became_peered":"2024-05-03T16:43:55.943153+0000","last_unstale":"2024-05-03T16:45:06.171964+0000","last_undegraded":"2024-05-03T16:45:06.171964+0000","last_fullsized":"2024-05-03T16:45:06.171964+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:29:01.943626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":84,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:59.726989+0000","last_change":"2024-05-03T16:43:51.837491+0000","last_active":"2024-05-03T16:45:59.726989+0000","last_peered":"2024-05-03T16:45:59.726989+0000","last_clean":"2024-05-03T16:45:59.726989+0000","last_became_active":"2024-05-03T16:43:51.837008+0000","last_became_peered":"2024-05-03T16:43:51.837008+0000","last_unstale":"2024-05-03T16:45:59.726989+0000","last_undegraded":"2024-05-03T16:45:59.726989+0000","last_fullsized":"2024-05-03T16:45:59.726989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:59:22.075792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171302+0000","last_change":"2024-05-03T16:44:11.091138+0000","last_active":"2024-05-03T16:45:06.171302+0000","last_peered":"2024-05-03T16:45:06.171302+0000","last_clean":"2024-05-03T16:45:06.171302+0000","last_became_active":"2024-05-03T16:44:11.090386+0000","last_became_peered":"2024-05-03T16:44:11.090386+0000","last_unstale":"2024-05-03T16:45:06.171302+0000","last_undegraded":"2024-05-03T16:45:06.171302+0000","last_fullsized":"2024-05-03T16:45:06.171302+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:36:31.201018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173298+0000","last_change":"2024-05-03T16:43:55.945735+0000","last_active":"2024-05-03T16:45:06.173298+0000","last_peered":"2024-05-03T16:45:06.173298+0000","last_clean":"2024-05-03T16:45:06.173298+0000","last_became_active":"2024-05-03T16:43:55.945399+0000","last_became_peered":"2024-05-03T16:43:55.945399+0000","last_unstale":"2024-05-03T16:45:06.173298+0000","last_undegraded":"2024-05-03T16:45:06.173298+0000","last_fullsized":"2024-05-03T16:45:06.173298+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:28:59.508011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.629811+0000","last_change":"2024-05-03T16:43:51.826695+0000","last_active":"2024-05-03T16:45:27.629811+0000","last_peered":"2024-05-03T16:45:27.629811+0000","last_clean":"2024-05-03T16:45:27.629811+0000","last_became_active":"2024-05-03T16:43:51.825863+0000","last_became_peered":"2024-05-03T16:43:51.825863+0000","last_unstale":"2024-05-03T16:45:27.629811+0000","last_undegraded":"2024-05-03T16:45:27.629811+0000","last_fullsized":"2024-05-03T16:45:27.629811+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:39:15.068092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169749+0000","last_change":"2024-05-03T16:41:59.060997+0000","last_active":"2024-05-03T16:45:06.169749+0000","last_peered":"2024-05-03T16:45:06.169749+0000","last_clean":"2024-05-03T16:45:06.169749+0000","last_became_active":"2024-05-03T16:41:59.044854+0000","last_became_peered":"2024-05-03T16:41:59.044854+0000","last_unstale":"2024-05-03T16:45:06.169749+0000","last_undegraded":"2024-05-03T16:45:06.169749+0000","last_fullsized":"2024-05-03T16:45:06.169749+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:37:18.600432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:37:18.600432+0000","last_clean_scrub_stamp":"2024-05-03T16:37:18.600432+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:10:25.167355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171332+0000","last_change":"2024-05-03T16:44:11.110042+0000","last_active":"2024-05-03T16:45:06.171332+0000","last_peered":"2024-05-03T16:45:06.171332+0000","last_clean":"2024-05-03T16:45:06.171332+0000","last_became_active":"2024-05-03T16:44:11.109374+0000","last_became_peered":"2024-05-03T16:44:11.109374+0000","last_unstale":"2024-05-03T16:45:06.171332+0000","last_undegraded":"2024-05-03T16:45:06.171332+0000","last_fullsized":"2024-05-03T16:45:06.171332+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:04:21.562224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171622+0000","last_change":"2024-05-03T16:43:55.936662+0000","last_active":"2024-05-03T16:45:06.171622+0000","last_peered":"2024-05-03T16:45:06.171622+0000","last_clean":"2024-05-03T16:45:06.171622+0000","last_became_active":"2024-05-03T16:43:55.936332+0000","last_became_peered":"2024-05-03T16:43:55.936332+0000","last_unstale":"2024-05-03T16:45:06.171622+0000","last_undegraded":"2024-05-03T16:45:06.171622+0000","last_fullsized":"2024-05-03T16:45:06.171622+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:35:39.571574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:24.588060+0000","last_change":"2024-05-03T16:44:06.024989+0000","last_active":"2024-05-03T16:45:24.588060+0000","last_peered":"2024-05-03T16:45:24.588060+0000","last_clean":"2024-05-03T16:45:24.588060+0000","last_became_active":"2024-05-03T16:44:06.023623+0000","last_became_peered":"2024-05-03T16:44:06.023623+0000","last_unstale":"2024-05-03T16:45:24.588060+0000","last_undegraded":"2024-05-03T16:45:24.588060+0000","last_fullsized":"2024-05-03T16:45:24.588060+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:24:25.516820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.103216+0000","last_change":"2024-05-03T16:44:11.088212+0000","last_active":"2024-05-03T16:45:06.103216+0000","last_peered":"2024-05-03T16:45:06.103216+0000","last_clean":"2024-05-03T16:45:06.103216+0000","last_became_active":"2024-05-03T16:44:11.087737+0000","last_became_peered":"2024-05-03T16:44:11.087737+0000","last_unstale":"2024-05-03T16:45:06.103216+0000","last_undegraded":"2024-05-03T16:45:06.103216+0000","last_fullsized":"2024-05-03T16:45:06.103216+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:41:45.422664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.628680+0000","last_change":"2024-05-03T16:43:51.837762+0000","last_active":"2024-05-03T16:45:27.628680+0000","last_peered":"2024-05-03T16:45:27.628680+0000","last_clean":"2024-05-03T16:45:27.628680+0000","last_became_active":"2024-05-03T16:43:51.837310+0000","last_became_peered":"2024-05-03T16:43:51.837310+0000","last_unstale":"2024-05-03T16:45:27.628680+0000","last_undegraded":"2024-05-03T16:45:27.628680+0000","last_fullsized":"2024-05-03T16:45:27.628680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:34:51.983691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173544+0000","last_change":"2024-05-03T16:43:55.937607+0000","last_active":"2024-05-03T16:45:06.173544+0000","last_peered":"2024-05-03T16:45:06.173544+0000","last_clean":"2024-05-03T16:45:06.173544+0000","last_became_active":"2024-05-03T16:43:55.937166+0000","last_became_peered":"2024-05-03T16:43:55.937166+0000","last_unstale":"2024-05-03T16:45:06.173544+0000","last_undegraded":"2024-05-03T16:45:06.173544+0000","last_fullsized":"2024-05-03T16:45:06.173544+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:03:29.121718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172123+0000","last_change":"2024-05-03T16:44:11.109641+0000","last_active":"2024-05-03T16:45:06.172123+0000","last_peered":"2024-05-03T16:45:06.172123+0000","last_clean":"2024-05-03T16:45:06.172123+0000","last_became_active":"2024-05-03T16:44:11.109118+0000","last_became_peered":"2024-05-03T16:44:11.109118+0000","last_unstale":"2024-05-03T16:45:06.172123+0000","last_undegraded":"2024-05-03T16:45:06.172123+0000","last_fullsized":"2024-05-03T16:45:06.172123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:23:37.879612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'14","reported_seq":58,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:49.972770+0000","last_change":"2024-05-03T16:43:51.816440+0000","last_active":"2024-05-03T16:45:49.972770+0000","last_peered":"2024-05-03T16:45:49.972770+0000","last_clean":"2024-05-03T16:45:49.972770+0000","last_became_active":"2024-05-03T16:43:51.815952+0000","last_became_peered":"2024-05-03T16:43:51.815952+0000","last_unstale":"2024-05-03T16:45:49.972770+0000","last_undegraded":"2024-05-03T16:45:49.972770+0000","last_fullsized":"2024-05-03T16:45:49.972770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:10:51.461550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175387+0000","last_change":"2024-05-03T16:43:55.952685+0000","last_active":"2024-05-03T16:45:06.175387+0000","last_peered":"2024-05-03T16:45:06.175387+0000","last_clean":"2024-05-03T16:45:06.175387+0000","last_became_active":"2024-05-03T16:43:55.952199+0000","last_became_peered":"2024-05-03T16:43:55.952199+0000","last_unstale":"2024-05-03T16:45:06.175387+0000","last_undegraded":"2024-05-03T16:45:06.175387+0000","last_fullsized":"2024-05-03T16:45:06.175387+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:26:01.716190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.098383+0000","last_change":"2024-05-03T16:44:11.084880+0000","last_active":"2024-05-03T16:45:06.098383+0000","last_peered":"2024-05-03T16:45:06.098383+0000","last_clean":"2024-05-03T16:45:06.098383+0000","last_became_active":"2024-05-03T16:44:11.084334+0000","last_became_peered":"2024-05-03T16:44:11.084334+0000","last_unstale":"2024-05-03T16:45:06.098383+0000","last_undegraded":"2024-05-03T16:45:06.098383+0000","last_fullsized":"2024-05-03T16:45:06.098383+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:38:01.884575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.627692+0000","last_change":"2024-05-03T16:43:51.824420+0000","last_active":"2024-05-03T16:45:26.627692+0000","last_peered":"2024-05-03T16:45:26.627692+0000","last_clean":"2024-05-03T16:45:26.627692+0000","last_became_active":"2024-05-03T16:43:51.820522+0000","last_became_peered":"2024-05-03T16:43:51.820522+0000","last_unstale":"2024-05-03T16:45:26.627692+0000","last_undegraded":"2024-05-03T16:45:26.627692+0000","last_fullsized":"2024-05-03T16:45:26.627692+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:54:29.537068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171170+0000","last_change":"2024-05-03T16:43:55.937107+0000","last_active":"2024-05-03T16:45:06.171170+0000","last_peered":"2024-05-03T16:45:06.171170+0000","last_clean":"2024-05-03T16:45:06.171170+0000","last_became_active":"2024-05-03T16:43:55.936801+0000","last_became_peered":"2024-05-03T16:43:55.936801+0000","last_unstale":"2024-05-03T16:45:06.171170+0000","last_undegraded":"2024-05-03T16:45:06.171170+0000","last_fullsized":"2024-05-03T16:45:06.171170+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:02:45.520881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.114420+0000","last_change":"2024-05-03T16:45:06.114420+0000","last_active":"2024-05-03T16:45:06.114420+0000","last_peered":"2024-05-03T16:45:06.114420+0000","last_clean":"2024-05-03T16:45:06.114420+0000","last_became_active":"2024-05-03T16:45:06.113345+0000","last_became_peered":"2024-05-03T16:45:06.113345+0000","last_unstale":"2024-05-03T16:45:06.114420+0000","last_undegraded":"2024-05-03T16:45:06.114420+0000","last_fullsized":"2024-05-03T16:45:06.114420+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:44:04.899008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:23.576810+0000","last_change":"2024-05-03T16:43:51.836247+0000","last_active":"2024-05-03T16:45:23.576810+0000","last_peered":"2024-05-03T16:45:23.576810+0000","last_clean":"2024-05-03T16:45:23.576810+0000","last_became_active":"2024-05-03T16:43:51.835877+0000","last_became_peered":"2024-05-03T16:43:51.835877+0000","last_unstale":"2024-05-03T16:45:23.576810+0000","last_undegraded":"2024-05-03T16:45:23.576810+0000","last_fullsized":"2024-05-03T16:45:23.576810+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:58:29.774976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.108953+0000","last_change":"2024-05-03T16:43:55.947689+0000","last_active":"2024-05-03T16:45:06.108953+0000","last_peered":"2024-05-03T16:45:06.108953+0000","last_clean":"2024-05-03T16:45:06.108953+0000","last_became_active":"2024-05-03T16:43:55.947228+0000","last_became_peered":"2024-05-03T16:43:55.947228+0000","last_unstale":"2024-05-03T16:45:06.108953+0000","last_undegraded":"2024-05-03T16:45:06.108953+0000","last_fullsized":"2024-05-03T16:45:06.108953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:09:17.595952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.179884+0000","last_change":"2024-05-03T16:45:06.179884+0000","last_active":"2024-05-03T16:45:06.179884+0000","last_peered":"2024-05-03T16:45:06.179884+0000","last_clean":"2024-05-03T16:45:06.179884+0000","last_became_active":"2024-05-03T16:45:06.178568+0000","last_became_peered":"2024-05-03T16:45:06.178568+0000","last_unstale":"2024-05-03T16:45:06.179884+0000","last_undegraded":"2024-05-03T16:45:06.179884+0000","last_fullsized":"2024-05-03T16:45:06.179884+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:10:00.693492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.623789+0000","last_change":"2024-05-03T16:43:51.821131+0000","last_active":"2024-05-03T16:45:26.623789+0000","last_peered":"2024-05-03T16:45:26.623789+0000","last_clean":"2024-05-03T16:45:26.623789+0000","last_became_active":"2024-05-03T16:43:51.817423+0000","last_became_peered":"2024-05-03T16:43:51.817423+0000","last_unstale":"2024-05-03T16:45:26.623789+0000","last_undegraded":"2024-05-03T16:45:26.623789+0000","last_fullsized":"2024-05-03T16:45:26.623789+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:00:34.387262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.103922+0000","last_change":"2024-05-03T16:43:55.944671+0000","last_active":"2024-05-03T16:45:06.103922+0000","last_peered":"2024-05-03T16:45:06.103922+0000","last_clean":"2024-05-03T16:45:06.103922+0000","last_became_active":"2024-05-03T16:43:55.943854+0000","last_became_peered":"2024-05-03T16:43:55.943854+0000","last_unstale":"2024-05-03T16:45:06.103922+0000","last_undegraded":"2024-05-03T16:45:06.103922+0000","last_fullsized":"2024-05-03T16:45:06.103922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:57:10.809133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.107682+0000","last_change":"2024-05-03T16:44:11.092702+0000","last_active":"2024-05-03T16:45:06.107682+0000","last_peered":"2024-05-03T16:45:06.107682+0000","last_clean":"2024-05-03T16:45:06.107682+0000","last_became_active":"2024-05-03T16:44:11.091351+0000","last_became_peered":"2024-05-03T16:44:11.091351+0000","last_unstale":"2024-05-03T16:45:06.107682+0000","last_undegraded":"2024-05-03T16:45:06.107682+0000","last_fullsized":"2024-05-03T16:45:06.107682+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:06:58.227501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"91'3","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:25.605731+0000","last_change":"2024-05-03T16:43:51.822538+0000","last_active":"2024-05-03T16:45:25.605731+0000","last_peered":"2024-05-03T16:45:25.605731+0000","last_clean":"2024-05-03T16:45:25.605731+0000","last_became_active":"2024-05-03T16:43:51.821210+0000","last_became_peered":"2024-05-03T16:43:51.821210+0000","last_unstale":"2024-05-03T16:45:25.605731+0000","last_undegraded":"2024-05-03T16:45:25.605731+0000","last_fullsized":"2024-05-03T16:45:25.605731+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:29:00.377196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.174169+0000","last_change":"2024-05-03T16:43:55.943752+0000","last_active":"2024-05-03T16:45:06.174169+0000","last_peered":"2024-05-03T16:45:06.174169+0000","last_clean":"2024-05-03T16:45:06.174169+0000","last_became_active":"2024-05-03T16:43:55.943406+0000","last_became_peered":"2024-05-03T16:43:55.943406+0000","last_unstale":"2024-05-03T16:45:06.174169+0000","last_undegraded":"2024-05-03T16:45:06.174169+0000","last_fullsized":"2024-05-03T16:45:06.174169+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:47:25.753453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.107633+0000","last_change":"2024-05-03T16:44:11.111510+0000","last_active":"2024-05-03T16:45:06.107633+0000","last_peered":"2024-05-03T16:45:06.107633+0000","last_clean":"2024-05-03T16:45:06.107633+0000","last_became_active":"2024-05-03T16:44:11.110913+0000","last_became_peered":"2024-05-03T16:44:11.110913+0000","last_unstale":"2024-05-03T16:45:06.107633+0000","last_undegraded":"2024-05-03T16:45:06.107633+0000","last_fullsized":"2024-05-03T16:45:06.107633+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:04:43.435364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:23.579296+0000","last_change":"2024-05-03T16:43:51.819283+0000","last_active":"2024-05-03T16:45:23.579296+0000","last_peered":"2024-05-03T16:45:23.579296+0000","last_clean":"2024-05-03T16:45:23.579296+0000","last_became_active":"2024-05-03T16:43:51.818775+0000","last_became_peered":"2024-05-03T16:43:51.818775+0000","last_unstale":"2024-05-03T16:45:23.579296+0000","last_undegraded":"2024-05-03T16:45:23.579296+0000","last_fullsized":"2024-05-03T16:45:23.579296+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:01:42.363340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170640+0000","last_change":"2024-05-03T16:43:55.946633+0000","last_active":"2024-05-03T16:45:06.170640+0000","last_peered":"2024-05-03T16:45:06.170640+0000","last_clean":"2024-05-03T16:45:06.170640+0000","last_became_active":"2024-05-03T16:43:55.946325+0000","last_became_peered":"2024-05-03T16:43:55.946325+0000","last_unstale":"2024-05-03T16:45:06.170640+0000","last_undegraded":"2024-05-03T16:45:06.170640+0000","last_fullsized":"2024-05-03T16:45:06.170640+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:10:54.280667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099461+0000","last_change":"2024-05-03T16:44:11.089589+0000","last_active":"2024-05-03T16:45:06.099461+0000","last_peered":"2024-05-03T16:45:06.099461+0000","last_clean":"2024-05-03T16:45:06.099461+0000","last_became_active":"2024-05-03T16:44:11.088901+0000","last_became_peered":"2024-05-03T16:44:11.088901+0000","last_unstale":"2024-05-03T16:45:06.099461+0000","last_undegraded":"2024-05-03T16:45:06.099461+0000","last_fullsized":"2024-05-03T16:45:06.099461+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:03:07.587439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'5","reported_seq":81,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:55.720225+0000","last_change":"2024-05-03T16:43:51.840062+0000","last_active":"2024-05-03T16:45:55.720225+0000","last_peered":"2024-05-03T16:45:55.720225+0000","last_clean":"2024-05-03T16:45:55.720225+0000","last_became_active":"2024-05-03T16:43:51.839544+0000","last_became_peered":"2024-05-03T16:43:51.839544+0000","last_unstale":"2024-05-03T16:45:55.720225+0000","last_undegraded":"2024-05-03T16:45:55.720225+0000","last_fullsized":"2024-05-03T16:45:55.720225+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:37:21.719418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171713+0000","last_change":"2024-05-03T16:43:55.945655+0000","last_active":"2024-05-03T16:45:06.171713+0000","last_peered":"2024-05-03T16:45:06.171713+0000","last_clean":"2024-05-03T16:45:06.171713+0000","last_became_active":"2024-05-03T16:43:55.945263+0000","last_became_peered":"2024-05-03T16:43:55.945263+0000","last_unstale":"2024-05-03T16:45:06.171713+0000","last_undegraded":"2024-05-03T16:45:06.171713+0000","last_fullsized":"2024-05-03T16:45:06.171713+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:33:19.927686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169819+0000","last_change":"2024-05-03T16:44:11.090589+0000","last_active":"2024-05-03T16:45:06.169819+0000","last_peered":"2024-05-03T16:45:06.169819+0000","last_clean":"2024-05-03T16:45:06.169819+0000","last_became_active":"2024-05-03T16:44:11.087981+0000","last_became_peered":"2024-05-03T16:44:11.087981+0000","last_unstale":"2024-05-03T16:45:06.169819+0000","last_undegraded":"2024-05-03T16:45:06.169819+0000","last_fullsized":"2024-05-03T16:45:06.169819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:43:29.953670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.629813+0000","last_change":"2024-05-03T16:43:51.829334+0000","last_active":"2024-05-03T16:45:26.629813+0000","last_peered":"2024-05-03T16:45:26.629813+0000","last_clean":"2024-05-03T16:45:26.629813+0000","last_became_active":"2024-05-03T16:43:51.828816+0000","last_became_peered":"2024-05-03T16:43:51.828816+0000","last_unstale":"2024-05-03T16:45:26.629813+0000","last_undegraded":"2024-05-03T16:45:26.629813+0000","last_fullsized":"2024-05-03T16:45:26.629813+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:54:31.996256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170424+0000","last_change":"2024-05-03T16:43:55.942732+0000","last_active":"2024-05-03T16:45:06.170424+0000","last_peered":"2024-05-03T16:45:06.170424+0000","last_clean":"2024-05-03T16:45:06.170424+0000","last_became_active":"2024-05-03T16:43:55.941445+0000","last_became_peered":"2024-05-03T16:43:55.941445+0000","last_unstale":"2024-05-03T16:45:06.170424+0000","last_undegraded":"2024-05-03T16:45:06.170424+0000","last_fullsized":"2024-05-03T16:45:06.170424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:04:58.351184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169422+0000","last_change":"2024-05-03T16:44:11.085542+0000","last_active":"2024-05-03T16:45:06.169422+0000","last_peered":"2024-05-03T16:45:06.169422+0000","last_clean":"2024-05-03T16:45:06.169422+0000","last_became_active":"2024-05-03T16:44:11.082930+0000","last_became_peered":"2024-05-03T16:44:11.082930+0000","last_unstale":"2024-05-03T16:45:06.169422+0000","last_undegraded":"2024-05-03T16:45:06.169422+0000","last_fullsized":"2024-05-03T16:45:06.169422+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T16:44:37.617445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.623205+0000","last_change":"2024-05-03T16:43:51.820087+0000","last_active":"2024-05-03T16:45:26.623205+0000","last_peered":"2024-05-03T16:45:26.623205+0000","last_clean":"2024-05-03T16:45:26.623205+0000","last_became_active":"2024-05-03T16:43:51.819325+0000","last_became_peered":"2024-05-03T16:43:51.819325+0000","last_unstale":"2024-05-03T16:45:26.623205+0000","last_undegraded":"2024-05-03T16:45:26.623205+0000","last_fullsized":"2024-05-03T16:45:26.623205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:56:38.593149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171795+0000","last_change":"2024-05-03T16:43:55.952515+0000","last_active":"2024-05-03T16:45:06.171795+0000","last_peered":"2024-05-03T16:45:06.171795+0000","last_clean":"2024-05-03T16:45:06.171795+0000","last_became_active":"2024-05-03T16:43:55.951685+0000","last_became_peered":"2024-05-03T16:43:55.951685+0000","last_unstale":"2024-05-03T16:45:06.171795+0000","last_undegraded":"2024-05-03T16:45:06.171795+0000","last_fullsized":"2024-05-03T16:45:06.171795+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:14:03.935407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104956+0000","last_change":"2024-05-03T16:43:55.944993+0000","last_active":"2024-05-03T16:45:06.104956+0000","last_peered":"2024-05-03T16:45:06.104956+0000","last_clean":"2024-05-03T16:45:06.104956+0000","last_became_active":"2024-05-03T16:43:55.944364+0000","last_became_peered":"2024-05-03T16:43:55.944364+0000","last_unstale":"2024-05-03T16:45:06.104956+0000","last_undegraded":"2024-05-03T16:45:06.104956+0000","last_fullsized":"2024-05-03T16:45:06.104956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:35:15.711248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.098707+0000","last_change":"2024-05-03T16:43:55.947596+0000","last_active":"2024-05-03T16:45:06.098707+0000","last_peered":"2024-05-03T16:45:06.098707+0000","last_clean":"2024-05-03T16:45:06.098707+0000","last_became_active":"2024-05-03T16:43:55.946217+0000","last_became_peered":"2024-05-03T16:43:55.946217+0000","last_unstale":"2024-05-03T16:45:06.098707+0000","last_undegraded":"2024-05-03T16:45:06.098707+0000","last_fullsized":"2024-05-03T16:45:06.098707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:09:07.005119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.098570+0000","last_change":"2024-05-03T16:43:55.940952+0000","last_active":"2024-05-03T16:45:06.098570+0000","last_peered":"2024-05-03T16:45:06.098570+0000","last_clean":"2024-05-03T16:45:06.098570+0000","last_became_active":"2024-05-03T16:43:55.940110+0000","last_became_peered":"2024-05-03T16:43:55.940110+0000","last_unstale":"2024-05-03T16:45:06.098570+0000","last_undegraded":"2024-05-03T16:45:06.098570+0000","last_fullsized":"2024-05-03T16:45:06.098570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:50:27.229267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170630+0000","last_change":"2024-05-03T16:43:55.936616+0000","last_active":"2024-05-03T16:45:06.170630+0000","last_peered":"2024-05-03T16:45:06.170630+0000","last_clean":"2024-05-03T16:45:06.170630+0000","last_became_active":"2024-05-03T16:43:55.936289+0000","last_became_peered":"2024-05-03T16:43:55.936289+0000","last_unstale":"2024-05-03T16:45:06.170630+0000","last_undegraded":"2024-05-03T16:45:06.170630+0000","last_fullsized":"2024-05-03T16:45:06.170630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:32:41.424346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173692+0000","last_change":"2024-05-03T16:43:55.932302+0000","last_active":"2024-05-03T16:45:06.173692+0000","last_peered":"2024-05-03T16:45:06.173692+0000","last_clean":"2024-05-03T16:45:06.173692+0000","last_became_active":"2024-05-03T16:43:55.931819+0000","last_became_peered":"2024-05-03T16:43:55.931819+0000","last_unstale":"2024-05-03T16:45:06.173692+0000","last_undegraded":"2024-05-03T16:45:06.173692+0000","last_fullsized":"2024-05-03T16:45:06.173692+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:25:02.644191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104442+0000","last_change":"2024-05-03T16:43:55.942873+0000","last_active":"2024-05-03T16:45:06.104442+0000","last_peered":"2024-05-03T16:45:06.104442+0000","last_clean":"2024-05-03T16:45:06.104442+0000","last_became_active":"2024-05-03T16:43:55.942546+0000","last_became_peered":"2024-05-03T16:43:55.942546+0000","last_unstale":"2024-05-03T16:45:06.104442+0000","last_undegraded":"2024-05-03T16:45:06.104442+0000","last_fullsized":"2024-05-03T16:45:06.104442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:24:07.111976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099757+0000","last_change":"2024-05-03T16:43:55.939764+0000","last_active":"2024-05-03T16:45:06.099757+0000","last_peered":"2024-05-03T16:45:06.099757+0000","last_clean":"2024-05-03T16:45:06.099757+0000","last_became_active":"2024-05-03T16:43:55.939362+0000","last_became_peered":"2024-05-03T16:43:55.939362+0000","last_unstale":"2024-05-03T16:45:06.099757+0000","last_undegraded":"2024-05-03T16:45:06.099757+0000","last_fullsized":"2024-05-03T16:45:06.099757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:06:27.624159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175862+0000","last_change":"2024-05-03T16:43:55.935974+0000","last_active":"2024-05-03T16:45:06.175862+0000","last_peered":"2024-05-03T16:45:06.175862+0000","last_clean":"2024-05-03T16:45:06.175862+0000","last_became_active":"2024-05-03T16:43:55.935582+0000","last_became_peered":"2024-05-03T16:43:55.935582+0000","last_unstale":"2024-05-03T16:45:06.175862+0000","last_undegraded":"2024-05-03T16:45:06.175862+0000","last_fullsized":"2024-05-03T16:45:06.175862+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:48:18.420037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169977+0000","last_change":"2024-05-03T16:43:55.938992+0000","last_active":"2024-05-03T16:45:06.169977+0000","last_peered":"2024-05-03T16:45:06.169977+0000","last_clean":"2024-05-03T16:45:06.169977+0000","last_became_active":"2024-05-03T16:43:55.938614+0000","last_became_peered":"2024-05-03T16:43:55.938614+0000","last_unstale":"2024-05-03T16:45:06.169977+0000","last_undegraded":"2024-05-03T16:45:06.169977+0000","last_fullsized":"2024-05-03T16:45:06.169977+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:18:44.830231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173344+0000","last_change":"2024-05-03T16:43:55.949381+0000","last_active":"2024-05-03T16:45:06.173344+0000","last_peered":"2024-05-03T16:45:06.173344+0000","last_clean":"2024-05-03T16:45:06.173344+0000","last_became_active":"2024-05-03T16:43:55.948536+0000","last_became_peered":"2024-05-03T16:43:55.948536+0000","last_unstale":"2024-05-03T16:45:06.173344+0000","last_undegraded":"2024-05-03T16:45:06.173344+0000","last_fullsized":"2024-05-03T16:45:06.173344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:27:17.081023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.100103+0000","last_change":"2024-05-03T16:43:55.936682+0000","last_active":"2024-05-03T16:45:06.100103+0000","last_peered":"2024-05-03T16:45:06.100103+0000","last_clean":"2024-05-03T16:45:06.100103+0000","last_became_active":"2024-05-03T16:43:55.936338+0000","last_became_peered":"2024-05-03T16:43:55.936338+0000","last_unstale":"2024-05-03T16:45:06.100103+0000","last_undegraded":"2024-05-03T16:45:06.100103+0000","last_fullsized":"2024-05-03T16:45:06.100103+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:15:21.824271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.174201+0000","last_change":"2024-05-03T16:43:55.938357+0000","last_active":"2024-05-03T16:45:06.174201+0000","last_peered":"2024-05-03T16:45:06.174201+0000","last_clean":"2024-05-03T16:45:06.174201+0000","last_became_active":"2024-05-03T16:43:55.938027+0000","last_became_peered":"2024-05-03T16:43:55.938027+0000","last_unstale":"2024-05-03T16:45:06.174201+0000","last_undegraded":"2024-05-03T16:45:06.174201+0000","last_fullsized":"2024-05-03T16:45:06.174201+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:03:03.537274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.105194+0000","last_change":"2024-05-03T16:43:55.944296+0000","last_active":"2024-05-03T16:45:06.105194+0000","last_peered":"2024-05-03T16:45:06.105194+0000","last_clean":"2024-05-03T16:45:06.105194+0000","last_became_active":"2024-05-03T16:43:55.943844+0000","last_became_peered":"2024-05-03T16:43:55.943844+0000","last_unstale":"2024-05-03T16:45:06.105194+0000","last_undegraded":"2024-05-03T16:45:06.105194+0000","last_fullsized":"2024-05-03T16:45:06.105194+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:50:25.594951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60940,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":368,"num_read_kb":253,"num_write":243,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":616,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":182820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645356,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":525657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841586,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28716,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716436,"statfs":{"total":95995035648,"available":95965630464,"internally_reserved":0,"allocated":1740800,"data_stored":1166532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005114,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32232,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712920,"statfs":{"total":95995035648,"available":95962030080,"internally_reserved":0,"allocated":1081344,"data_stored":529615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201344,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":525225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430281,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28648,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716504,"statfs":{"total":95995035648,"available":95965700096,"internally_reserved":0,"allocated":1671168,"data_stored":1122394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593807,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":521414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1122304,"data_stored":577193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738489,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":522479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411434,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32268,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712884,"statfs":{"total":95995035648,"available":95961993216,"internally_reserved":0,"allocated":1118208,"data_stored":575710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149794,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1064960,"data_stored":520731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953565,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1069056,"data_stored":525769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790039,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32816,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712336,"statfs":{"total":95995035648,"available":95961432064,"internally_reserved":0,"allocated":1679360,"data_stored":1117585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":56892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":55409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":55863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-03T16:46:05.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-03T16:46:05.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:04 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:05.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:04 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:05.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:04 smithi134 ceph-mon[31708]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T16:46:05.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:05.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:04 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:05.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:04 smithi081 ceph-mon[28640]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T16:46:05.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:04 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:05.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:04 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:05.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:04 smithi146 ceph-mon[32357]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T16:46:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:06.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:05 smithi134 ceph-mon[31708]: pgmap v441: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-03T16:46:06.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:05 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:46:06.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:05 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:46:06.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:05 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:06.229 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:05 smithi081 ceph-mon[28640]: pgmap v441: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-03T16:46:06.229 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:46:06.229 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:46:06.229 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:05 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:06.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:05 smithi146 ceph-mon[32357]: pgmap v441: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-03T16:46:06.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:05 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:46:06.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:05 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:46:06.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:05 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:46:07.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.932+0000 7f70de600700 1 -- 172.21.15.81:0/311573311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d8105f90 msgr2=0x7f70d81124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:07.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.932+0000 7f70de600700 1 --2- 172.21.15.81:0/311573311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d8105f90 0x7f70d81124a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f70d000b0a0 tx=0x7f70d000b3b0 comp rx=0 tx=0).stop 2024-05-03T16:46:07.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.932+0000 7f70de600700 1 -- 172.21.15.81:0/311573311 shutdown_connections 2024-05-03T16:46:07.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.932+0000 7f70de600700 1 --2- 172.21.15.81:0/311573311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d8105f90 0x7f70d81124a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:07.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.932+0000 7f70de600700 1 --2- 172.21.15.81:0/311573311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70d810b660 0x7f70d810ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:07.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.932+0000 7f70de600700 1 --2- 172.21.15.81:0/311573311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70d81055d0 0x7f70d8105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:07.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.932+0000 7f70de600700 1 -- 172.21.15.81:0/311573311 >> 172.21.15.81:0/311573311 conn(0x7f70d81010c0 msgr2=0x7f70d81034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:07.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.932+0000 7f70de600700 1 -- 172.21.15.81:0/311573311 shutdown_connections 2024-05-03T16:46:07.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.932+0000 7f70de600700 1 -- 172.21.15.81:0/311573311 wait complete. 2024-05-03T16:46:07.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.933+0000 7f70de600700 1 Processor -- start 2024-05-03T16:46:07.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.933+0000 7f70de600700 1 -- start start 2024-05-03T16:46:07.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.934+0000 7f70de600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70d81055d0 0x7f70d81a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:07.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.934+0000 7f70de600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70d8105f90 0x7f70d81a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:07.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.934+0000 7f70de600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d810b660 0x7f70d819b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:07.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.934+0000 7f70de600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f70d8115660 con 0x7f70d810b660 2024-05-03T16:46:07.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.934+0000 7f70de600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f70d81154e0 con 0x7f70d81055d0 2024-05-03T16:46:07.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.934+0000 7f70de600700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f70d81157e0 con 0x7f70d8105f90 2024-05-03T16:46:07.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.934+0000 7f70ddc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d810b660 0x7f70d819b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:07.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.934+0000 7f70ddc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d810b660 0x7f70d819b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54262/0 (socket says 172.21.15.81:54262) 2024-05-03T16:46:07.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.934+0000 7f70ddc00700 1 -- 172.21.15.81:0/3150474008 learned_addr learned my addr 172.21.15.81:0/3150474008 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:46:07.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.934+0000 7f70d7e00700 1 --2- 172.21.15.81:0/3150474008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70d8105f90 0x7f70d81a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:07.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.934+0000 7f70dd200700 1 --2- 172.21.15.81:0/3150474008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70d81055d0 0x7f70d81a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:07.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.935+0000 7f70ddc00700 1 -- 172.21.15.81:0/3150474008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70d8105f90 msgr2=0x7f70d81a1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:07.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.935+0000 7f70ddc00700 1 --2- 172.21.15.81:0/3150474008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70d8105f90 0x7f70d81a1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:07.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.935+0000 7f70ddc00700 1 -- 172.21.15.81:0/3150474008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70d81055d0 msgr2=0x7f70d81a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:07.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.935+0000 7f70ddc00700 1 --2- 172.21.15.81:0/3150474008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70d81055d0 0x7f70d81a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:07.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.935+0000 7f70ddc00700 1 -- 172.21.15.81:0/3150474008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d819bfc0 con 0x7f70d810b660 2024-05-03T16:46:07.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.935+0000 7f70ddc00700 1 --2- 172.21.15.81:0/3150474008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d810b660 0x7f70d819b7e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f70d00062a0 tx=0x7f70d0004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:07.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.935+0000 7f70d5600700 1 -- 172.21.15.81:0/3150474008 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d0021070 con 0x7f70d810b660 2024-05-03T16:46:07.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.935+0000 7f70d5600700 1 -- 172.21.15.81:0/3150474008 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70d0007d00 con 0x7f70d810b660 2024-05-03T16:46:07.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.935+0000 7f70de600700 1 -- 172.21.15.81:0/3150474008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d819c250 con 0x7f70d810b660 2024-05-03T16:46:07.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.935+0000 7f70d5600700 1 -- 172.21.15.81:0/3150474008 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d0005280 con 0x7f70d810b660 2024-05-03T16:46:07.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.936+0000 7f70de600700 1 -- 172.21.15.81:0/3150474008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d81a8470 con 0x7f70d810b660 2024-05-03T16:46:07.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.937+0000 7f70de600700 1 -- 172.21.15.81:0/3150474008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70d8106d10 con 0x7f70d810b660 2024-05-03T16:46:07.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.939+0000 7f70d5600700 1 -- 172.21.15.81:0/3150474008 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f70d0024070 con 0x7f70d810b660 2024-05-03T16:46:07.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.941+0000 7f70d5600700 1 --2- 172.21.15.81:0/3150474008 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f70c00b2910 0x7f70c00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:07.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.941+0000 7f70d5600700 1 -- 172.21.15.81:0/3150474008 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f70d000f020 con 0x7f70d810b660 2024-05-03T16:46:07.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.941+0000 7f70dd200700 1 --2- 172.21.15.81:0/3150474008 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f70c00b2910 0x7f70c00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:07.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.942+0000 7f70dd200700 1 --2- 172.21.15.81:0/3150474008 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f70c00b2910 0x7f70c00b4dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f70cc005fd0 tx=0x7f70cc005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:07.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:07.944+0000 7f70d5600700 1 -- 172.21.15.81:0/3150474008 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f70d002b020 con 0x7f70d810b660 2024-05-03T16:46:08.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:08.172+0000 7f70de600700 1 -- 172.21.15.81:0/3150474008 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f70d819ccc0 con 0x7f70c00b2910 2024-05-03T16:46:08.175 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:07 smithi081 ceph-mon[28640]: pgmap v442: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-03T16:46:08.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:08.201+0000 7f70d5600700 1 -- 172.21.15.81:0/3150474008 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340402 (secure 0 0 0) 0x7f70d819ccc0 con 0x7f70c00b2910 2024-05-03T16:46:08.209 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:46:08.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:08.209+0000 7f70de600700 1 -- 172.21.15.81:0/3150474008 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f70c00b2910 msgr2=0x7f70c00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:08.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:08.209+0000 7f70de600700 1 --2- 172.21.15.81:0/3150474008 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f70c00b2910 0x7f70c00b4dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f70cc005fd0 tx=0x7f70cc005e50 comp rx=0 tx=0).stop 2024-05-03T16:46:08.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:08.209+0000 7f70de600700 1 -- 172.21.15.81:0/3150474008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d810b660 msgr2=0x7f70d819b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:08.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:08.209+0000 7f70de600700 1 --2- 172.21.15.81:0/3150474008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d810b660 0x7f70d819b7e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f70d00062a0 tx=0x7f70d0004ed0 comp rx=0 tx=0).stop 2024-05-03T16:46:08.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:08.210+0000 7f70de600700 1 -- 172.21.15.81:0/3150474008 shutdown_connections 2024-05-03T16:46:08.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:08.210+0000 7f70de600700 1 --2- 172.21.15.81:0/3150474008 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f70c00b2910 0x7f70c00b4dd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:08.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:08.210+0000 7f70de600700 1 --2- 172.21.15.81:0/3150474008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d810b660 0x7f70d819b7e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:08.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:08.210+0000 7f70de600700 1 --2- 172.21.15.81:0/3150474008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70d81055d0 0x7f70d81a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:08.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:08.210+0000 7f70de600700 1 --2- 172.21.15.81:0/3150474008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70d8105f90 0x7f70d81a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:08.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:08.210+0000 7f70de600700 1 -- 172.21.15.81:0/3150474008 >> 172.21.15.81:0/3150474008 conn(0x7f70d81010c0 msgr2=0x7f70d81025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:08.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:08.210+0000 7f70de600700 1 -- 172.21.15.81:0/3150474008 shutdown_connections 2024-05-03T16:46:08.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:08.210+0000 7f70de600700 1 -- 172.21.15.81:0/3150474008 wait complete. 2024-05-03T16:46:08.213 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-03T16:46:08.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:07 smithi134 ceph-mon[31708]: pgmap v442: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-03T16:46:08.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:07 smithi146 ceph-mon[32357]: pgmap v442: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-03T16:46:09.209 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":442,"stamp":"2024-05-03T16:46:06.331354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651542,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":494,"num_read_kb":342,"num_write":368,"num_write_kb":2284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952456,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359448,"kb_used_data":14456,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124582376,"statfs":{"total":1151940427776,"available":1151572353024,"internally_reserved":0,"allocated":14802944,"data_stored":8230304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1138,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":72,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006414"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.105518+0000","last_change":"2024-05-03T16:43:55.937413+0000","last_active":"2024-05-03T16:45:06.105518+0000","last_peered":"2024-05-03T16:45:06.105518+0000","last_clean":"2024-05-03T16:45:06.105518+0000","last_became_active":"2024-05-03T16:43:55.935792+0000","last_became_peered":"2024-05-03T16:43:55.935792+0000","last_unstale":"2024-05-03T16:45:06.105518+0000","last_undegraded":"2024-05-03T16:45:06.105518+0000","last_fullsized":"2024-05-03T16:45:06.105518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:42:51.277432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170992+0000","last_change":"2024-05-03T16:43:55.950299+0000","last_active":"2024-05-03T16:45:06.170992+0000","last_peered":"2024-05-03T16:45:06.170992+0000","last_clean":"2024-05-03T16:45:06.170992+0000","last_became_active":"2024-05-03T16:43:55.948163+0000","last_became_peered":"2024-05-03T16:43:55.948163+0000","last_unstale":"2024-05-03T16:45:06.170992+0000","last_undegraded":"2024-05-03T16:45:06.170992+0000","last_fullsized":"2024-05-03T16:45:06.170992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:39:33.225914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169889+0000","last_change":"2024-05-03T16:43:55.942136+0000","last_active":"2024-05-03T16:45:06.169889+0000","last_peered":"2024-05-03T16:45:06.169889+0000","last_clean":"2024-05-03T16:45:06.169889+0000","last_became_active":"2024-05-03T16:43:55.941402+0000","last_became_peered":"2024-05-03T16:43:55.941402+0000","last_unstale":"2024-05-03T16:45:06.169889+0000","last_undegraded":"2024-05-03T16:45:06.169889+0000","last_fullsized":"2024-05-03T16:45:06.169889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:50:19.328978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.108202+0000","last_change":"2024-05-03T16:43:55.940573+0000","last_active":"2024-05-03T16:45:06.108202+0000","last_peered":"2024-05-03T16:45:06.108202+0000","last_clean":"2024-05-03T16:45:06.108202+0000","last_became_active":"2024-05-03T16:43:55.939406+0000","last_became_peered":"2024-05-03T16:43:55.939406+0000","last_unstale":"2024-05-03T16:45:06.108202+0000","last_undegraded":"2024-05-03T16:45:06.108202+0000","last_fullsized":"2024-05-03T16:45:06.108202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:29:35.290602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.108653+0000","last_change":"2024-05-03T16:43:55.937068+0000","last_active":"2024-05-03T16:45:06.108653+0000","last_peered":"2024-05-03T16:45:06.108653+0000","last_clean":"2024-05-03T16:45:06.108653+0000","last_became_active":"2024-05-03T16:43:55.934858+0000","last_became_peered":"2024-05-03T16:43:55.934858+0000","last_unstale":"2024-05-03T16:45:06.108653+0000","last_undegraded":"2024-05-03T16:45:06.108653+0000","last_fullsized":"2024-05-03T16:45:06.108653+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:50:41.839587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.105009+0000","last_change":"2024-05-03T16:43:55.936367+0000","last_active":"2024-05-03T16:45:06.105009+0000","last_peered":"2024-05-03T16:45:06.105009+0000","last_clean":"2024-05-03T16:45:06.105009+0000","last_became_active":"2024-05-03T16:43:55.936045+0000","last_became_peered":"2024-05-03T16:43:55.936045+0000","last_unstale":"2024-05-03T16:45:06.105009+0000","last_undegraded":"2024-05-03T16:45:06.105009+0000","last_fullsized":"2024-05-03T16:45:06.105009+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:34.718036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169804+0000","last_change":"2024-05-03T16:43:55.947918+0000","last_active":"2024-05-03T16:45:06.169804+0000","last_peered":"2024-05-03T16:45:06.169804+0000","last_clean":"2024-05-03T16:45:06.169804+0000","last_became_active":"2024-05-03T16:43:55.947541+0000","last_became_peered":"2024-05-03T16:43:55.947541+0000","last_unstale":"2024-05-03T16:45:06.169804+0000","last_undegraded":"2024-05-03T16:45:06.169804+0000","last_fullsized":"2024-05-03T16:45:06.169804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:11:53.101483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172748+0000","last_change":"2024-05-03T16:43:55.947104+0000","last_active":"2024-05-03T16:45:06.172748+0000","last_peered":"2024-05-03T16:45:06.172748+0000","last_clean":"2024-05-03T16:45:06.172748+0000","last_became_active":"2024-05-03T16:43:55.946733+0000","last_became_peered":"2024-05-03T16:43:55.946733+0000","last_unstale":"2024-05-03T16:45:06.172748+0000","last_undegraded":"2024-05-03T16:45:06.172748+0000","last_fullsized":"2024-05-03T16:45:06.172748+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:00:49.865951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.101894+0000","last_change":"2024-05-03T16:43:55.935238+0000","last_active":"2024-05-03T16:45:06.101894+0000","last_peered":"2024-05-03T16:45:06.101894+0000","last_clean":"2024-05-03T16:45:06.101894+0000","last_became_active":"2024-05-03T16:43:55.934821+0000","last_became_peered":"2024-05-03T16:43:55.934821+0000","last_unstale":"2024-05-03T16:45:06.101894+0000","last_undegraded":"2024-05-03T16:45:06.101894+0000","last_fullsized":"2024-05-03T16:45:06.101894+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:53:00.895000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.106705+0000","last_change":"2024-05-03T16:43:55.940084+0000","last_active":"2024-05-03T16:45:06.106705+0000","last_peered":"2024-05-03T16:45:06.106705+0000","last_clean":"2024-05-03T16:45:06.106705+0000","last_became_active":"2024-05-03T16:43:55.939788+0000","last_became_peered":"2024-05-03T16:43:55.939788+0000","last_unstale":"2024-05-03T16:45:06.106705+0000","last_undegraded":"2024-05-03T16:45:06.106705+0000","last_fullsized":"2024-05-03T16:45:06.106705+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:05:04.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171334+0000","last_change":"2024-05-03T16:43:55.941343+0000","last_active":"2024-05-03T16:45:06.171334+0000","last_peered":"2024-05-03T16:45:06.171334+0000","last_clean":"2024-05-03T16:45:06.171334+0000","last_became_active":"2024-05-03T16:43:55.940187+0000","last_became_peered":"2024-05-03T16:43:55.940187+0000","last_unstale":"2024-05-03T16:45:06.171334+0000","last_undegraded":"2024-05-03T16:45:06.171334+0000","last_fullsized":"2024-05-03T16:45:06.171334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:56:32.974369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.098277+0000","last_change":"2024-05-03T16:44:06.018850+0000","last_active":"2024-05-03T16:45:06.098277+0000","last_peered":"2024-05-03T16:45:06.098277+0000","last_clean":"2024-05-03T16:45:06.098277+0000","last_became_active":"2024-05-03T16:44:06.018311+0000","last_became_peered":"2024-05-03T16:44:06.018311+0000","last_unstale":"2024-05-03T16:45:06.098277+0000","last_undegraded":"2024-05-03T16:45:06.098277+0000","last_fullsized":"2024-05-03T16:45:06.098277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:02:09.949030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173935+0000","last_change":"2024-05-03T16:43:55.938218+0000","last_active":"2024-05-03T16:45:06.173935+0000","last_peered":"2024-05-03T16:45:06.173935+0000","last_clean":"2024-05-03T16:45:06.173935+0000","last_became_active":"2024-05-03T16:43:55.937559+0000","last_became_peered":"2024-05-03T16:43:55.937559+0000","last_unstale":"2024-05-03T16:45:06.173935+0000","last_undegraded":"2024-05-03T16:45:06.173935+0000","last_fullsized":"2024-05-03T16:45:06.173935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:59:03.766052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171415+0000","last_change":"2024-05-03T16:43:55.950325+0000","last_active":"2024-05-03T16:45:06.171415+0000","last_peered":"2024-05-03T16:45:06.171415+0000","last_clean":"2024-05-03T16:45:06.171415+0000","last_became_active":"2024-05-03T16:43:55.948615+0000","last_became_peered":"2024-05-03T16:43:55.948615+0000","last_unstale":"2024-05-03T16:45:06.171415+0000","last_undegraded":"2024-05-03T16:45:06.171415+0000","last_fullsized":"2024-05-03T16:45:06.171415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:53:06.143381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169397+0000","last_change":"2024-05-03T16:44:06.021139+0000","last_active":"2024-05-03T16:45:06.169397+0000","last_peered":"2024-05-03T16:45:06.169397+0000","last_clean":"2024-05-03T16:45:06.169397+0000","last_became_active":"2024-05-03T16:44:06.020348+0000","last_became_peered":"2024-05-03T16:44:06.020348+0000","last_unstale":"2024-05-03T16:45:06.169397+0000","last_undegraded":"2024-05-03T16:45:06.169397+0000","last_fullsized":"2024-05-03T16:45:06.169397+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:59:45.974113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.098879+0000","last_change":"2024-05-03T16:43:55.934973+0000","last_active":"2024-05-03T16:45:06.098879+0000","last_peered":"2024-05-03T16:45:06.098879+0000","last_clean":"2024-05-03T16:45:06.098879+0000","last_became_active":"2024-05-03T16:43:55.934650+0000","last_became_peered":"2024-05-03T16:43:55.934650+0000","last_unstale":"2024-05-03T16:45:06.098879+0000","last_undegraded":"2024-05-03T16:45:06.098879+0000","last_fullsized":"2024-05-03T16:45:06.098879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:17:05.164194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.106062+0000","last_change":"2024-05-03T16:43:55.937828+0000","last_active":"2024-05-03T16:45:06.106062+0000","last_peered":"2024-05-03T16:45:06.106062+0000","last_clean":"2024-05-03T16:45:06.106062+0000","last_became_active":"2024-05-03T16:43:55.936380+0000","last_became_peered":"2024-05-03T16:43:55.936380+0000","last_unstale":"2024-05-03T16:45:06.106062+0000","last_undegraded":"2024-05-03T16:45:06.106062+0000","last_fullsized":"2024-05-03T16:45:06.106062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:23:17.199501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099034+0000","last_change":"2024-05-03T16:43:55.945162+0000","last_active":"2024-05-03T16:45:06.099034+0000","last_peered":"2024-05-03T16:45:06.099034+0000","last_clean":"2024-05-03T16:45:06.099034+0000","last_became_active":"2024-05-03T16:43:55.944210+0000","last_became_peered":"2024-05-03T16:43:55.944210+0000","last_unstale":"2024-05-03T16:45:06.099034+0000","last_undegraded":"2024-05-03T16:45:06.099034+0000","last_fullsized":"2024-05-03T16:45:06.099034+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:41:57.674653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.101139+0000","last_change":"2024-05-03T16:43:55.939350+0000","last_active":"2024-05-03T16:45:06.101139+0000","last_peered":"2024-05-03T16:45:06.101139+0000","last_clean":"2024-05-03T16:45:06.101139+0000","last_became_active":"2024-05-03T16:43:55.936920+0000","last_became_peered":"2024-05-03T16:43:55.936920+0000","last_unstale":"2024-05-03T16:45:06.101139+0000","last_undegraded":"2024-05-03T16:45:06.101139+0000","last_fullsized":"2024-05-03T16:45:06.101139+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:06:00.716153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099239+0000","last_change":"2024-05-03T16:44:11.090719+0000","last_active":"2024-05-03T16:45:06.099239+0000","last_peered":"2024-05-03T16:45:06.099239+0000","last_clean":"2024-05-03T16:45:06.099239+0000","last_became_active":"2024-05-03T16:44:11.090155+0000","last_became_peered":"2024-05-03T16:44:11.090155+0000","last_unstale":"2024-05-03T16:45:06.099239+0000","last_undegraded":"2024-05-03T16:45:06.099239+0000","last_fullsized":"2024-05-03T16:45:06.099239+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:05:01.406303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'13","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:46:00.725940+0000","last_change":"2024-05-03T16:44:06.029215+0000","last_active":"2024-05-03T16:46:00.725940+0000","last_peered":"2024-05-03T16:46:00.725940+0000","last_clean":"2024-05-03T16:46:00.725940+0000","last_became_active":"2024-05-03T16:44:06.013972+0000","last_became_peered":"2024-05-03T16:44:06.013972+0000","last_unstale":"2024-05-03T16:46:00.725940+0000","last_undegraded":"2024-05-03T16:46:00.725940+0000","last_fullsized":"2024-05-03T16:46:00.725940+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:01:58.464781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099938+0000","last_change":"2024-05-03T16:44:06.023393+0000","last_active":"2024-05-03T16:45:06.099938+0000","last_peered":"2024-05-03T16:45:06.099938+0000","last_clean":"2024-05-03T16:45:06.099938+0000","last_became_active":"2024-05-03T16:44:06.022614+0000","last_became_peered":"2024-05-03T16:44:06.022614+0000","last_unstale":"2024-05-03T16:45:06.099938+0000","last_undegraded":"2024-05-03T16:45:06.099938+0000","last_fullsized":"2024-05-03T16:45:06.099938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:21:04.946792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.105733+0000","last_change":"2024-05-03T16:44:11.094113+0000","last_active":"2024-05-03T16:45:06.105733+0000","last_peered":"2024-05-03T16:45:06.105733+0000","last_clean":"2024-05-03T16:45:06.105733+0000","last_became_active":"2024-05-03T16:44:11.092499+0000","last_became_peered":"2024-05-03T16:44:11.092499+0000","last_unstale":"2024-05-03T16:45:06.105733+0000","last_undegraded":"2024-05-03T16:45:06.105733+0000","last_fullsized":"2024-05-03T16:45:06.105733+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:00:38.261341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:24.587168+0000","last_change":"2024-05-03T16:43:51.837525+0000","last_active":"2024-05-03T16:45:24.587168+0000","last_peered":"2024-05-03T16:45:24.587168+0000","last_clean":"2024-05-03T16:45:24.587168+0000","last_became_active":"2024-05-03T16:43:51.837056+0000","last_became_peered":"2024-05-03T16:43:51.837056+0000","last_unstale":"2024-05-03T16:45:24.587168+0000","last_undegraded":"2024-05-03T16:45:24.587168+0000","last_fullsized":"2024-05-03T16:45:24.587168+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:34:07.077471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170361+0000","last_change":"2024-05-03T16:43:55.933576+0000","last_active":"2024-05-03T16:45:06.170361+0000","last_peered":"2024-05-03T16:45:06.170361+0000","last_clean":"2024-05-03T16:45:06.170361+0000","last_became_active":"2024-05-03T16:43:55.932711+0000","last_became_peered":"2024-05-03T16:43:55.932711+0000","last_unstale":"2024-05-03T16:45:06.170361+0000","last_undegraded":"2024-05-03T16:45:06.170361+0000","last_fullsized":"2024-05-03T16:45:06.170361+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:35:44.769103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.106920+0000","last_change":"2024-05-03T16:44:11.093379+0000","last_active":"2024-05-03T16:45:06.106920+0000","last_peered":"2024-05-03T16:45:06.106920+0000","last_clean":"2024-05-03T16:45:06.106920+0000","last_became_active":"2024-05-03T16:44:11.091280+0000","last_became_peered":"2024-05-03T16:44:11.091280+0000","last_unstale":"2024-05-03T16:45:06.106920+0000","last_undegraded":"2024-05-03T16:45:06.106920+0000","last_fullsized":"2024-05-03T16:45:06.106920+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:20:11.987590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":57,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.616400+0000","last_change":"2024-05-03T16:43:51.820233+0000","last_active":"2024-05-03T16:45:27.616400+0000","last_peered":"2024-05-03T16:45:27.616400+0000","last_clean":"2024-05-03T16:45:27.616400+0000","last_became_active":"2024-05-03T16:43:51.818823+0000","last_became_peered":"2024-05-03T16:43:51.818823+0000","last_unstale":"2024-05-03T16:45:27.616400+0000","last_undegraded":"2024-05-03T16:45:27.616400+0000","last_fullsized":"2024-05-03T16:45:27.616400+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:48:06.135496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099413+0000","last_change":"2024-05-03T16:43:55.946298+0000","last_active":"2024-05-03T16:45:06.099413+0000","last_peered":"2024-05-03T16:45:06.099413+0000","last_clean":"2024-05-03T16:45:06.099413+0000","last_became_active":"2024-05-03T16:43:55.944228+0000","last_became_peered":"2024-05-03T16:43:55.944228+0000","last_unstale":"2024-05-03T16:45:06.099413+0000","last_undegraded":"2024-05-03T16:45:06.099413+0000","last_fullsized":"2024-05-03T16:45:06.099413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:42:50.437264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.106117+0000","last_change":"2024-05-03T16:44:11.086723+0000","last_active":"2024-05-03T16:45:06.106117+0000","last_peered":"2024-05-03T16:45:06.106117+0000","last_clean":"2024-05-03T16:45:06.106117+0000","last_became_active":"2024-05-03T16:44:11.086189+0000","last_became_peered":"2024-05-03T16:44:11.086189+0000","last_unstale":"2024-05-03T16:45:06.106117+0000","last_undegraded":"2024-05-03T16:45:06.106117+0000","last_fullsized":"2024-05-03T16:45:06.106117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:23:41.292942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.633306+0000","last_change":"2024-05-03T16:43:51.817737+0000","last_active":"2024-05-03T16:45:26.633306+0000","last_peered":"2024-05-03T16:45:26.633306+0000","last_clean":"2024-05-03T16:45:26.633306+0000","last_became_active":"2024-05-03T16:43:51.817191+0000","last_became_peered":"2024-05-03T16:43:51.817191+0000","last_unstale":"2024-05-03T16:45:26.633306+0000","last_undegraded":"2024-05-03T16:45:26.633306+0000","last_fullsized":"2024-05-03T16:45:26.633306+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:21:16.875189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.098518+0000","last_change":"2024-05-03T16:44:06.180066+0000","last_active":"2024-05-03T16:45:06.098518+0000","last_peered":"2024-05-03T16:45:06.098518+0000","last_clean":"2024-05-03T16:45:06.098518+0000","last_became_active":"2024-05-03T16:44:06.178981+0000","last_became_peered":"2024-05-03T16:44:06.178981+0000","last_unstale":"2024-05-03T16:45:06.098518+0000","last_undegraded":"2024-05-03T16:45:06.098518+0000","last_fullsized":"2024-05-03T16:45:06.098518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:18:10.683947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.100401+0000","last_change":"2024-05-03T16:44:11.092472+0000","last_active":"2024-05-03T16:45:06.100401+0000","last_peered":"2024-05-03T16:45:06.100401+0000","last_clean":"2024-05-03T16:45:06.100401+0000","last_became_active":"2024-05-03T16:44:11.091225+0000","last_became_peered":"2024-05-03T16:44:11.091225+0000","last_unstale":"2024-05-03T16:45:06.100401+0000","last_undegraded":"2024-05-03T16:45:06.100401+0000","last_fullsized":"2024-05-03T16:45:06.100401+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:24:09.194801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'5","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:46:04.740201+0000","last_change":"2024-05-03T16:44:06.180557+0000","last_active":"2024-05-03T16:46:04.740201+0000","last_peered":"2024-05-03T16:46:04.740201+0000","last_clean":"2024-05-03T16:46:04.740201+0000","last_became_active":"2024-05-03T16:44:06.179612+0000","last_became_peered":"2024-05-03T16:44:06.179612+0000","last_unstale":"2024-05-03T16:46:04.740201+0000","last_undegraded":"2024-05-03T16:46:04.740201+0000","last_fullsized":"2024-05-03T16:46:04.740201+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:39:33.469080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.109308+0000","last_change":"2024-05-03T16:43:55.942416+0000","last_active":"2024-05-03T16:45:06.109308+0000","last_peered":"2024-05-03T16:45:06.109308+0000","last_clean":"2024-05-03T16:45:06.109308+0000","last_became_active":"2024-05-03T16:43:55.942041+0000","last_became_peered":"2024-05-03T16:43:55.942041+0000","last_unstale":"2024-05-03T16:45:06.109308+0000","last_undegraded":"2024-05-03T16:45:06.109308+0000","last_fullsized":"2024-05-03T16:45:06.109308+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:40:29.384354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099884+0000","last_change":"2024-05-03T16:44:11.096209+0000","last_active":"2024-05-03T16:45:06.099884+0000","last_peered":"2024-05-03T16:45:06.099884+0000","last_clean":"2024-05-03T16:45:06.099884+0000","last_became_active":"2024-05-03T16:44:11.095724+0000","last_became_peered":"2024-05-03T16:44:11.095724+0000","last_unstale":"2024-05-03T16:45:06.099884+0000","last_undegraded":"2024-05-03T16:45:06.099884+0000","last_fullsized":"2024-05-03T16:45:06.099884+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:41:30.883988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":57,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:25.605680+0000","last_change":"2024-05-03T16:44:06.021453+0000","last_active":"2024-05-03T16:45:25.605680+0000","last_peered":"2024-05-03T16:45:25.605680+0000","last_clean":"2024-05-03T16:45:25.605680+0000","last_became_active":"2024-05-03T16:44:06.020443+0000","last_became_peered":"2024-05-03T16:44:06.020443+0000","last_unstale":"2024-05-03T16:45:25.605680+0000","last_undegraded":"2024-05-03T16:45:25.605680+0000","last_fullsized":"2024-05-03T16:45:25.605680+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:55:43.435774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171350+0000","last_change":"2024-05-03T16:43:55.938655+0000","last_active":"2024-05-03T16:45:06.171350+0000","last_peered":"2024-05-03T16:45:06.171350+0000","last_clean":"2024-05-03T16:45:06.171350+0000","last_became_active":"2024-05-03T16:43:55.938269+0000","last_became_peered":"2024-05-03T16:43:55.938269+0000","last_unstale":"2024-05-03T16:45:06.171350+0000","last_undegraded":"2024-05-03T16:45:06.171350+0000","last_fullsized":"2024-05-03T16:45:06.171350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:51:42.550932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104665+0000","last_change":"2024-05-03T16:44:11.096724+0000","last_active":"2024-05-03T16:45:06.104665+0000","last_peered":"2024-05-03T16:45:06.104665+0000","last_clean":"2024-05-03T16:45:06.104665+0000","last_became_active":"2024-05-03T16:44:11.095877+0000","last_became_peered":"2024-05-03T16:44:11.095877+0000","last_unstale":"2024-05-03T16:45:06.104665+0000","last_undegraded":"2024-05-03T16:45:06.104665+0000","last_fullsized":"2024-05-03T16:45:06.104665+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:08:46.696046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:24.589838+0000","last_change":"2024-05-03T16:43:51.818919+0000","last_active":"2024-05-03T16:45:24.589838+0000","last_peered":"2024-05-03T16:45:24.589838+0000","last_clean":"2024-05-03T16:45:24.589838+0000","last_became_active":"2024-05-03T16:43:51.817574+0000","last_became_peered":"2024-05-03T16:43:51.817574+0000","last_unstale":"2024-05-03T16:45:24.589838+0000","last_undegraded":"2024-05-03T16:45:24.589838+0000","last_fullsized":"2024-05-03T16:45:24.589838+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:18:17.335988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172429+0000","last_change":"2024-05-03T16:43:55.935647+0000","last_active":"2024-05-03T16:45:06.172429+0000","last_peered":"2024-05-03T16:45:06.172429+0000","last_clean":"2024-05-03T16:45:06.172429+0000","last_became_active":"2024-05-03T16:43:55.935266+0000","last_became_peered":"2024-05-03T16:43:55.935266+0000","last_unstale":"2024-05-03T16:45:06.172429+0000","last_undegraded":"2024-05-03T16:45:06.172429+0000","last_fullsized":"2024-05-03T16:45:06.172429+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:51:48.743197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170825+0000","last_change":"2024-05-03T16:44:11.085588+0000","last_active":"2024-05-03T16:45:06.170825+0000","last_peered":"2024-05-03T16:45:06.170825+0000","last_clean":"2024-05-03T16:45:06.170825+0000","last_became_active":"2024-05-03T16:44:11.084993+0000","last_became_peered":"2024-05-03T16:44:11.084993+0000","last_unstale":"2024-05-03T16:45:06.170825+0000","last_undegraded":"2024-05-03T16:45:06.170825+0000","last_fullsized":"2024-05-03T16:45:06.170825+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:50:42.349365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.628203+0000","last_change":"2024-05-03T16:43:51.828689+0000","last_active":"2024-05-03T16:45:26.628203+0000","last_peered":"2024-05-03T16:45:26.628203+0000","last_clean":"2024-05-03T16:45:26.628203+0000","last_became_active":"2024-05-03T16:43:51.828212+0000","last_became_peered":"2024-05-03T16:43:51.828212+0000","last_unstale":"2024-05-03T16:45:26.628203+0000","last_undegraded":"2024-05-03T16:45:26.628203+0000","last_fullsized":"2024-05-03T16:45:26.628203+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:06:18.947792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.097742+0000","last_change":"2024-05-03T16:43:55.945043+0000","last_active":"2024-05-03T16:45:06.097742+0000","last_peered":"2024-05-03T16:45:06.097742+0000","last_clean":"2024-05-03T16:45:06.097742+0000","last_became_active":"2024-05-03T16:43:55.944702+0000","last_became_peered":"2024-05-03T16:43:55.944702+0000","last_unstale":"2024-05-03T16:45:06.097742+0000","last_undegraded":"2024-05-03T16:45:06.097742+0000","last_fullsized":"2024-05-03T16:45:06.097742+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:28:51.434232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172766+0000","last_change":"2024-05-03T16:44:11.080122+0000","last_active":"2024-05-03T16:45:06.172766+0000","last_peered":"2024-05-03T16:45:06.172766+0000","last_clean":"2024-05-03T16:45:06.172766+0000","last_became_active":"2024-05-03T16:44:11.078792+0000","last_became_peered":"2024-05-03T16:44:11.078792+0000","last_unstale":"2024-05-03T16:45:06.172766+0000","last_undegraded":"2024-05-03T16:45:06.172766+0000","last_fullsized":"2024-05-03T16:45:06.172766+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:43:17.828550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'4","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:46:05.741880+0000","last_change":"2024-05-03T16:43:51.823536+0000","last_active":"2024-05-03T16:46:05.741880+0000","last_peered":"2024-05-03T16:46:05.741880+0000","last_clean":"2024-05-03T16:46:05.741880+0000","last_became_active":"2024-05-03T16:43:51.823117+0000","last_became_peered":"2024-05-03T16:43:51.823117+0000","last_unstale":"2024-05-03T16:46:05.741880+0000","last_undegraded":"2024-05-03T16:46:05.741880+0000","last_fullsized":"2024-05-03T16:46:05.741880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:50:19.990133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.102043+0000","last_change":"2024-05-03T16:43:55.945941+0000","last_active":"2024-05-03T16:45:06.102043+0000","last_peered":"2024-05-03T16:45:06.102043+0000","last_clean":"2024-05-03T16:45:06.102043+0000","last_became_active":"2024-05-03T16:43:55.945173+0000","last_became_peered":"2024-05-03T16:43:55.945173+0000","last_unstale":"2024-05-03T16:45:06.102043+0000","last_undegraded":"2024-05-03T16:45:06.102043+0000","last_fullsized":"2024-05-03T16:45:06.102043+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:39:22.185454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.097412+0000","last_change":"2024-05-03T16:44:11.090040+0000","last_active":"2024-05-03T16:45:06.097412+0000","last_peered":"2024-05-03T16:45:06.097412+0000","last_clean":"2024-05-03T16:45:06.097412+0000","last_became_active":"2024-05-03T16:44:11.089381+0000","last_became_peered":"2024-05-03T16:44:11.089381+0000","last_unstale":"2024-05-03T16:45:06.097412+0000","last_undegraded":"2024-05-03T16:45:06.097412+0000","last_fullsized":"2024-05-03T16:45:06.097412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:13:05.149205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.623147+0000","last_change":"2024-05-03T16:43:51.828726+0000","last_active":"2024-05-03T16:45:26.623147+0000","last_peered":"2024-05-03T16:45:26.623147+0000","last_clean":"2024-05-03T16:45:26.623147+0000","last_became_active":"2024-05-03T16:43:51.827302+0000","last_became_peered":"2024-05-03T16:43:51.827302+0000","last_unstale":"2024-05-03T16:45:26.623147+0000","last_undegraded":"2024-05-03T16:45:26.623147+0000","last_fullsized":"2024-05-03T16:45:26.623147+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:24:03.296019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170542+0000","last_change":"2024-05-03T16:43:55.941142+0000","last_active":"2024-05-03T16:45:06.170542+0000","last_peered":"2024-05-03T16:45:06.170542+0000","last_clean":"2024-05-03T16:45:06.170542+0000","last_became_active":"2024-05-03T16:43:55.940762+0000","last_became_peered":"2024-05-03T16:43:55.940762+0000","last_unstale":"2024-05-03T16:45:06.170542+0000","last_undegraded":"2024-05-03T16:45:06.170542+0000","last_fullsized":"2024-05-03T16:45:06.170542+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:31:38.412076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.107255+0000","last_change":"2024-05-03T16:44:11.091481+0000","last_active":"2024-05-03T16:45:06.107255+0000","last_peered":"2024-05-03T16:45:06.107255+0000","last_clean":"2024-05-03T16:45:06.107255+0000","last_became_active":"2024-05-03T16:44:11.090597+0000","last_became_peered":"2024-05-03T16:44:11.090597+0000","last_unstale":"2024-05-03T16:45:06.107255+0000","last_undegraded":"2024-05-03T16:45:06.107255+0000","last_fullsized":"2024-05-03T16:45:06.107255+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:43:09.390062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:25.605378+0000","last_change":"2024-05-03T16:43:51.837548+0000","last_active":"2024-05-03T16:45:25.605378+0000","last_peered":"2024-05-03T16:45:25.605378+0000","last_clean":"2024-05-03T16:45:25.605378+0000","last_became_active":"2024-05-03T16:43:51.837021+0000","last_became_peered":"2024-05-03T16:43:51.837021+0000","last_unstale":"2024-05-03T16:45:25.605378+0000","last_undegraded":"2024-05-03T16:45:25.605378+0000","last_fullsized":"2024-05-03T16:45:25.605378+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:26:57.384438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.100099+0000","last_change":"2024-05-03T16:43:55.933759+0000","last_active":"2024-05-03T16:45:06.100099+0000","last_peered":"2024-05-03T16:45:06.100099+0000","last_clean":"2024-05-03T16:45:06.100099+0000","last_became_active":"2024-05-03T16:43:55.933026+0000","last_became_peered":"2024-05-03T16:43:55.933026+0000","last_unstale":"2024-05-03T16:45:06.100099+0000","last_undegraded":"2024-05-03T16:45:06.100099+0000","last_fullsized":"2024-05-03T16:45:06.100099+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:28:46.898497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175789+0000","last_change":"2024-05-03T16:45:06.174763+0000","last_active":"2024-05-03T16:45:06.175789+0000","last_peered":"2024-05-03T16:45:06.175789+0000","last_clean":"2024-05-03T16:45:06.175789+0000","last_became_active":"2024-05-03T16:45:06.173268+0000","last_became_peered":"2024-05-03T16:45:06.173268+0000","last_unstale":"2024-05-03T16:45:06.175789+0000","last_undegraded":"2024-05-03T16:45:06.175789+0000","last_fullsized":"2024-05-03T16:45:06.175789+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:42:14.281298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.14","version":"91'33","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:46:05.759173+0000","last_change":"2024-05-03T16:43:51.821086+0000","last_active":"2024-05-03T16:46:05.759173+0000","last_peered":"2024-05-03T16:46:05.759173+0000","last_clean":"2024-05-03T16:46:05.759173+0000","last_became_active":"2024-05-03T16:43:51.820371+0000","last_became_peered":"2024-05-03T16:43:51.820371+0000","last_unstale":"2024-05-03T16:46:05.759173+0000","last_undegraded":"2024-05-03T16:46:05.759173+0000","last_fullsized":"2024-05-03T16:46:05.759173+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:40:51.807045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54127,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":86,"num_read_kb":96,"num_write":35,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.109227+0000","last_change":"2024-05-03T16:43:55.952946+0000","last_active":"2024-05-03T16:45:06.109227+0000","last_peered":"2024-05-03T16:45:06.109227+0000","last_clean":"2024-05-03T16:45:06.109227+0000","last_became_active":"2024-05-03T16:43:55.952587+0000","last_became_peered":"2024-05-03T16:43:55.952587+0000","last_unstale":"2024-05-03T16:45:06.109227+0000","last_undegraded":"2024-05-03T16:45:06.109227+0000","last_fullsized":"2024-05-03T16:45:06.109227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:40:24.944554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170947+0000","last_change":"2024-05-03T16:44:11.088771+0000","last_active":"2024-05-03T16:45:06.170947+0000","last_peered":"2024-05-03T16:45:06.170947+0000","last_clean":"2024-05-03T16:45:06.170947+0000","last_became_active":"2024-05-03T16:44:11.088206+0000","last_became_peered":"2024-05-03T16:44:11.088206+0000","last_unstale":"2024-05-03T16:45:06.170947+0000","last_undegraded":"2024-05-03T16:45:06.170947+0000","last_fullsized":"2024-05-03T16:45:06.170947+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:20:34.876403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.626012+0000","last_change":"2024-05-03T16:44:06.034148+0000","last_active":"2024-05-03T16:45:27.626012+0000","last_peered":"2024-05-03T16:45:27.626012+0000","last_clean":"2024-05-03T16:45:27.626012+0000","last_became_active":"2024-05-03T16:44:06.019766+0000","last_became_peered":"2024-05-03T16:44:06.019766+0000","last_unstale":"2024-05-03T16:45:27.626012+0000","last_undegraded":"2024-05-03T16:45:27.626012+0000","last_fullsized":"2024-05-03T16:45:27.626012+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:05:37.507361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172574+0000","last_change":"2024-05-03T16:43:55.935799+0000","last_active":"2024-05-03T16:45:06.172574+0000","last_peered":"2024-05-03T16:45:06.172574+0000","last_clean":"2024-05-03T16:45:06.172574+0000","last_became_active":"2024-05-03T16:43:55.935500+0000","last_became_peered":"2024-05-03T16:43:55.935500+0000","last_unstale":"2024-05-03T16:45:06.172574+0000","last_undegraded":"2024-05-03T16:45:06.172574+0000","last_fullsized":"2024-05-03T16:45:06.172574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:01:42.624823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.180000+0000","last_change":"2024-05-03T16:45:06.180000+0000","last_active":"2024-05-03T16:45:06.180000+0000","last_peered":"2024-05-03T16:45:06.180000+0000","last_clean":"2024-05-03T16:45:06.180000+0000","last_became_active":"2024-05-03T16:45:06.178226+0000","last_became_peered":"2024-05-03T16:45:06.178226+0000","last_unstale":"2024-05-03T16:45:06.180000+0000","last_undegraded":"2024-05-03T16:45:06.180000+0000","last_fullsized":"2024-05-03T16:45:06.180000+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:12:14.524002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.631154+0000","last_change":"2024-05-03T16:43:51.831435+0000","last_active":"2024-05-03T16:45:26.631154+0000","last_peered":"2024-05-03T16:45:26.631154+0000","last_clean":"2024-05-03T16:45:26.631154+0000","last_became_active":"2024-05-03T16:43:51.830857+0000","last_became_peered":"2024-05-03T16:43:51.830857+0000","last_unstale":"2024-05-03T16:45:26.631154+0000","last_undegraded":"2024-05-03T16:45:26.631154+0000","last_fullsized":"2024-05-03T16:45:26.631154+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:32:36.463798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170881+0000","last_change":"2024-05-03T16:43:55.946511+0000","last_active":"2024-05-03T16:45:06.170881+0000","last_peered":"2024-05-03T16:45:06.170881+0000","last_clean":"2024-05-03T16:45:06.170881+0000","last_became_active":"2024-05-03T16:43:55.946206+0000","last_became_peered":"2024-05-03T16:43:55.946206+0000","last_unstale":"2024-05-03T16:45:06.170881+0000","last_undegraded":"2024-05-03T16:45:06.170881+0000","last_fullsized":"2024-05-03T16:45:06.170881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:08:04.276790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099316+0000","last_change":"2024-05-03T16:44:11.087824+0000","last_active":"2024-05-03T16:45:06.099316+0000","last_peered":"2024-05-03T16:45:06.099316+0000","last_clean":"2024-05-03T16:45:06.099316+0000","last_became_active":"2024-05-03T16:44:11.087408+0000","last_became_peered":"2024-05-03T16:44:11.087408+0000","last_unstale":"2024-05-03T16:45:06.099316+0000","last_undegraded":"2024-05-03T16:45:06.099316+0000","last_fullsized":"2024-05-03T16:45:06.099316+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:18:23.334214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"91'5","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:46:03.737420+0000","last_change":"2024-05-03T16:43:51.824633+0000","last_active":"2024-05-03T16:46:03.737420+0000","last_peered":"2024-05-03T16:46:03.737420+0000","last_clean":"2024-05-03T16:46:03.737420+0000","last_became_active":"2024-05-03T16:43:51.824137+0000","last_became_peered":"2024-05-03T16:43:51.824137+0000","last_unstale":"2024-05-03T16:46:03.737420+0000","last_undegraded":"2024-05-03T16:46:03.737420+0000","last_fullsized":"2024-05-03T16:46:03.737420+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:13:25.975252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169584+0000","last_change":"2024-05-03T16:43:55.948878+0000","last_active":"2024-05-03T16:45:06.169584+0000","last_peered":"2024-05-03T16:45:06.169584+0000","last_clean":"2024-05-03T16:45:06.169584+0000","last_became_active":"2024-05-03T16:43:55.947279+0000","last_became_peered":"2024-05-03T16:43:55.947279+0000","last_unstale":"2024-05-03T16:45:06.169584+0000","last_undegraded":"2024-05-03T16:45:06.169584+0000","last_fullsized":"2024-05-03T16:45:06.169584+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:36:46.082725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175012+0000","last_change":"2024-05-03T16:44:11.096329+0000","last_active":"2024-05-03T16:45:06.175012+0000","last_peered":"2024-05-03T16:45:06.175012+0000","last_clean":"2024-05-03T16:45:06.175012+0000","last_became_active":"2024-05-03T16:44:11.091404+0000","last_became_peered":"2024-05-03T16:44:11.091404+0000","last_unstale":"2024-05-03T16:45:06.175012+0000","last_undegraded":"2024-05-03T16:45:06.175012+0000","last_fullsized":"2024-05-03T16:45:06.175012+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:09:12.688840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":62,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.630264+0000","last_change":"2024-05-03T16:43:51.837908+0000","last_active":"2024-05-03T16:45:26.630264+0000","last_peered":"2024-05-03T16:45:26.630264+0000","last_clean":"2024-05-03T16:45:26.630264+0000","last_became_active":"2024-05-03T16:43:51.837334+0000","last_became_peered":"2024-05-03T16:43:51.837334+0000","last_unstale":"2024-05-03T16:45:26.630264+0000","last_undegraded":"2024-05-03T16:45:26.630264+0000","last_fullsized":"2024-05-03T16:45:26.630264+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:08:46.480524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170127+0000","last_change":"2024-05-03T16:43:55.933729+0000","last_active":"2024-05-03T16:45:06.170127+0000","last_peered":"2024-05-03T16:45:06.170127+0000","last_clean":"2024-05-03T16:45:06.170127+0000","last_became_active":"2024-05-03T16:43:55.933211+0000","last_became_peered":"2024-05-03T16:43:55.933211+0000","last_unstale":"2024-05-03T16:45:06.170127+0000","last_undegraded":"2024-05-03T16:45:06.170127+0000","last_fullsized":"2024-05-03T16:45:06.170127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:03:38.814029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169919+0000","last_change":"2024-05-03T16:44:11.077832+0000","last_active":"2024-05-03T16:45:06.169919+0000","last_peered":"2024-05-03T16:45:06.169919+0000","last_clean":"2024-05-03T16:45:06.169919+0000","last_became_active":"2024-05-03T16:44:11.076574+0000","last_became_peered":"2024-05-03T16:44:11.076574+0000","last_unstale":"2024-05-03T16:45:06.169919+0000","last_undegraded":"2024-05-03T16:45:06.169919+0000","last_fullsized":"2024-05-03T16:45:06.169919+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:59:35.354254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:25.575049+0000","last_change":"2024-05-03T16:43:51.818391+0000","last_active":"2024-05-03T16:45:25.575049+0000","last_peered":"2024-05-03T16:45:25.575049+0000","last_clean":"2024-05-03T16:45:25.575049+0000","last_became_active":"2024-05-03T16:43:51.817335+0000","last_became_peered":"2024-05-03T16:43:51.817335+0000","last_unstale":"2024-05-03T16:45:25.575049+0000","last_undegraded":"2024-05-03T16:45:25.575049+0000","last_fullsized":"2024-05-03T16:45:25.575049+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:41:16.610501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104143+0000","last_change":"2024-05-03T16:43:55.948170+0000","last_active":"2024-05-03T16:45:06.104143+0000","last_peered":"2024-05-03T16:45:06.104143+0000","last_clean":"2024-05-03T16:45:06.104143+0000","last_became_active":"2024-05-03T16:43:55.947702+0000","last_became_peered":"2024-05-03T16:43:55.947702+0000","last_unstale":"2024-05-03T16:45:06.104143+0000","last_undegraded":"2024-05-03T16:45:06.104143+0000","last_fullsized":"2024-05-03T16:45:06.104143+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:23:27.614466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.108872+0000","last_change":"2024-05-03T16:44:11.110211+0000","last_active":"2024-05-03T16:45:06.108872+0000","last_peered":"2024-05-03T16:45:06.108872+0000","last_clean":"2024-05-03T16:45:06.108872+0000","last_became_active":"2024-05-03T16:44:11.109387+0000","last_became_peered":"2024-05-03T16:44:11.109387+0000","last_unstale":"2024-05-03T16:45:06.108872+0000","last_undegraded":"2024-05-03T16:45:06.108872+0000","last_fullsized":"2024-05-03T16:45:06.108872+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:00:50.609558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:25.605648+0000","last_change":"2024-05-03T16:43:51.837727+0000","last_active":"2024-05-03T16:45:25.605648+0000","last_peered":"2024-05-03T16:45:25.605648+0000","last_clean":"2024-05-03T16:45:25.605648+0000","last_became_active":"2024-05-03T16:43:51.837226+0000","last_became_peered":"2024-05-03T16:43:51.837226+0000","last_unstale":"2024-05-03T16:45:25.605648+0000","last_undegraded":"2024-05-03T16:45:25.605648+0000","last_fullsized":"2024-05-03T16:45:25.605648+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:52:48.913506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.106165+0000","last_change":"2024-05-03T16:43:55.934403+0000","last_active":"2024-05-03T16:45:06.106165+0000","last_peered":"2024-05-03T16:45:06.106165+0000","last_clean":"2024-05-03T16:45:06.106165+0000","last_became_active":"2024-05-03T16:43:55.933997+0000","last_became_peered":"2024-05-03T16:43:55.933997+0000","last_unstale":"2024-05-03T16:45:06.106165+0000","last_undegraded":"2024-05-03T16:45:06.106165+0000","last_fullsized":"2024-05-03T16:45:06.106165+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:44:36.005567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172933+0000","last_change":"2024-05-03T16:44:11.088757+0000","last_active":"2024-05-03T16:45:06.172933+0000","last_peered":"2024-05-03T16:45:06.172933+0000","last_clean":"2024-05-03T16:45:06.172933+0000","last_became_active":"2024-05-03T16:44:11.088208+0000","last_became_peered":"2024-05-03T16:44:11.088208+0000","last_unstale":"2024-05-03T16:45:06.172933+0000","last_undegraded":"2024-05-03T16:45:06.172933+0000","last_fullsized":"2024-05-03T16:45:06.172933+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:28:27.913357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"91'6","reported_seq":91,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:46:03.734672+0000","last_change":"2024-05-03T16:43:51.831736+0000","last_active":"2024-05-03T16:46:03.734672+0000","last_peered":"2024-05-03T16:46:03.734672+0000","last_clean":"2024-05-03T16:46:03.734672+0000","last_became_active":"2024-05-03T16:43:51.831282+0000","last_became_peered":"2024-05-03T16:43:51.831282+0000","last_unstale":"2024-05-03T16:46:03.734672+0000","last_undegraded":"2024-05-03T16:46:03.734672+0000","last_fullsized":"2024-05-03T16:46:03.734672+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:43:20.924935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104404+0000","last_change":"2024-05-03T16:43:55.939523+0000","last_active":"2024-05-03T16:45:06.104404+0000","last_peered":"2024-05-03T16:45:06.104404+0000","last_clean":"2024-05-03T16:45:06.104404+0000","last_became_active":"2024-05-03T16:43:55.939040+0000","last_became_peered":"2024-05-03T16:43:55.939040+0000","last_unstale":"2024-05-03T16:45:06.104404+0000","last_undegraded":"2024-05-03T16:45:06.104404+0000","last_fullsized":"2024-05-03T16:45:06.104404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:18:10.014846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175166+0000","last_change":"2024-05-03T16:44:11.110879+0000","last_active":"2024-05-03T16:45:06.175166+0000","last_peered":"2024-05-03T16:45:06.175166+0000","last_clean":"2024-05-03T16:45:06.175166+0000","last_became_active":"2024-05-03T16:44:11.109272+0000","last_became_peered":"2024-05-03T16:44:11.109272+0000","last_unstale":"2024-05-03T16:45:06.175166+0000","last_undegraded":"2024-05-03T16:45:06.175166+0000","last_fullsized":"2024-05-03T16:45:06.175166+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:56:06.145740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171964+0000","last_change":"2024-05-03T16:43:55.943555+0000","last_active":"2024-05-03T16:45:06.171964+0000","last_peered":"2024-05-03T16:45:06.171964+0000","last_clean":"2024-05-03T16:45:06.171964+0000","last_became_active":"2024-05-03T16:43:55.943153+0000","last_became_peered":"2024-05-03T16:43:55.943153+0000","last_unstale":"2024-05-03T16:45:06.171964+0000","last_undegraded":"2024-05-03T16:45:06.171964+0000","last_fullsized":"2024-05-03T16:45:06.171964+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:29:01.943626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:46:03.736062+0000","last_change":"2024-05-03T16:43:51.837491+0000","last_active":"2024-05-03T16:46:03.736062+0000","last_peered":"2024-05-03T16:46:03.736062+0000","last_clean":"2024-05-03T16:46:03.736062+0000","last_became_active":"2024-05-03T16:43:51.837008+0000","last_became_peered":"2024-05-03T16:43:51.837008+0000","last_unstale":"2024-05-03T16:46:03.736062+0000","last_undegraded":"2024-05-03T16:46:03.736062+0000","last_fullsized":"2024-05-03T16:46:03.736062+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:59:22.075792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171302+0000","last_change":"2024-05-03T16:44:11.091138+0000","last_active":"2024-05-03T16:45:06.171302+0000","last_peered":"2024-05-03T16:45:06.171302+0000","last_clean":"2024-05-03T16:45:06.171302+0000","last_became_active":"2024-05-03T16:44:11.090386+0000","last_became_peered":"2024-05-03T16:44:11.090386+0000","last_unstale":"2024-05-03T16:45:06.171302+0000","last_undegraded":"2024-05-03T16:45:06.171302+0000","last_fullsized":"2024-05-03T16:45:06.171302+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:36:31.201018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173423+0000","last_change":"2024-05-03T16:43:55.945735+0000","last_active":"2024-05-03T16:45:06.173423+0000","last_peered":"2024-05-03T16:45:06.173423+0000","last_clean":"2024-05-03T16:45:06.173423+0000","last_became_active":"2024-05-03T16:43:55.945399+0000","last_became_peered":"2024-05-03T16:43:55.945399+0000","last_unstale":"2024-05-03T16:45:06.173423+0000","last_undegraded":"2024-05-03T16:45:06.173423+0000","last_fullsized":"2024-05-03T16:45:06.173423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:28:59.508011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.629811+0000","last_change":"2024-05-03T16:43:51.826695+0000","last_active":"2024-05-03T16:45:27.629811+0000","last_peered":"2024-05-03T16:45:27.629811+0000","last_clean":"2024-05-03T16:45:27.629811+0000","last_became_active":"2024-05-03T16:43:51.825863+0000","last_became_peered":"2024-05-03T16:43:51.825863+0000","last_unstale":"2024-05-03T16:45:27.629811+0000","last_undegraded":"2024-05-03T16:45:27.629811+0000","last_fullsized":"2024-05-03T16:45:27.629811+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:39:15.068092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169749+0000","last_change":"2024-05-03T16:41:59.060997+0000","last_active":"2024-05-03T16:45:06.169749+0000","last_peered":"2024-05-03T16:45:06.169749+0000","last_clean":"2024-05-03T16:45:06.169749+0000","last_became_active":"2024-05-03T16:41:59.044854+0000","last_became_peered":"2024-05-03T16:41:59.044854+0000","last_unstale":"2024-05-03T16:45:06.169749+0000","last_undegraded":"2024-05-03T16:45:06.169749+0000","last_fullsized":"2024-05-03T16:45:06.169749+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:37:18.600432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:37:18.600432+0000","last_clean_scrub_stamp":"2024-05-03T16:37:18.600432+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:10:25.167355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171332+0000","last_change":"2024-05-03T16:44:11.110042+0000","last_active":"2024-05-03T16:45:06.171332+0000","last_peered":"2024-05-03T16:45:06.171332+0000","last_clean":"2024-05-03T16:45:06.171332+0000","last_became_active":"2024-05-03T16:44:11.109374+0000","last_became_peered":"2024-05-03T16:44:11.109374+0000","last_unstale":"2024-05-03T16:45:06.171332+0000","last_undegraded":"2024-05-03T16:45:06.171332+0000","last_fullsized":"2024-05-03T16:45:06.171332+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:04:21.562224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171622+0000","last_change":"2024-05-03T16:43:55.936662+0000","last_active":"2024-05-03T16:45:06.171622+0000","last_peered":"2024-05-03T16:45:06.171622+0000","last_clean":"2024-05-03T16:45:06.171622+0000","last_became_active":"2024-05-03T16:43:55.936332+0000","last_became_peered":"2024-05-03T16:43:55.936332+0000","last_unstale":"2024-05-03T16:45:06.171622+0000","last_undegraded":"2024-05-03T16:45:06.171622+0000","last_fullsized":"2024-05-03T16:45:06.171622+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:35:39.571574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:24.588060+0000","last_change":"2024-05-03T16:44:06.024989+0000","last_active":"2024-05-03T16:45:24.588060+0000","last_peered":"2024-05-03T16:45:24.588060+0000","last_clean":"2024-05-03T16:45:24.588060+0000","last_became_active":"2024-05-03T16:44:06.023623+0000","last_became_peered":"2024-05-03T16:44:06.023623+0000","last_unstale":"2024-05-03T16:45:24.588060+0000","last_undegraded":"2024-05-03T16:45:24.588060+0000","last_fullsized":"2024-05-03T16:45:24.588060+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:24:25.516820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.103216+0000","last_change":"2024-05-03T16:44:11.088212+0000","last_active":"2024-05-03T16:45:06.103216+0000","last_peered":"2024-05-03T16:45:06.103216+0000","last_clean":"2024-05-03T16:45:06.103216+0000","last_became_active":"2024-05-03T16:44:11.087737+0000","last_became_peered":"2024-05-03T16:44:11.087737+0000","last_unstale":"2024-05-03T16:45:06.103216+0000","last_undegraded":"2024-05-03T16:45:06.103216+0000","last_fullsized":"2024-05-03T16:45:06.103216+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:41:45.422664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.628680+0000","last_change":"2024-05-03T16:43:51.837762+0000","last_active":"2024-05-03T16:45:27.628680+0000","last_peered":"2024-05-03T16:45:27.628680+0000","last_clean":"2024-05-03T16:45:27.628680+0000","last_became_active":"2024-05-03T16:43:51.837310+0000","last_became_peered":"2024-05-03T16:43:51.837310+0000","last_unstale":"2024-05-03T16:45:27.628680+0000","last_undegraded":"2024-05-03T16:45:27.628680+0000","last_fullsized":"2024-05-03T16:45:27.628680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:34:51.983691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173544+0000","last_change":"2024-05-03T16:43:55.937607+0000","last_active":"2024-05-03T16:45:06.173544+0000","last_peered":"2024-05-03T16:45:06.173544+0000","last_clean":"2024-05-03T16:45:06.173544+0000","last_became_active":"2024-05-03T16:43:55.937166+0000","last_became_peered":"2024-05-03T16:43:55.937166+0000","last_unstale":"2024-05-03T16:45:06.173544+0000","last_undegraded":"2024-05-03T16:45:06.173544+0000","last_fullsized":"2024-05-03T16:45:06.173544+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:03:29.121718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172123+0000","last_change":"2024-05-03T16:44:11.109641+0000","last_active":"2024-05-03T16:45:06.172123+0000","last_peered":"2024-05-03T16:45:06.172123+0000","last_clean":"2024-05-03T16:45:06.172123+0000","last_became_active":"2024-05-03T16:44:11.109118+0000","last_became_peered":"2024-05-03T16:44:11.109118+0000","last_unstale":"2024-05-03T16:45:06.172123+0000","last_undegraded":"2024-05-03T16:45:06.172123+0000","last_fullsized":"2024-05-03T16:45:06.172123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:23:37.879612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'14","reported_seq":59,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:52.972707+0000","last_change":"2024-05-03T16:43:51.816440+0000","last_active":"2024-05-03T16:45:52.972707+0000","last_peered":"2024-05-03T16:45:52.972707+0000","last_clean":"2024-05-03T16:45:52.972707+0000","last_became_active":"2024-05-03T16:43:51.815952+0000","last_became_peered":"2024-05-03T16:43:51.815952+0000","last_unstale":"2024-05-03T16:45:52.972707+0000","last_undegraded":"2024-05-03T16:45:52.972707+0000","last_fullsized":"2024-05-03T16:45:52.972707+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:10:51.461550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175387+0000","last_change":"2024-05-03T16:43:55.952685+0000","last_active":"2024-05-03T16:45:06.175387+0000","last_peered":"2024-05-03T16:45:06.175387+0000","last_clean":"2024-05-03T16:45:06.175387+0000","last_became_active":"2024-05-03T16:43:55.952199+0000","last_became_peered":"2024-05-03T16:43:55.952199+0000","last_unstale":"2024-05-03T16:45:06.175387+0000","last_undegraded":"2024-05-03T16:45:06.175387+0000","last_fullsized":"2024-05-03T16:45:06.175387+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:26:01.716190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.098383+0000","last_change":"2024-05-03T16:44:11.084880+0000","last_active":"2024-05-03T16:45:06.098383+0000","last_peered":"2024-05-03T16:45:06.098383+0000","last_clean":"2024-05-03T16:45:06.098383+0000","last_became_active":"2024-05-03T16:44:11.084334+0000","last_became_peered":"2024-05-03T16:44:11.084334+0000","last_unstale":"2024-05-03T16:45:06.098383+0000","last_undegraded":"2024-05-03T16:45:06.098383+0000","last_fullsized":"2024-05-03T16:45:06.098383+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:38:01.884575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.626312+0000","last_change":"2024-05-03T16:43:51.824420+0000","last_active":"2024-05-03T16:45:27.626312+0000","last_peered":"2024-05-03T16:45:27.626312+0000","last_clean":"2024-05-03T16:45:27.626312+0000","last_became_active":"2024-05-03T16:43:51.820522+0000","last_became_peered":"2024-05-03T16:43:51.820522+0000","last_unstale":"2024-05-03T16:45:27.626312+0000","last_undegraded":"2024-05-03T16:45:27.626312+0000","last_fullsized":"2024-05-03T16:45:27.626312+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:54:29.537068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171293+0000","last_change":"2024-05-03T16:43:55.937107+0000","last_active":"2024-05-03T16:45:06.171293+0000","last_peered":"2024-05-03T16:45:06.171293+0000","last_clean":"2024-05-03T16:45:06.171293+0000","last_became_active":"2024-05-03T16:43:55.936801+0000","last_became_peered":"2024-05-03T16:43:55.936801+0000","last_unstale":"2024-05-03T16:45:06.171293+0000","last_undegraded":"2024-05-03T16:45:06.171293+0000","last_fullsized":"2024-05-03T16:45:06.171293+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:02:45.520881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.114420+0000","last_change":"2024-05-03T16:45:06.114420+0000","last_active":"2024-05-03T16:45:06.114420+0000","last_peered":"2024-05-03T16:45:06.114420+0000","last_clean":"2024-05-03T16:45:06.114420+0000","last_became_active":"2024-05-03T16:45:06.113345+0000","last_became_peered":"2024-05-03T16:45:06.113345+0000","last_unstale":"2024-05-03T16:45:06.114420+0000","last_undegraded":"2024-05-03T16:45:06.114420+0000","last_fullsized":"2024-05-03T16:45:06.114420+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:44:04.899008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:23.579638+0000","last_change":"2024-05-03T16:43:51.836247+0000","last_active":"2024-05-03T16:45:23.579638+0000","last_peered":"2024-05-03T16:45:23.579638+0000","last_clean":"2024-05-03T16:45:23.579638+0000","last_became_active":"2024-05-03T16:43:51.835877+0000","last_became_peered":"2024-05-03T16:43:51.835877+0000","last_unstale":"2024-05-03T16:45:23.579638+0000","last_undegraded":"2024-05-03T16:45:23.579638+0000","last_fullsized":"2024-05-03T16:45:23.579638+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:58:29.774976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.109113+0000","last_change":"2024-05-03T16:43:55.947689+0000","last_active":"2024-05-03T16:45:06.109113+0000","last_peered":"2024-05-03T16:45:06.109113+0000","last_clean":"2024-05-03T16:45:06.109113+0000","last_became_active":"2024-05-03T16:43:55.947228+0000","last_became_peered":"2024-05-03T16:43:55.947228+0000","last_unstale":"2024-05-03T16:45:06.109113+0000","last_undegraded":"2024-05-03T16:45:06.109113+0000","last_fullsized":"2024-05-03T16:45:06.109113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:09:17.595952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.179884+0000","last_change":"2024-05-03T16:45:06.179884+0000","last_active":"2024-05-03T16:45:06.179884+0000","last_peered":"2024-05-03T16:45:06.179884+0000","last_clean":"2024-05-03T16:45:06.179884+0000","last_became_active":"2024-05-03T16:45:06.178568+0000","last_became_peered":"2024-05-03T16:45:06.178568+0000","last_unstale":"2024-05-03T16:45:06.179884+0000","last_undegraded":"2024-05-03T16:45:06.179884+0000","last_fullsized":"2024-05-03T16:45:06.179884+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:10:00.693492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.623942+0000","last_change":"2024-05-03T16:43:51.821131+0000","last_active":"2024-05-03T16:45:26.623942+0000","last_peered":"2024-05-03T16:45:26.623942+0000","last_clean":"2024-05-03T16:45:26.623942+0000","last_became_active":"2024-05-03T16:43:51.817423+0000","last_became_peered":"2024-05-03T16:43:51.817423+0000","last_unstale":"2024-05-03T16:45:26.623942+0000","last_undegraded":"2024-05-03T16:45:26.623942+0000","last_fullsized":"2024-05-03T16:45:26.623942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:00:34.387262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.103922+0000","last_change":"2024-05-03T16:43:55.944671+0000","last_active":"2024-05-03T16:45:06.103922+0000","last_peered":"2024-05-03T16:45:06.103922+0000","last_clean":"2024-05-03T16:45:06.103922+0000","last_became_active":"2024-05-03T16:43:55.943854+0000","last_became_peered":"2024-05-03T16:43:55.943854+0000","last_unstale":"2024-05-03T16:45:06.103922+0000","last_undegraded":"2024-05-03T16:45:06.103922+0000","last_fullsized":"2024-05-03T16:45:06.103922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:57:10.809133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.107682+0000","last_change":"2024-05-03T16:44:11.092702+0000","last_active":"2024-05-03T16:45:06.107682+0000","last_peered":"2024-05-03T16:45:06.107682+0000","last_clean":"2024-05-03T16:45:06.107682+0000","last_became_active":"2024-05-03T16:44:11.091351+0000","last_became_peered":"2024-05-03T16:44:11.091351+0000","last_unstale":"2024-05-03T16:45:06.107682+0000","last_undegraded":"2024-05-03T16:45:06.107682+0000","last_fullsized":"2024-05-03T16:45:06.107682+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:06:58.227501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"91'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.590347+0000","last_change":"2024-05-03T16:43:51.822538+0000","last_active":"2024-05-03T16:45:27.590347+0000","last_peered":"2024-05-03T16:45:27.590347+0000","last_clean":"2024-05-03T16:45:27.590347+0000","last_became_active":"2024-05-03T16:43:51.821210+0000","last_became_peered":"2024-05-03T16:43:51.821210+0000","last_unstale":"2024-05-03T16:45:27.590347+0000","last_undegraded":"2024-05-03T16:45:27.590347+0000","last_fullsized":"2024-05-03T16:45:27.590347+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:29:00.377196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.174169+0000","last_change":"2024-05-03T16:43:55.943752+0000","last_active":"2024-05-03T16:45:06.174169+0000","last_peered":"2024-05-03T16:45:06.174169+0000","last_clean":"2024-05-03T16:45:06.174169+0000","last_became_active":"2024-05-03T16:43:55.943406+0000","last_became_peered":"2024-05-03T16:43:55.943406+0000","last_unstale":"2024-05-03T16:45:06.174169+0000","last_undegraded":"2024-05-03T16:45:06.174169+0000","last_fullsized":"2024-05-03T16:45:06.174169+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:47:25.753453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.107633+0000","last_change":"2024-05-03T16:44:11.111510+0000","last_active":"2024-05-03T16:45:06.107633+0000","last_peered":"2024-05-03T16:45:06.107633+0000","last_clean":"2024-05-03T16:45:06.107633+0000","last_became_active":"2024-05-03T16:44:11.110913+0000","last_became_peered":"2024-05-03T16:44:11.110913+0000","last_unstale":"2024-05-03T16:45:06.107633+0000","last_undegraded":"2024-05-03T16:45:06.107633+0000","last_fullsized":"2024-05-03T16:45:06.107633+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:04:43.435364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:23.579296+0000","last_change":"2024-05-03T16:43:51.819283+0000","last_active":"2024-05-03T16:45:23.579296+0000","last_peered":"2024-05-03T16:45:23.579296+0000","last_clean":"2024-05-03T16:45:23.579296+0000","last_became_active":"2024-05-03T16:43:51.818775+0000","last_became_peered":"2024-05-03T16:43:51.818775+0000","last_unstale":"2024-05-03T16:45:23.579296+0000","last_undegraded":"2024-05-03T16:45:23.579296+0000","last_fullsized":"2024-05-03T16:45:23.579296+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:01:42.363340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170640+0000","last_change":"2024-05-03T16:43:55.946633+0000","last_active":"2024-05-03T16:45:06.170640+0000","last_peered":"2024-05-03T16:45:06.170640+0000","last_clean":"2024-05-03T16:45:06.170640+0000","last_became_active":"2024-05-03T16:43:55.946325+0000","last_became_peered":"2024-05-03T16:43:55.946325+0000","last_unstale":"2024-05-03T16:45:06.170640+0000","last_undegraded":"2024-05-03T16:45:06.170640+0000","last_fullsized":"2024-05-03T16:45:06.170640+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:10:54.280667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099461+0000","last_change":"2024-05-03T16:44:11.089589+0000","last_active":"2024-05-03T16:45:06.099461+0000","last_peered":"2024-05-03T16:45:06.099461+0000","last_clean":"2024-05-03T16:45:06.099461+0000","last_became_active":"2024-05-03T16:44:11.088901+0000","last_became_peered":"2024-05-03T16:44:11.088901+0000","last_unstale":"2024-05-03T16:45:06.099461+0000","last_undegraded":"2024-05-03T16:45:06.099461+0000","last_fullsized":"2024-05-03T16:45:06.099461+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:03:07.587439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'5","reported_seq":86,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:46:00.733172+0000","last_change":"2024-05-03T16:43:51.840062+0000","last_active":"2024-05-03T16:46:00.733172+0000","last_peered":"2024-05-03T16:46:00.733172+0000","last_clean":"2024-05-03T16:46:00.733172+0000","last_became_active":"2024-05-03T16:43:51.839544+0000","last_became_peered":"2024-05-03T16:43:51.839544+0000","last_unstale":"2024-05-03T16:46:00.733172+0000","last_undegraded":"2024-05-03T16:46:00.733172+0000","last_fullsized":"2024-05-03T16:46:00.733172+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:37:21.719418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171713+0000","last_change":"2024-05-03T16:43:55.945655+0000","last_active":"2024-05-03T16:45:06.171713+0000","last_peered":"2024-05-03T16:45:06.171713+0000","last_clean":"2024-05-03T16:45:06.171713+0000","last_became_active":"2024-05-03T16:43:55.945263+0000","last_became_peered":"2024-05-03T16:43:55.945263+0000","last_unstale":"2024-05-03T16:45:06.171713+0000","last_undegraded":"2024-05-03T16:45:06.171713+0000","last_fullsized":"2024-05-03T16:45:06.171713+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:33:19.927686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169819+0000","last_change":"2024-05-03T16:44:11.090589+0000","last_active":"2024-05-03T16:45:06.169819+0000","last_peered":"2024-05-03T16:45:06.169819+0000","last_clean":"2024-05-03T16:45:06.169819+0000","last_became_active":"2024-05-03T16:44:11.087981+0000","last_became_peered":"2024-05-03T16:44:11.087981+0000","last_unstale":"2024-05-03T16:45:06.169819+0000","last_undegraded":"2024-05-03T16:45:06.169819+0000","last_fullsized":"2024-05-03T16:45:06.169819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:43:29.953670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.629118+0000","last_change":"2024-05-03T16:43:51.829334+0000","last_active":"2024-05-03T16:45:27.629118+0000","last_peered":"2024-05-03T16:45:27.629118+0000","last_clean":"2024-05-03T16:45:27.629118+0000","last_became_active":"2024-05-03T16:43:51.828816+0000","last_became_peered":"2024-05-03T16:43:51.828816+0000","last_unstale":"2024-05-03T16:45:27.629118+0000","last_undegraded":"2024-05-03T16:45:27.629118+0000","last_fullsized":"2024-05-03T16:45:27.629118+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:54:31.996256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170424+0000","last_change":"2024-05-03T16:43:55.942732+0000","last_active":"2024-05-03T16:45:06.170424+0000","last_peered":"2024-05-03T16:45:06.170424+0000","last_clean":"2024-05-03T16:45:06.170424+0000","last_became_active":"2024-05-03T16:43:55.941445+0000","last_became_peered":"2024-05-03T16:43:55.941445+0000","last_unstale":"2024-05-03T16:45:06.170424+0000","last_undegraded":"2024-05-03T16:45:06.170424+0000","last_fullsized":"2024-05-03T16:45:06.170424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:04:58.351184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169422+0000","last_change":"2024-05-03T16:44:11.085542+0000","last_active":"2024-05-03T16:45:06.169422+0000","last_peered":"2024-05-03T16:45:06.169422+0000","last_clean":"2024-05-03T16:45:06.169422+0000","last_became_active":"2024-05-03T16:44:11.082930+0000","last_became_peered":"2024-05-03T16:44:11.082930+0000","last_unstale":"2024-05-03T16:45:06.169422+0000","last_undegraded":"2024-05-03T16:45:06.169422+0000","last_fullsized":"2024-05-03T16:45:06.169422+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T16:44:37.617445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.623205+0000","last_change":"2024-05-03T16:43:51.820087+0000","last_active":"2024-05-03T16:45:26.623205+0000","last_peered":"2024-05-03T16:45:26.623205+0000","last_clean":"2024-05-03T16:45:26.623205+0000","last_became_active":"2024-05-03T16:43:51.819325+0000","last_became_peered":"2024-05-03T16:43:51.819325+0000","last_unstale":"2024-05-03T16:45:26.623205+0000","last_undegraded":"2024-05-03T16:45:26.623205+0000","last_fullsized":"2024-05-03T16:45:26.623205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:56:38.593149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171795+0000","last_change":"2024-05-03T16:43:55.952515+0000","last_active":"2024-05-03T16:45:06.171795+0000","last_peered":"2024-05-03T16:45:06.171795+0000","last_clean":"2024-05-03T16:45:06.171795+0000","last_became_active":"2024-05-03T16:43:55.951685+0000","last_became_peered":"2024-05-03T16:43:55.951685+0000","last_unstale":"2024-05-03T16:45:06.171795+0000","last_undegraded":"2024-05-03T16:45:06.171795+0000","last_fullsized":"2024-05-03T16:45:06.171795+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:14:03.935407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104956+0000","last_change":"2024-05-03T16:43:55.944993+0000","last_active":"2024-05-03T16:45:06.104956+0000","last_peered":"2024-05-03T16:45:06.104956+0000","last_clean":"2024-05-03T16:45:06.104956+0000","last_became_active":"2024-05-03T16:43:55.944364+0000","last_became_peered":"2024-05-03T16:43:55.944364+0000","last_unstale":"2024-05-03T16:45:06.104956+0000","last_undegraded":"2024-05-03T16:45:06.104956+0000","last_fullsized":"2024-05-03T16:45:06.104956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:35:15.711248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099184+0000","last_change":"2024-05-03T16:43:55.947596+0000","last_active":"2024-05-03T16:45:06.099184+0000","last_peered":"2024-05-03T16:45:06.099184+0000","last_clean":"2024-05-03T16:45:06.099184+0000","last_became_active":"2024-05-03T16:43:55.946217+0000","last_became_peered":"2024-05-03T16:43:55.946217+0000","last_unstale":"2024-05-03T16:45:06.099184+0000","last_undegraded":"2024-05-03T16:45:06.099184+0000","last_fullsized":"2024-05-03T16:45:06.099184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:09:07.005119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.098706+0000","last_change":"2024-05-03T16:43:55.940952+0000","last_active":"2024-05-03T16:45:06.098706+0000","last_peered":"2024-05-03T16:45:06.098706+0000","last_clean":"2024-05-03T16:45:06.098706+0000","last_became_active":"2024-05-03T16:43:55.940110+0000","last_became_peered":"2024-05-03T16:43:55.940110+0000","last_unstale":"2024-05-03T16:45:06.098706+0000","last_undegraded":"2024-05-03T16:45:06.098706+0000","last_fullsized":"2024-05-03T16:45:06.098706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:50:27.229267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170630+0000","last_change":"2024-05-03T16:43:55.936616+0000","last_active":"2024-05-03T16:45:06.170630+0000","last_peered":"2024-05-03T16:45:06.170630+0000","last_clean":"2024-05-03T16:45:06.170630+0000","last_became_active":"2024-05-03T16:43:55.936289+0000","last_became_peered":"2024-05-03T16:43:55.936289+0000","last_unstale":"2024-05-03T16:45:06.170630+0000","last_undegraded":"2024-05-03T16:45:06.170630+0000","last_fullsized":"2024-05-03T16:45:06.170630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:32:41.424346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173825+0000","last_change":"2024-05-03T16:43:55.932302+0000","last_active":"2024-05-03T16:45:06.173825+0000","last_peered":"2024-05-03T16:45:06.173825+0000","last_clean":"2024-05-03T16:45:06.173825+0000","last_became_active":"2024-05-03T16:43:55.931819+0000","last_became_peered":"2024-05-03T16:43:55.931819+0000","last_unstale":"2024-05-03T16:45:06.173825+0000","last_undegraded":"2024-05-03T16:45:06.173825+0000","last_fullsized":"2024-05-03T16:45:06.173825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:25:02.644191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104442+0000","last_change":"2024-05-03T16:43:55.942873+0000","last_active":"2024-05-03T16:45:06.104442+0000","last_peered":"2024-05-03T16:45:06.104442+0000","last_clean":"2024-05-03T16:45:06.104442+0000","last_became_active":"2024-05-03T16:43:55.942546+0000","last_became_peered":"2024-05-03T16:43:55.942546+0000","last_unstale":"2024-05-03T16:45:06.104442+0000","last_undegraded":"2024-05-03T16:45:06.104442+0000","last_fullsized":"2024-05-03T16:45:06.104442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:24:07.111976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099757+0000","last_change":"2024-05-03T16:43:55.939764+0000","last_active":"2024-05-03T16:45:06.099757+0000","last_peered":"2024-05-03T16:45:06.099757+0000","last_clean":"2024-05-03T16:45:06.099757+0000","last_became_active":"2024-05-03T16:43:55.939362+0000","last_became_peered":"2024-05-03T16:43:55.939362+0000","last_unstale":"2024-05-03T16:45:06.099757+0000","last_undegraded":"2024-05-03T16:45:06.099757+0000","last_fullsized":"2024-05-03T16:45:06.099757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:06:27.624159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175862+0000","last_change":"2024-05-03T16:43:55.935974+0000","last_active":"2024-05-03T16:45:06.175862+0000","last_peered":"2024-05-03T16:45:06.175862+0000","last_clean":"2024-05-03T16:45:06.175862+0000","last_became_active":"2024-05-03T16:43:55.935582+0000","last_became_peered":"2024-05-03T16:43:55.935582+0000","last_unstale":"2024-05-03T16:45:06.175862+0000","last_undegraded":"2024-05-03T16:45:06.175862+0000","last_fullsized":"2024-05-03T16:45:06.175862+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:48:18.420037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170153+0000","last_change":"2024-05-03T16:43:55.938992+0000","last_active":"2024-05-03T16:45:06.170153+0000","last_peered":"2024-05-03T16:45:06.170153+0000","last_clean":"2024-05-03T16:45:06.170153+0000","last_became_active":"2024-05-03T16:43:55.938614+0000","last_became_peered":"2024-05-03T16:43:55.938614+0000","last_unstale":"2024-05-03T16:45:06.170153+0000","last_undegraded":"2024-05-03T16:45:06.170153+0000","last_fullsized":"2024-05-03T16:45:06.170153+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:18:44.830231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173344+0000","last_change":"2024-05-03T16:43:55.949381+0000","last_active":"2024-05-03T16:45:06.173344+0000","last_peered":"2024-05-03T16:45:06.173344+0000","last_clean":"2024-05-03T16:45:06.173344+0000","last_became_active":"2024-05-03T16:43:55.948536+0000","last_became_peered":"2024-05-03T16:43:55.948536+0000","last_unstale":"2024-05-03T16:45:06.173344+0000","last_undegraded":"2024-05-03T16:45:06.173344+0000","last_fullsized":"2024-05-03T16:45:06.173344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:27:17.081023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.100103+0000","last_change":"2024-05-03T16:43:55.936682+0000","last_active":"2024-05-03T16:45:06.100103+0000","last_peered":"2024-05-03T16:45:06.100103+0000","last_clean":"2024-05-03T16:45:06.100103+0000","last_became_active":"2024-05-03T16:43:55.936338+0000","last_became_peered":"2024-05-03T16:43:55.936338+0000","last_unstale":"2024-05-03T16:45:06.100103+0000","last_undegraded":"2024-05-03T16:45:06.100103+0000","last_fullsized":"2024-05-03T16:45:06.100103+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:15:21.824271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.174201+0000","last_change":"2024-05-03T16:43:55.938357+0000","last_active":"2024-05-03T16:45:06.174201+0000","last_peered":"2024-05-03T16:45:06.174201+0000","last_clean":"2024-05-03T16:45:06.174201+0000","last_became_active":"2024-05-03T16:43:55.938027+0000","last_became_peered":"2024-05-03T16:43:55.938027+0000","last_unstale":"2024-05-03T16:45:06.174201+0000","last_undegraded":"2024-05-03T16:45:06.174201+0000","last_fullsized":"2024-05-03T16:45:06.174201+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:03:03.537274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.105194+0000","last_change":"2024-05-03T16:43:55.944296+0000","last_active":"2024-05-03T16:45:06.105194+0000","last_peered":"2024-05-03T16:45:06.105194+0000","last_clean":"2024-05-03T16:45:06.105194+0000","last_became_active":"2024-05-03T16:43:55.943844+0000","last_became_peered":"2024-05-03T16:43:55.943844+0000","last_unstale":"2024-05-03T16:45:06.105194+0000","last_undegraded":"2024-05-03T16:45:06.105194+0000","last_fullsized":"2024-05-03T16:45:06.105194+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:50:25.594951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60940,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":418,"num_read_kb":278,"num_write":243,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":616,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":182820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645356,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":525657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841587,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28716,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716436,"statfs":{"total":95995035648,"available":95965630464,"internally_reserved":0,"allocated":1740800,"data_stored":1166532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005115,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32232,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712920,"statfs":{"total":95995035648,"available":95962030080,"internally_reserved":0,"allocated":1081344,"data_stored":529615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201345,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":525225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430282,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28648,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716504,"statfs":{"total":95995035648,"available":95965700096,"internally_reserved":0,"allocated":1671168,"data_stored":1122394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593808,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":521414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1122304,"data_stored":577193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738490,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":522479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411435,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32268,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712884,"statfs":{"total":95995035648,"available":95961993216,"internally_reserved":0,"allocated":1118208,"data_stored":575710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149795,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1064960,"data_stored":520731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953566,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1069056,"data_stored":525769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790040,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32816,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712336,"statfs":{"total":95995035648,"available":95961432064,"internally_reserved":0,"allocated":1679360,"data_stored":1117585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":56892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":55409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":55863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-03T16:46:09.215 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-03T16:46:09.215 INFO:tasks.cephadm:Setting up client nodes... 2024-05-03T16:46:09.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-03T16:46:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:10.103 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:09 smithi081 ceph-mon[28640]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T16:46:10.104 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:09 smithi081 ceph-mon[28640]: pgmap v443: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-03T16:46:10.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:09 smithi134 ceph-mon[31708]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T16:46:10.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:09 smithi134 ceph-mon[31708]: pgmap v443: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-03T16:46:10.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:09 smithi146 ceph-mon[32357]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T16:46:10.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:09 smithi146 ceph-mon[32357]: pgmap v443: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-03T16:46:12.093 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:11 smithi081 ceph-mon[28640]: pgmap v444: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:12.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.123+0000 7f8fba800700 1 -- 172.21.15.81:0/3306051029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb410ad40 msgr2=0x7f8fb410b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:12.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.123+0000 7f8fba800700 1 --2- 172.21.15.81:0/3306051029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb410ad40 0x7f8fb410b1a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00099c0 tx=0x7f8fa0009cd0 comp rx=0 tx=0).stop 2024-05-03T16:46:12.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.123+0000 7f8fba800700 1 -- 172.21.15.81:0/3306051029 shutdown_connections 2024-05-03T16:46:12.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.123+0000 7f8fba800700 1 --2- 172.21.15.81:0/3306051029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fb4109b40 0x7f8fb4109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:12.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.123+0000 7f8fba800700 1 --2- 172.21.15.81:0/3306051029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fb410b6e0 0x7f8fb4111f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:12.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.123+0000 7f8fba800700 1 --2- 172.21.15.81:0/3306051029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb410ad40 0x7f8fb410b1a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:12.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.123+0000 7f8fba800700 1 -- 172.21.15.81:0/3306051029 >> 172.21.15.81:0/3306051029 conn(0x7f8fb4078b10 msgr2=0x7f8fb407af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:12.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.124+0000 7f8fba800700 1 -- 172.21.15.81:0/3306051029 shutdown_connections 2024-05-03T16:46:12.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.124+0000 7f8fba800700 1 -- 172.21.15.81:0/3306051029 wait complete. 2024-05-03T16:46:12.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.125+0000 7f8fba800700 1 Processor -- start 2024-05-03T16:46:12.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.125+0000 7f8fba800700 1 -- start start 2024-05-03T16:46:12.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.125+0000 7f8fba800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb4109b40 0x7f8fb419fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.125+0000 7f8fba800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fb410ad40 0x7f8fb419ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.125+0000 7f8fba800700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fb410b6e0 0x7f8fb41a7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.125+0000 7f8fba800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb4115460 con 0x7f8fb4109b40 2024-05-03T16:46:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.125+0000 7f8fba800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb41152e0 con 0x7f8fb410ad40 2024-05-03T16:46:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.125+0000 7f8fba800700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb41155e0 con 0x7f8fb410b6e0 2024-05-03T16:46:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.125+0000 7f8fb3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb4109b40 0x7f8fb419fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.126+0000 7f8fb3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb4109b40 0x7f8fb419fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54278/0 (socket says 172.21.15.81:54278) 2024-05-03T16:46:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.126+0000 7f8fb3400700 1 -- 172.21.15.81:0/1393947961 learned_addr learned my addr 172.21.15.81:0/1393947961 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:46:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.126+0000 7f8fb2a00700 1 --2- 172.21.15.81:0/1393947961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fb410ad40 0x7f8fb419ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.126+0000 7f8fb3e00700 1 --2- 172.21.15.81:0/1393947961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fb410b6e0 0x7f8fb41a7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.126+0000 7f8fb3400700 1 -- 172.21.15.81:0/1393947961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fb410b6e0 msgr2=0x7f8fb41a7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.126+0000 7f8fb3400700 1 --2- 172.21.15.81:0/1393947961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fb410b6e0 0x7f8fb41a7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.126+0000 7f8fb3400700 1 -- 172.21.15.81:0/1393947961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fb410ad40 msgr2=0x7f8fb419ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.126+0000 7f8fb3400700 1 --2- 172.21.15.81:0/1393947961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fb410ad40 0x7f8fb419ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.126+0000 7f8fb3400700 1 -- 172.21.15.81:0/1393947961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb41a76b0 con 0x7f8fb4109b40 2024-05-03T16:46:12.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.126+0000 7f8fb3400700 1 --2- 172.21.15.81:0/1393947961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb4109b40 0x7f8fb419fa50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8fa400d9b0 tx=0x7f8fa400dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:12.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.127+0000 7f8fabe00700 1 -- 172.21.15.81:0/1393947961 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4017030 con 0x7f8fb4109b40 2024-05-03T16:46:12.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.127+0000 7f8fabe00700 1 -- 172.21.15.81:0/1393947961 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8fa40044b0 con 0x7f8fb4109b40 2024-05-03T16:46:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.127+0000 7f8fba800700 1 -- 172.21.15.81:0/1393947961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb41a79a0 con 0x7f8fb4109b40 2024-05-03T16:46:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.127+0000 7f8fabe00700 1 -- 172.21.15.81:0/1393947961 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa40038e0 con 0x7f8fb4109b40 2024-05-03T16:46:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.127+0000 7f8fba800700 1 -- 172.21.15.81:0/1393947961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb41a7ee0 con 0x7f8fb4109b40 2024-05-03T16:46:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.128+0000 7f8fba800700 1 -- 172.21.15.81:0/1393947961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb40519e0 con 0x7f8fb4109b40 2024-05-03T16:46:12.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.130+0000 7f8fabe00700 1 -- 172.21.15.81:0/1393947961 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f8fa401a070 con 0x7f8fb4109b40 2024-05-03T16:46:12.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.132+0000 7f8fabe00700 1 --2- 172.21.15.81:0/1393947961 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8f980b29b0 0x7f8f980b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:12.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.132+0000 7f8fabe00700 1 -- 172.21.15.81:0/1393947961 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f8fa40e2530 con 0x7f8fb4109b40 2024-05-03T16:46:12.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.132+0000 7f8fb2a00700 1 --2- 172.21.15.81:0/1393947961 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8f980b29b0 0x7f8f980b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.133+0000 7f8fb2a00700 1 --2- 172.21.15.81:0/1393947961 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8f980b29b0 0x7f8f980b4e70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0000c00 tx=0x7f8fa001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:12.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.134+0000 7f8fabe00700 1 -- 172.21.15.81:0/1393947961 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8fa40a9ce0 con 0x7f8fb4109b40 2024-05-03T16:46:12.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:11 smithi146 ceph-mon[32357]: pgmap v444: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.450+0000 7f8fba800700 1 -- 172.21.15.81:0/1393947961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f8fb402e540 con 0x7f8fb4109b40 2024-05-03T16:46:12.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.454+0000 7f8fabe00700 1 -- 172.21.15.81:0/1393947961 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v34) ==== 170+0+59 (secure 0 0 0) 0x7f8fa40a95e0 con 0x7f8fb4109b40 2024-05-03T16:46:12.456 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-05-03T16:46:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDUFDVmj6z3GhAAO80y/FC/0P+nrP2eVjISEQ== 2024-05-03T16:46:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.457+0000 7f8fba800700 1 -- 172.21.15.81:0/1393947961 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8f980b29b0 msgr2=0x7f8f980b4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.457+0000 7f8fba800700 1 --2- 172.21.15.81:0/1393947961 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8f980b29b0 0x7f8f980b4e70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0000c00 tx=0x7f8fa001a040 comp rx=0 tx=0).stop 2024-05-03T16:46:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.457+0000 7f8fba800700 1 -- 172.21.15.81:0/1393947961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb4109b40 msgr2=0x7f8fb419fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.457+0000 7f8fba800700 1 --2- 172.21.15.81:0/1393947961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb4109b40 0x7f8fb419fa50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8fa400d9b0 tx=0x7f8fa400dd70 comp rx=0 tx=0).stop 2024-05-03T16:46:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.458+0000 7f8fba800700 1 -- 172.21.15.81:0/1393947961 shutdown_connections 2024-05-03T16:46:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.458+0000 7f8fba800700 1 --2- 172.21.15.81:0/1393947961 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8f980b29b0 0x7f8f980b4e70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.458+0000 7f8fba800700 1 --2- 172.21.15.81:0/1393947961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fb410b6e0 0x7f8fb41a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.458+0000 7f8fba800700 1 --2- 172.21.15.81:0/1393947961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb4109b40 0x7f8fb419fa50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.458+0000 7f8fba800700 1 --2- 172.21.15.81:0/1393947961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fb410ad40 0x7f8fb419ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.458+0000 7f8fba800700 1 -- 172.21.15.81:0/1393947961 >> 172.21.15.81:0/1393947961 conn(0x7f8fb4078b10 msgr2=0x7f8fb410e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:12.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.458+0000 7f8fba800700 1 -- 172.21.15.81:0/1393947961 shutdown_connections 2024-05-03T16:46:12.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:12.458+0000 7f8fba800700 1 -- 172.21.15.81:0/1393947961 wait complete. 2024-05-03T16:46:12.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:11 smithi134 ceph-mon[31708]: pgmap v444: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:13.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:12 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1393947961' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-03T16:46:13.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:12 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1393947961' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-03T16:46:13.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:12 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/1393947961' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-03T16:46:13.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:12 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/1393947961' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-03T16:46:13.415 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T16:46:13.415 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-03T16:46:13.415 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-03T16:46:13.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:12 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/1393947961' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-03T16:46:13.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:12 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/1393947961' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-03T16:46:13.533 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-03T16:46:13.533 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-03T16:46:13.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph mgr dump --format=json 2024-05-03T16:46:14.008 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:14.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:13 smithi081 ceph-mon[28640]: pgmap v445: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:46:14.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:13 smithi146 ceph-mon[32357]: pgmap v445: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:46:14.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:13 smithi134 ceph-mon[31708]: pgmap v445: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:46:16.027 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:15 smithi081 ceph-mon[28640]: pgmap v446: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:16.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:15 smithi146 ceph-mon[32357]: pgmap v446: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:16.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.346+0000 7ff3a1a00700 1 -- 172.21.15.81:0/3008387133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff39c103750 msgr2=0x7ff39c103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:16.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.346+0000 7ff3a1a00700 1 --2- 172.21.15.81:0/3008387133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff39c103750 0x7ff39c103b30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0099c0 tx=0x7ff38c009cd0 comp rx=0 tx=0).stop 2024-05-03T16:46:16.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.346+0000 7ff3a1a00700 1 -- 172.21.15.81:0/3008387133 shutdown_connections 2024-05-03T16:46:16.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.346+0000 7ff3a1a00700 1 --2- 172.21.15.81:0/3008387133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff39c108850 0x7ff39c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:16.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.346+0000 7ff3a1a00700 1 --2- 172.21.15.81:0/3008387133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff39c103750 0x7ff39c103b30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:16.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.346+0000 7ff3a1a00700 1 --2- 172.21.15.81:0/3008387133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff39c104100 0x7ff39c108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:16.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.346+0000 7ff3a1a00700 1 -- 172.21.15.81:0/3008387133 >> 172.21.15.81:0/3008387133 conn(0x7ff39c07a600 msgr2=0x7ff39c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:16.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.346+0000 7ff3a1a00700 1 -- 172.21.15.81:0/3008387133 shutdown_connections 2024-05-03T16:46:16.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.347+0000 7ff3a1a00700 1 -- 172.21.15.81:0/3008387133 wait complete. 2024-05-03T16:46:16.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.347+0000 7ff3a1a00700 1 Processor -- start 2024-05-03T16:46:16.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.348+0000 7ff3a1a00700 1 -- start start 2024-05-03T16:46:16.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.348+0000 7ff3a1a00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff39c103750 0x7ff39c1a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:16.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.348+0000 7ff3a1a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff39c104100 0x7ff39c1a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:16.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.348+0000 7ff3a1a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff39c108850 0x7ff39c19ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:16.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.348+0000 7ff3a1a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c113520 con 0x7ff39c104100 2024-05-03T16:46:16.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.348+0000 7ff3a1a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c1133a0 con 0x7ff39c108850 2024-05-03T16:46:16.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.348+0000 7ff3a1a00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c1136a0 con 0x7ff39c103750 2024-05-03T16:46:16.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.348+0000 7ff39a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff39c104100 0x7ff39c1a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:16.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.348+0000 7ff39a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff39c104100 0x7ff39c1a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47526/0 (socket says 172.21.15.81:47526) 2024-05-03T16:46:16.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.348+0000 7ff39a000700 1 -- 172.21.15.81:0/2876302599 learned_addr learned my addr 172.21.15.81:0/2876302599 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:46:16.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.349+0000 7ff39aa00700 1 --2- 172.21.15.81:0/2876302599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff39c103750 0x7ff39c1a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:16.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.349+0000 7ff39b400700 1 --2- 172.21.15.81:0/2876302599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff39c108850 0x7ff39c19ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:16.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.349+0000 7ff39a000700 1 -- 172.21.15.81:0/2876302599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff39c103750 msgr2=0x7ff39c1a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:16.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.349+0000 7ff39a000700 1 --2- 172.21.15.81:0/2876302599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff39c103750 0x7ff39c1a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:16.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.349+0000 7ff39a000700 1 -- 172.21.15.81:0/2876302599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff39c108850 msgr2=0x7ff39c19ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:16.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.349+0000 7ff39a000700 1 --2- 172.21.15.81:0/2876302599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff39c108850 0x7ff39c19ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:16.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.349+0000 7ff39a000700 1 -- 172.21.15.81:0/2876302599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c19c1c0 con 0x7ff39c104100 2024-05-03T16:46:16.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.349+0000 7ff39b400700 1 --2- 172.21.15.81:0/2876302599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff39c108850 0x7ff39c19ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:46:16.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.349+0000 7ff39a000700 1 --2- 172.21.15.81:0/2876302599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff39c104100 0x7ff39c1a1d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff38800c9b0 tx=0x7ff38800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:16.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.350+0000 7ff393400700 1 -- 172.21.15.81:0/2876302599 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388007b00 con 0x7ff39c104100 2024-05-03T16:46:16.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.350+0000 7ff393400700 1 -- 172.21.15.81:0/2876302599 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff388007ca0 con 0x7ff39c104100 2024-05-03T16:46:16.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.350+0000 7ff393400700 1 -- 172.21.15.81:0/2876302599 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388018660 con 0x7ff39c104100 2024-05-03T16:46:16.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.350+0000 7ff3a1a00700 1 -- 172.21.15.81:0/2876302599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39c19c4b0 con 0x7ff39c104100 2024-05-03T16:46:16.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.350+0000 7ff3a1a00700 1 -- 172.21.15.81:0/2876302599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff39c1a8720 con 0x7ff39c104100 2024-05-03T16:46:16.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.351+0000 7ff3a1a00700 1 -- 172.21.15.81:0/2876302599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff39c06a190 con 0x7ff39c104100 2024-05-03T16:46:16.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.354+0000 7ff393400700 1 -- 172.21.15.81:0/2876302599 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff38800f450 con 0x7ff39c104100 2024-05-03T16:46:16.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.356+0000 7ff393400700 1 --2- 172.21.15.81:0/2876302599 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff3800b2990 0x7ff3800b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:16.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.357+0000 7ff393400700 1 -- 172.21.15.81:0/2876302599 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7ff3880e27f0 con 0x7ff39c104100 2024-05-03T16:46:16.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.357+0000 7ff39aa00700 1 --2- 172.21.15.81:0/2876302599 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff3800b2990 0x7ff3800b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:16.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.357+0000 7ff39aa00700 1 --2- 172.21.15.81:0/2876302599 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff3800b2990 0x7ff3800b4e50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009990 tx=0x7ff38c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:16.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.361+0000 7ff393400700 1 -- 172.21.15.81:0/2876302599 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff388014030 con 0x7ff39c104100 2024-05-03T16:46:16.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:15 smithi134 ceph-mon[31708]: pgmap v446: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:16.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.654+0000 7ff3a1a00700 1 -- 172.21.15.81:0/2876302599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff39c19cf40 con 0x7ff39c104100 2024-05-03T16:46:16.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.672+0000 7ff393400700 1 -- 172.21.15.81:0/2876302599 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+288646 (secure 0 0 0) 0x7ff39c19cf40 con 0x7ff39c104100 2024-05-03T16:46:16.680 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:46:16.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.679+0000 7ff3a1a00700 1 -- 172.21.15.81:0/2876302599 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff3800b2990 msgr2=0x7ff3800b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:16.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.679+0000 7ff3a1a00700 1 --2- 172.21.15.81:0/2876302599 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff3800b2990 0x7ff3800b4e50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009990 tx=0x7ff38c01a040 comp rx=0 tx=0).stop 2024-05-03T16:46:16.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.679+0000 7ff3a1a00700 1 -- 172.21.15.81:0/2876302599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff39c104100 msgr2=0x7ff39c1a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:16.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.679+0000 7ff3a1a00700 1 --2- 172.21.15.81:0/2876302599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff39c104100 0x7ff39c1a1d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff38800c9b0 tx=0x7ff38800cd70 comp rx=0 tx=0).stop 2024-05-03T16:46:16.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.679+0000 7ff3a1a00700 1 -- 172.21.15.81:0/2876302599 shutdown_connections 2024-05-03T16:46:16.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.679+0000 7ff3a1a00700 1 --2- 172.21.15.81:0/2876302599 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff3800b2990 0x7ff3800b4e50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:16.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.680+0000 7ff3a1a00700 1 --2- 172.21.15.81:0/2876302599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff39c103750 0x7ff39c1a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:16.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.680+0000 7ff3a1a00700 1 --2- 172.21.15.81:0/2876302599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff39c108850 0x7ff39c19ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:16.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.680+0000 7ff3a1a00700 1 --2- 172.21.15.81:0/2876302599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff39c104100 0x7ff39c1a1d90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:16.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.680+0000 7ff3a1a00700 1 -- 172.21.15.81:0/2876302599 >> 172.21.15.81:0/2876302599 conn(0x7ff39c07a600 msgr2=0x7ff39c102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:16.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.680+0000 7ff3a1a00700 1 -- 172.21.15.81:0/2876302599 shutdown_connections 2024-05-03T16:46:16.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:16.680+0000 7ff3a1a00700 1 -- 172.21.15.81:0/2876302599 wait complete. 2024-05-03T16:46:17.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:17 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2876302599' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-03T16:46:17.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:17 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2876302599' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-03T16:46:17.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:17 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2876302599' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-03T16:46:17.701 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1773670984},{"type":"v1","addr":"172.21.15.81:6801","nonce":1773670984}]},"active_addr":"172.21.15.81:6801/1773670984","active_change":"2024-05-03T16:34:04.089534+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":34109,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.81:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1982030037}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":2013628964}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":248172842}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3131576181}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1666817439}]}]} 2024-05-03T16:46:17.708 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-03T16:46:17.708 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-03T16:46:17.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T16:46:18.193 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:18.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:18 smithi146 ceph-mon[32357]: pgmap v447: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:46:18.346 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:18 smithi081 ceph-mon[28640]: pgmap v447: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:46:18.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:18 smithi134 ceph-mon[31708]: pgmap v447: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:46:20.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:20 smithi146 ceph-mon[32357]: pgmap v448: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:20.385 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:20 smithi081 ceph-mon[28640]: pgmap v448: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:20.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:20 smithi134 ceph-mon[31708]: pgmap v448: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:20.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.550+0000 7f5f4ca00700 1 -- 172.21.15.81:0/2339096838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f4810b660 msgr2=0x7f5f4810ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:20.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.550+0000 7f5f4ca00700 1 --2- 172.21.15.81:0/2339096838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f4810b660 0x7f5f4810ba40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009990 tx=0x7f5f38009ca0 comp rx=0 tx=0).stop 2024-05-03T16:46:20.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.550+0000 7f5f4ca00700 1 -- 172.21.15.81:0/2339096838 shutdown_connections 2024-05-03T16:46:20.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.550+0000 7f5f4ca00700 1 --2- 172.21.15.81:0/2339096838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f48105f90 0x7f5f481124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:20.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.550+0000 7f5f4ca00700 1 --2- 172.21.15.81:0/2339096838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f4810b660 0x7f5f4810ba40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:20.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.550+0000 7f5f4ca00700 1 --2- 172.21.15.81:0/2339096838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f481055d0 0x7f5f48105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:20.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.550+0000 7f5f4ca00700 1 -- 172.21.15.81:0/2339096838 >> 172.21.15.81:0/2339096838 conn(0x7f5f481010c0 msgr2=0x7f5f481034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:20.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.550+0000 7f5f4ca00700 1 -- 172.21.15.81:0/2339096838 shutdown_connections 2024-05-03T16:46:20.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.550+0000 7f5f4ca00700 1 -- 172.21.15.81:0/2339096838 wait complete. 2024-05-03T16:46:20.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.552+0000 7f5f4ca00700 1 Processor -- start 2024-05-03T16:46:20.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.552+0000 7f5f4ca00700 1 -- start start 2024-05-03T16:46:20.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.552+0000 7f5f4ca00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f481055d0 0x7f5f481a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:20.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.552+0000 7f5f4ca00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f48105f90 0x7f5f481a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:20.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.552+0000 7f5f4ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f4810b660 0x7f5f4819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:20.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.552+0000 7f5f4ca00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5f481156b0 con 0x7f5f4810b660 2024-05-03T16:46:20.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.552+0000 7f5f4ca00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5f48115530 con 0x7f5f481055d0 2024-05-03T16:46:20.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.552+0000 7f5f4ca00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5f48115830 con 0x7f5f48105f90 2024-05-03T16:46:20.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.553+0000 7f5f47e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f4810b660 0x7f5f4819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:20.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.553+0000 7f5f47e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f4810b660 0x7f5f4819b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47548/0 (socket says 172.21.15.81:47548) 2024-05-03T16:46:20.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.553+0000 7f5f47e00700 1 -- 172.21.15.81:0/3507133263 learned_addr learned my addr 172.21.15.81:0/3507133263 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:46:20.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.553+0000 7f5f46a00700 1 --2- 172.21.15.81:0/3507133263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f48105f90 0x7f5f481a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:20.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.553+0000 7f5f47400700 1 --2- 172.21.15.81:0/3507133263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f481055d0 0x7f5f481a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:20.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.553+0000 7f5f47e00700 1 -- 172.21.15.81:0/3507133263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f48105f90 msgr2=0x7f5f481a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:20.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.553+0000 7f5f47e00700 1 --2- 172.21.15.81:0/3507133263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f48105f90 0x7f5f481a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:20.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.553+0000 7f5f47e00700 1 -- 172.21.15.81:0/3507133263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f481055d0 msgr2=0x7f5f481a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:20.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.553+0000 7f5f47e00700 1 --2- 172.21.15.81:0/3507133263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f481055d0 0x7f5f481a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:20.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.553+0000 7f5f47e00700 1 -- 172.21.15.81:0/3507133263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4819c150 con 0x7f5f4810b660 2024-05-03T16:46:20.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.553+0000 7f5f46a00700 1 --2- 172.21.15.81:0/3507133263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f48105f90 0x7f5f481a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:46:20.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.553+0000 7f5f47400700 1 --2- 172.21.15.81:0/3507133263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f481055d0 0x7f5f481a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:46:20.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.553+0000 7f5f47e00700 1 --2- 172.21.15.81:0/3507133263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f4810b660 0x7f5f4819b9f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5f40007ee0 tx=0x7f5f4000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:20.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.554+0000 7f5f3fe00700 1 -- 172.21.15.81:0/3507133263 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4000ddd0 con 0x7f5f4810b660 2024-05-03T16:46:20.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.554+0000 7f5f3fe00700 1 -- 172.21.15.81:0/3507133263 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5f40004020 con 0x7f5f4810b660 2024-05-03T16:46:20.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.554+0000 7f5f4ca00700 1 -- 172.21.15.81:0/3507133263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f4819c440 con 0x7f5f4810b660 2024-05-03T16:46:20.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.554+0000 7f5f3fe00700 1 -- 172.21.15.81:0/3507133263 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f40015660 con 0x7f5f4810b660 2024-05-03T16:46:20.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.554+0000 7f5f4ca00700 1 -- 172.21.15.81:0/3507133263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f481a86b0 con 0x7f5f4810b660 2024-05-03T16:46:20.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.555+0000 7f5f4ca00700 1 -- 172.21.15.81:0/3507133263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f4806a190 con 0x7f5f4810b660 2024-05-03T16:46:20.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.557+0000 7f5f3fe00700 1 -- 172.21.15.81:0/3507133263 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5f400041d0 con 0x7f5f4810b660 2024-05-03T16:46:20.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.559+0000 7f5f3fe00700 1 --2- 172.21.15.81:0/3507133263 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5f2c0b2910 0x7f5f2c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:20.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.559+0000 7f5f3fe00700 1 -- 172.21.15.81:0/3507133263 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f5f400e2270 con 0x7f5f4810b660 2024-05-03T16:46:20.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.559+0000 7f5f47400700 1 --2- 172.21.15.81:0/3507133263 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5f2c0b2910 0x7f5f2c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:20.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.560+0000 7f5f47400700 1 --2- 172.21.15.81:0/3507133263 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5f2c0b2910 0x7f5f2c0b4dd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800b650 tx=0x7f5f3801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:20.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.564+0000 7f5f3fe00700 1 -- 172.21.15.81:0/3507133263 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f5f40010070 con 0x7f5f4810b660 2024-05-03T16:46:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.798+0000 7f5f4ca00700 1 -- 172.21.15.81:0/3507133263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5f4802e510 con 0x7f5f4810b660 2024-05-03T16:46:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.802+0000 7f5f3fe00700 1 -- 172.21.15.81:0/3507133263 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24767 (secure 0 0 0) 0x7f5f400a9a20 con 0x7f5f4810b660 2024-05-03T16:46:20.805 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:46:20.805 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":91,"fsid":"8988869e-096a-11ef-bc97-c7b262605968","created":"2024-05-03T16:32:56.440204+0000","modified":"2024-05-03T16:45:06.079032+0000","last_up_change":"2024-05-03T16:42:31.768974+0000","last_in_change":"2024-05-03T16:42:06.989688+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T16:37:18.271939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T16:43:50.469793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T16:43:54.708564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T16:44:09.064474+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"957b05dc-dfb9-4561-8800-b7ec0aba679d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6803","nonce":1639968055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6805","nonce":1639968055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6809","nonce":1639968055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6807","nonce":1639968055}]},"public_addr":"172.21.15.81:6803/1639968055","cluster_addr":"172.21.15.81:6805/1639968055","heartbeat_back_addr":"172.21.15.81:6809/1639968055","heartbeat_front_addr":"172.21.15.81:6807/1639968055","state":["exists","up"]},{"osd":1,"uuid":"3bb199cd-b4d0-4c67-b98f-2106336dd57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6801","nonce":1928503491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6803","nonce":1928503491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6807","nonce":1928503491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6805","nonce":1928503491}]},"public_addr":"172.21.15.134:6801/1928503491","cluster_addr":"172.21.15.134:6803/1928503491","heartbeat_back_addr":"172.21.15.134:6807/1928503491","heartbeat_front_addr":"172.21.15.134:6805/1928503491","state":["exists","up"]},{"osd":2,"uuid":"79ec9995-50e8-4eaf-935a-39a479925734","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6801","nonce":1233108455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6803","nonce":1233108455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6807","nonce":1233108455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6805","nonce":1233108455}]},"public_addr":"172.21.15.146:6801/1233108455","cluster_addr":"172.21.15.146:6803/1233108455","heartbeat_back_addr":"172.21.15.146:6807/1233108455","heartbeat_front_addr":"172.21.15.146:6805/1233108455","state":["exists","up"]},{"osd":3,"uuid":"2d38f4e7-73c3-4e70-9f87-d44da28db452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6811","nonce":4128709465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6813","nonce":4128709465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6817","nonce":4128709465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6815","nonce":4128709465}]},"public_addr":"172.21.15.81:6811/4128709465","cluster_addr":"172.21.15.81:6813/4128709465","heartbeat_back_addr":"172.21.15.81:6817/4128709465","heartbeat_front_addr":"172.21.15.81:6815/4128709465","state":["exists","up"]},{"osd":4,"uuid":"3837a136-a25b-4cb9-aa82-084b477c67d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6809","nonce":1498616220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6811","nonce":1498616220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6815","nonce":1498616220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6813","nonce":1498616220}]},"public_addr":"172.21.15.134:6809/1498616220","cluster_addr":"172.21.15.134:6811/1498616220","heartbeat_back_addr":"172.21.15.134:6815/1498616220","heartbeat_front_addr":"172.21.15.134:6813/1498616220","state":["exists","up"]},{"osd":5,"uuid":"2e783d2e-c181-41a9-97de-f17705a201bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6809","nonce":1276988922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6811","nonce":1276988922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6815","nonce":1276988922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6813","nonce":1276988922}]},"public_addr":"172.21.15.146:6809/1276988922","cluster_addr":"172.21.15.146:6811/1276988922","heartbeat_back_addr":"172.21.15.146:6815/1276988922","heartbeat_front_addr":"172.21.15.146:6813/1276988922","state":["exists","up"]},{"osd":6,"uuid":"6faebdbf-7820-42e5-b07c-15db11f278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6819","nonce":3319125020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6821","nonce":3319125020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6825","nonce":3319125020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6823","nonce":3319125020}]},"public_addr":"172.21.15.81:6819/3319125020","cluster_addr":"172.21.15.81:6821/3319125020","heartbeat_back_addr":"172.21.15.81:6825/3319125020","heartbeat_front_addr":"172.21.15.81:6823/3319125020","state":["exists","up"]},{"osd":7,"uuid":"ec4b6b84-6c5f-4d07-a747-06610b2cd345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6817","nonce":3241993481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6819","nonce":3241993481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6823","nonce":3241993481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6821","nonce":3241993481}]},"public_addr":"172.21.15.134:6817/3241993481","cluster_addr":"172.21.15.134:6819/3241993481","heartbeat_back_addr":"172.21.15.134:6823/3241993481","heartbeat_front_addr":"172.21.15.134:6821/3241993481","state":["exists","up"]},{"osd":8,"uuid":"02b1b0fd-837c-4c29-bedb-54fa2ee7531d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6817","nonce":2423161684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6819","nonce":2423161684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6823","nonce":2423161684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6821","nonce":2423161684}]},"public_addr":"172.21.15.146:6817/2423161684","cluster_addr":"172.21.15.146:6819/2423161684","heartbeat_back_addr":"172.21.15.146:6823/2423161684","heartbeat_front_addr":"172.21.15.146:6821/2423161684","state":["exists","up"]},{"osd":9,"uuid":"46713a8e-743d-44d5-babe-c01d3179afcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6827","nonce":873909886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6829","nonce":873909886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6833","nonce":873909886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6831","nonce":873909886}]},"public_addr":"172.21.15.81:6827/873909886","cluster_addr":"172.21.15.81:6829/873909886","heartbeat_back_addr":"172.21.15.81:6833/873909886","heartbeat_front_addr":"172.21.15.81:6831/873909886","state":["exists","up"]},{"osd":10,"uuid":"12fcae89-30af-436b-a513-3998303da93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6825","nonce":1183629038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6827","nonce":1183629038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6831","nonce":1183629038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6829","nonce":1183629038}]},"public_addr":"172.21.15.134:6825/1183629038","cluster_addr":"172.21.15.134:6827/1183629038","heartbeat_back_addr":"172.21.15.134:6831/1183629038","heartbeat_front_addr":"172.21.15.134:6829/1183629038","state":["exists","up"]},{"osd":11,"uuid":"a543f42c-61da-4a93-b16b-a2891a4ef873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6825","nonce":2627233639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6827","nonce":2627233639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6831","nonce":2627233639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6829","nonce":2627233639}]},"public_addr":"172.21.15.146:6825/2627233639","cluster_addr":"172.21.15.146:6827/2627233639","heartbeat_back_addr":"172.21.15.146:6831/2627233639","heartbeat_front_addr":"172.21.15.146:6829/2627233639","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:08.411954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:41.459869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:15.068172+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:49.711273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:23.231811+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:57.917964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:39:32.982397+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:07.434610+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:43.606108+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:19.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:54.917284+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:42:30.525217+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6801/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/2237510960":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6801/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/3199433706":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1689714816":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/2777950369":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/1982866220":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1112375028":"2024-05-04T16:33:30.274051+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T16:46:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.805+0000 7f5f4ca00700 1 -- 172.21.15.81:0/3507133263 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5f2c0b2910 msgr2=0x7f5f2c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.805+0000 7f5f4ca00700 1 --2- 172.21.15.81:0/3507133263 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5f2c0b2910 0x7f5f2c0b4dd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800b650 tx=0x7f5f3801a040 comp rx=0 tx=0).stop 2024-05-03T16:46:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.805+0000 7f5f4ca00700 1 -- 172.21.15.81:0/3507133263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f4810b660 msgr2=0x7f5f4819b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.805+0000 7f5f4ca00700 1 --2- 172.21.15.81:0/3507133263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f4810b660 0x7f5f4819b9f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5f40007ee0 tx=0x7f5f4000d3b0 comp rx=0 tx=0).stop 2024-05-03T16:46:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.805+0000 7f5f4ca00700 1 -- 172.21.15.81:0/3507133263 shutdown_connections 2024-05-03T16:46:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.805+0000 7f5f4ca00700 1 --2- 172.21.15.81:0/3507133263 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5f2c0b2910 0x7f5f2c0b4dd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.805+0000 7f5f4ca00700 1 --2- 172.21.15.81:0/3507133263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f4810b660 0x7f5f4819b9f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.805+0000 7f5f4ca00700 1 --2- 172.21.15.81:0/3507133263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f481055d0 0x7f5f481a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.805+0000 7f5f4ca00700 1 --2- 172.21.15.81:0/3507133263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f48105f90 0x7f5f481a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.805+0000 7f5f4ca00700 1 -- 172.21.15.81:0/3507133263 >> 172.21.15.81:0/3507133263 conn(0x7f5f481010c0 msgr2=0x7f5f481028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.805+0000 7f5f4ca00700 1 -- 172.21.15.81:0/3507133263 shutdown_connections 2024-05-03T16:46:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:20.806+0000 7f5f4ca00700 1 -- 172.21.15.81:0/3507133263 wait complete. 2024-05-03T16:46:21.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:21 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3507133263' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:46:21.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:21 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3507133263' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:46:21.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:21 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3507133263' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:46:21.734 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-03T16:46:21.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T16:46:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:22.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:22 smithi146 ceph-mon[32357]: pgmap v449: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:22.333 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:22 smithi081 ceph-mon[28640]: pgmap v449: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:22.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:22 smithi134 ceph-mon[31708]: pgmap v449: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:24.180 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:24 smithi081 ceph-mon[28640]: pgmap v450: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:46:24.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:24 smithi146 ceph-mon[32357]: pgmap v450: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:46:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.346+0000 7fd0ce600700 1 -- 172.21.15.81:0/1565161054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c8104590 msgr2=0x7fd0c8104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.346+0000 7fd0ce600700 1 --2- 172.21.15.81:0/1565161054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c8104590 0x7fd0c8104970 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009990 tx=0x7fd0bc009ca0 comp rx=0 tx=0).stop 2024-05-03T16:46:24.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.347+0000 7fd0ce600700 1 -- 172.21.15.81:0/1565161054 shutdown_connections 2024-05-03T16:46:24.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.347+0000 7fd0ce600700 1 --2- 172.21.15.81:0/1565161054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c810d9c0 0x7fd0c810fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:24.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.347+0000 7fd0ce600700 1 --2- 172.21.15.81:0/1565161054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c8104590 0x7fd0c8104970 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:24.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.347+0000 7fd0ce600700 1 --2- 172.21.15.81:0/1565161054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0c8104eb0 0x7fd0c810d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:24.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.347+0000 7fd0ce600700 1 -- 172.21.15.81:0/1565161054 >> 172.21.15.81:0/1565161054 conn(0x7fd0c80fddc0 msgr2=0x7fd0c81001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:24.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.347+0000 7fd0ce600700 1 -- 172.21.15.81:0/1565161054 shutdown_connections 2024-05-03T16:46:24.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.347+0000 7fd0ce600700 1 -- 172.21.15.81:0/1565161054 wait complete. 2024-05-03T16:46:24.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.348+0000 7fd0ce600700 1 Processor -- start 2024-05-03T16:46:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.349+0000 7fd0ce600700 1 -- start start 2024-05-03T16:46:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.349+0000 7fd0ce600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0c8104590 0x7fd0c81a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.349+0000 7fd0ce600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c8104eb0 0x7fd0c81a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.349+0000 7fd0ce600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c810d9c0 0x7fd0c819ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.349+0000 7fd0ce600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c8113490 con 0x7fd0c810d9c0 2024-05-03T16:46:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.349+0000 7fd0ce600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c8113310 con 0x7fd0c8104eb0 2024-05-03T16:46:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.349+0000 7fd0ce600700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c8113610 con 0x7fd0c8104590 2024-05-03T16:46:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.350+0000 7fd0cdc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c810d9c0 0x7fd0c819ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.350+0000 7fd0cdc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c810d9c0 0x7fd0c819ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47570/0 (socket says 172.21.15.81:47570) 2024-05-03T16:46:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.350+0000 7fd0cdc00700 1 -- 172.21.15.81:0/1680553757 learned_addr learned my addr 172.21.15.81:0/1680553757 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:46:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.350+0000 7fd0cd200700 1 --2- 172.21.15.81:0/1680553757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0c8104590 0x7fd0c81a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.350+0000 7fd0c7e00700 1 --2- 172.21.15.81:0/1680553757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c8104eb0 0x7fd0c81a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.350+0000 7fd0cdc00700 1 -- 172.21.15.81:0/1680553757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0c8104590 msgr2=0x7fd0c81a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.350+0000 7fd0cdc00700 1 --2- 172.21.15.81:0/1680553757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0c8104590 0x7fd0c81a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.350+0000 7fd0cdc00700 1 -- 172.21.15.81:0/1680553757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c8104eb0 msgr2=0x7fd0c81a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.350+0000 7fd0cdc00700 1 --2- 172.21.15.81:0/1680553757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c8104eb0 0x7fd0c81a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.350+0000 7fd0cdc00700 1 -- 172.21.15.81:0/1680553757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c819c1b0 con 0x7fd0c810d9c0 2024-05-03T16:46:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.350+0000 7fd0cdc00700 1 --2- 172.21.15.81:0/1680553757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c810d9c0 0x7fd0c819ba50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0007ee0 tx=0x7fd0c000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.351+0000 7fd0c5600700 1 -- 172.21.15.81:0/1680553757 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c000dbd0 con 0x7fd0c810d9c0 2024-05-03T16:46:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.351+0000 7fd0c5600700 1 -- 172.21.15.81:0/1680553757 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0c000dd70 con 0x7fd0c810d9c0 2024-05-03T16:46:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.351+0000 7fd0ce600700 1 -- 172.21.15.81:0/1680553757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c819c4a0 con 0x7fd0c810d9c0 2024-05-03T16:46:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.351+0000 7fd0c5600700 1 -- 172.21.15.81:0/1680553757 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00058d0 con 0x7fd0c810d9c0 2024-05-03T16:46:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.351+0000 7fd0ce600700 1 -- 172.21.15.81:0/1680553757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c81a8760 con 0x7fd0c810d9c0 2024-05-03T16:46:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.352+0000 7fd0ce600700 1 -- 172.21.15.81:0/1680553757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c806a190 con 0x7fd0c810d9c0 2024-05-03T16:46:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.354+0000 7fd0c5600700 1 -- 172.21.15.81:0/1680553757 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd0c001a020 con 0x7fd0c810d9c0 2024-05-03T16:46:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.356+0000 7fd0c5600700 1 --2- 172.21.15.81:0/1680553757 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd0b00b2990 0x7fd0b00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.356+0000 7fd0c5600700 1 -- 172.21.15.81:0/1680553757 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fd0c00e1f00 con 0x7fd0c810d9c0 2024-05-03T16:46:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.356+0000 7fd0cd200700 1 --2- 172.21.15.81:0/1680553757 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd0b00b2990 0x7fd0b00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.357+0000 7fd0cd200700 1 --2- 172.21.15.81:0/1680553757 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd0b00b2990 0x7fd0b00b4e50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc003760 tx=0x7fd0bc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.361+0000 7fd0c5600700 1 -- 172.21.15.81:0/1680553757 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd0c0010070 con 0x7fd0c810d9c0 2024-05-03T16:46:24.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:24 smithi134 ceph-mon[31708]: pgmap v450: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:46:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.595+0000 7fd0ce600700 1 -- 172.21.15.81:0/1680553757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0c81a8990 con 0x7fd0c810d9c0 2024-05-03T16:46:24.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.597+0000 7fd0c5600700 1 -- 172.21.15.81:0/1680553757 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24767 (secure 0 0 0) 0x7fd0c00a96b0 con 0x7fd0c810d9c0 2024-05-03T16:46:24.600 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:46:24.600 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":91,"fsid":"8988869e-096a-11ef-bc97-c7b262605968","created":"2024-05-03T16:32:56.440204+0000","modified":"2024-05-03T16:45:06.079032+0000","last_up_change":"2024-05-03T16:42:31.768974+0000","last_in_change":"2024-05-03T16:42:06.989688+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T16:37:18.271939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T16:43:50.469793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T16:43:54.708564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T16:44:09.064474+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"957b05dc-dfb9-4561-8800-b7ec0aba679d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6803","nonce":1639968055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6805","nonce":1639968055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6809","nonce":1639968055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6807","nonce":1639968055}]},"public_addr":"172.21.15.81:6803/1639968055","cluster_addr":"172.21.15.81:6805/1639968055","heartbeat_back_addr":"172.21.15.81:6809/1639968055","heartbeat_front_addr":"172.21.15.81:6807/1639968055","state":["exists","up"]},{"osd":1,"uuid":"3bb199cd-b4d0-4c67-b98f-2106336dd57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6801","nonce":1928503491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6803","nonce":1928503491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6807","nonce":1928503491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6805","nonce":1928503491}]},"public_addr":"172.21.15.134:6801/1928503491","cluster_addr":"172.21.15.134:6803/1928503491","heartbeat_back_addr":"172.21.15.134:6807/1928503491","heartbeat_front_addr":"172.21.15.134:6805/1928503491","state":["exists","up"]},{"osd":2,"uuid":"79ec9995-50e8-4eaf-935a-39a479925734","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6801","nonce":1233108455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6803","nonce":1233108455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6807","nonce":1233108455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6805","nonce":1233108455}]},"public_addr":"172.21.15.146:6801/1233108455","cluster_addr":"172.21.15.146:6803/1233108455","heartbeat_back_addr":"172.21.15.146:6807/1233108455","heartbeat_front_addr":"172.21.15.146:6805/1233108455","state":["exists","up"]},{"osd":3,"uuid":"2d38f4e7-73c3-4e70-9f87-d44da28db452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6811","nonce":4128709465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6813","nonce":4128709465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6817","nonce":4128709465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6815","nonce":4128709465}]},"public_addr":"172.21.15.81:6811/4128709465","cluster_addr":"172.21.15.81:6813/4128709465","heartbeat_back_addr":"172.21.15.81:6817/4128709465","heartbeat_front_addr":"172.21.15.81:6815/4128709465","state":["exists","up"]},{"osd":4,"uuid":"3837a136-a25b-4cb9-aa82-084b477c67d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6809","nonce":1498616220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6811","nonce":1498616220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6815","nonce":1498616220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6813","nonce":1498616220}]},"public_addr":"172.21.15.134:6809/1498616220","cluster_addr":"172.21.15.134:6811/1498616220","heartbeat_back_addr":"172.21.15.134:6815/1498616220","heartbeat_front_addr":"172.21.15.134:6813/1498616220","state":["exists","up"]},{"osd":5,"uuid":"2e783d2e-c181-41a9-97de-f17705a201bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6809","nonce":1276988922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6811","nonce":1276988922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6815","nonce":1276988922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6813","nonce":1276988922}]},"public_addr":"172.21.15.146:6809/1276988922","cluster_addr":"172.21.15.146:6811/1276988922","heartbeat_back_addr":"172.21.15.146:6815/1276988922","heartbeat_front_addr":"172.21.15.146:6813/1276988922","state":["exists","up"]},{"osd":6,"uuid":"6faebdbf-7820-42e5-b07c-15db11f278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6819","nonce":3319125020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6821","nonce":3319125020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6825","nonce":3319125020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6823","nonce":3319125020}]},"public_addr":"172.21.15.81:6819/3319125020","cluster_addr":"172.21.15.81:6821/3319125020","heartbeat_back_addr":"172.21.15.81:6825/3319125020","heartbeat_front_addr":"172.21.15.81:6823/3319125020","state":["exists","up"]},{"osd":7,"uuid":"ec4b6b84-6c5f-4d07-a747-06610b2cd345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6817","nonce":3241993481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6819","nonce":3241993481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6823","nonce":3241993481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6821","nonce":3241993481}]},"public_addr":"172.21.15.134:6817/3241993481","cluster_addr":"172.21.15.134:6819/3241993481","heartbeat_back_addr":"172.21.15.134:6823/3241993481","heartbeat_front_addr":"172.21.15.134:6821/3241993481","state":["exists","up"]},{"osd":8,"uuid":"02b1b0fd-837c-4c29-bedb-54fa2ee7531d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6817","nonce":2423161684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6819","nonce":2423161684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6823","nonce":2423161684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6821","nonce":2423161684}]},"public_addr":"172.21.15.146:6817/2423161684","cluster_addr":"172.21.15.146:6819/2423161684","heartbeat_back_addr":"172.21.15.146:6823/2423161684","heartbeat_front_addr":"172.21.15.146:6821/2423161684","state":["exists","up"]},{"osd":9,"uuid":"46713a8e-743d-44d5-babe-c01d3179afcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6827","nonce":873909886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6829","nonce":873909886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6833","nonce":873909886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6831","nonce":873909886}]},"public_addr":"172.21.15.81:6827/873909886","cluster_addr":"172.21.15.81:6829/873909886","heartbeat_back_addr":"172.21.15.81:6833/873909886","heartbeat_front_addr":"172.21.15.81:6831/873909886","state":["exists","up"]},{"osd":10,"uuid":"12fcae89-30af-436b-a513-3998303da93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6825","nonce":1183629038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6827","nonce":1183629038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6831","nonce":1183629038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6829","nonce":1183629038}]},"public_addr":"172.21.15.134:6825/1183629038","cluster_addr":"172.21.15.134:6827/1183629038","heartbeat_back_addr":"172.21.15.134:6831/1183629038","heartbeat_front_addr":"172.21.15.134:6829/1183629038","state":["exists","up"]},{"osd":11,"uuid":"a543f42c-61da-4a93-b16b-a2891a4ef873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6825","nonce":2627233639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6827","nonce":2627233639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6831","nonce":2627233639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6829","nonce":2627233639}]},"public_addr":"172.21.15.146:6825/2627233639","cluster_addr":"172.21.15.146:6827/2627233639","heartbeat_back_addr":"172.21.15.146:6831/2627233639","heartbeat_front_addr":"172.21.15.146:6829/2627233639","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:08.411954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:41.459869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:15.068172+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:49.711273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:23.231811+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:57.917964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:39:32.982397+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:07.434610+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:43.606108+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:19.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:54.917284+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:42:30.525217+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6801/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/2237510960":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6801/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/3199433706":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1689714816":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/2777950369":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/1982866220":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1112375028":"2024-05-04T16:33:30.274051+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T16:46:24.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.600+0000 7fd0ce600700 1 -- 172.21.15.81:0/1680553757 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd0b00b2990 msgr2=0x7fd0b00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:24.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.600+0000 7fd0ce600700 1 --2- 172.21.15.81:0/1680553757 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd0b00b2990 0x7fd0b00b4e50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc003760 tx=0x7fd0bc01a040 comp rx=0 tx=0).stop 2024-05-03T16:46:24.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.600+0000 7fd0ce600700 1 -- 172.21.15.81:0/1680553757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c810d9c0 msgr2=0x7fd0c819ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:24.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.600+0000 7fd0ce600700 1 --2- 172.21.15.81:0/1680553757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c810d9c0 0x7fd0c819ba50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0007ee0 tx=0x7fd0c000d3b0 comp rx=0 tx=0).stop 2024-05-03T16:46:24.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.600+0000 7fd0ce600700 1 -- 172.21.15.81:0/1680553757 shutdown_connections 2024-05-03T16:46:24.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.600+0000 7fd0ce600700 1 --2- 172.21.15.81:0/1680553757 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd0b00b2990 0x7fd0b00b4e50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:24.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.600+0000 7fd0ce600700 1 --2- 172.21.15.81:0/1680553757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0c8104590 0x7fd0c81a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:24.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.600+0000 7fd0ce600700 1 --2- 172.21.15.81:0/1680553757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c810d9c0 0x7fd0c819ba50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:24.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.600+0000 7fd0ce600700 1 --2- 172.21.15.81:0/1680553757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c8104eb0 0x7fd0c81a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:24.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.600+0000 7fd0ce600700 1 -- 172.21.15.81:0/1680553757 >> 172.21.15.81:0/1680553757 conn(0x7fd0c80fddc0 msgr2=0x7fd0c81001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:24.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.600+0000 7fd0ce600700 1 -- 172.21.15.81:0/1680553757 shutdown_connections 2024-05-03T16:46:24.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:24.601+0000 7fd0ce600700 1 -- 172.21.15.81:0/1680553757 wait complete. 2024-05-03T16:46:25.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:25 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/1680553757' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:46:25.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:25 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/1680553757' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:46:25.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:25 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1680553757' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:46:25.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-03T16:46:25.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-03T16:46:25.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-03T16:46:25.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-03T16:46:25.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-03T16:46:25.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-03T16:46:25.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-03T16:46:25.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-03T16:46:25.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-03T16:46:25.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-03T16:46:25.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-03T16:46:25.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-03T16:46:26.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:26 smithi081 ceph-mon[28640]: pgmap v451: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:26.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:26 smithi146 ceph-mon[32357]: pgmap v451: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:26.369 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:26 smithi134 ceph-mon[31708]: pgmap v451: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:26.571 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:26.792 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:26.792 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:26.795 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:26.797 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:26.804 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:26.805 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:26.809 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:26.815 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:26.831 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:26.840 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:28.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:28 smithi081 ceph-mon[28640]: pgmap v452: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:46:28.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:28 smithi146 ceph-mon[32357]: pgmap v452: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:46:28.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:28 smithi134 ceph-mon[31708]: pgmap v452: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:46:28.798 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:30.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:30 smithi081 ceph-mon[28640]: pgmap v453: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:30.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:30 smithi134 ceph-mon[31708]: pgmap v453: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:30.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:30 smithi146 ceph-mon[32357]: pgmap v453: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:32.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:32 smithi081 ceph-mon[28640]: pgmap v454: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:32.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:32 smithi134 ceph-mon[31708]: pgmap v454: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:32.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:32 smithi146 ceph-mon[32357]: pgmap v454: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:34.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:34 smithi081 ceph-mon[28640]: pgmap v455: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:46:34.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:34 smithi146 ceph-mon[32357]: pgmap v455: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:46:34.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:34 smithi134 ceph-mon[31708]: pgmap v455: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:46:36.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:36 smithi134 ceph-mon[31708]: pgmap v456: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:36.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:36 smithi081 ceph-mon[28640]: pgmap v456: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:36.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:36 smithi146 ceph-mon[32357]: pgmap v456: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:38.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:38 smithi081 ceph-mon[28640]: pgmap v457: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:46:38.434 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:38 smithi134 ceph-mon[31708]: pgmap v457: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:46:38.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:38 smithi146 ceph-mon[32357]: pgmap v457: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:46:40.184 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:40 smithi081 ceph-mon[28640]: pgmap v458: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:40.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:40 smithi134 ceph-mon[31708]: pgmap v458: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:40.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:40 smithi146 ceph-mon[32357]: pgmap v458: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:42.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.115+0000 7f6708c00700 1 -- 172.21.15.81:0/1663742297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6704103ef0 msgr2=0x7f67041103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:42.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.115+0000 7f6708c00700 1 --2- 172.21.15.81:0/1663742297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6704103ef0 0x7f67041103d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00b0a0 tx=0x7f66fc00b3b0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.115+0000 7f6708c00700 1 -- 172.21.15.81:0/1663742297 shutdown_connections 2024-05-03T16:46:42.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.115+0000 7f6708c00700 1 --2- 172.21.15.81:0/1663742297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6704103ef0 0x7f67041103d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.115+0000 7f6708c00700 1 --2- 172.21.15.81:0/1663742297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6704108460 0x7f6704108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.115+0000 7f6708c00700 1 --2- 172.21.15.81:0/1663742297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6704103550 0x7f67041039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.115+0000 7f6708c00700 1 -- 172.21.15.81:0/1663742297 >> 172.21.15.81:0/1663742297 conn(0x7f670407a600 msgr2=0x7f670407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:42.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.115+0000 7f6708c00700 1 -- 172.21.15.81:0/1663742297 shutdown_connections 2024-05-03T16:46:42.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.115+0000 7f6708c00700 1 -- 172.21.15.81:0/1663742297 wait complete. 2024-05-03T16:46:42.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.116+0000 7f6708c00700 1 Processor -- start 2024-05-03T16:46:42.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.117+0000 7f6708c00700 1 -- start start 2024-05-03T16:46:42.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.117+0000 7f6708c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6704103550 0x7f67040757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:42.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.117+0000 7f6708c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6704103ef0 0x7f6704075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:42.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.117+0000 7f6708c00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6704108460 0x7f6704076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:42.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.117+0000 7f6708c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f67041135a0 con 0x7f6704103550 2024-05-03T16:46:42.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.117+0000 7f6708c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6704113420 con 0x7f6704103ef0 2024-05-03T16:46:42.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.117+0000 7f6708c00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6704113720 con 0x7f6704108460 2024-05-03T16:46:42.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.117+0000 7f6701e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6704103550 0x7f67040757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:42.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.117+0000 7f6701e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6704103550 0x7f67040757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32914/0 (socket says 172.21.15.81:32914) 2024-05-03T16:46:42.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.117+0000 7f6701e00700 1 -- 172.21.15.81:0/304649183 learned_addr learned my addr 172.21.15.81:0/304649183 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:46:42.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.118+0000 7f6701400700 1 --2- 172.21.15.81:0/304649183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6704103ef0 0x7f6704075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.118+0000 7f6702800700 1 --2- 172.21.15.81:0/304649183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6704108460 0x7f6704076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.118+0000 7f6701e00700 1 -- 172.21.15.81:0/304649183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6704108460 msgr2=0x7f6704076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.118+0000 7f6701e00700 1 --2- 172.21.15.81:0/304649183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6704108460 0x7f6704076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.118+0000 7f6701e00700 1 -- 172.21.15.81:0/304649183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6704103ef0 msgr2=0x7f6704075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.118+0000 7f6701e00700 1 --2- 172.21.15.81:0/304649183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6704103ef0 0x7f6704075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.118+0000 7f6701e00700 1 -- 172.21.15.81:0/304649183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67041a7ed0 con 0x7f6704103550 2024-05-03T16:46:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.118+0000 7f6702800700 1 --2- 172.21.15.81:0/304649183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6704108460 0x7f6704076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:46:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.118+0000 7f6701400700 1 --2- 172.21.15.81:0/304649183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6704103ef0 0x7f6704075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:46:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.118+0000 7f6701e00700 1 --2- 172.21.15.81:0/304649183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6704103550 0x7f67040757a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f66f400c970 tx=0x7f66f400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.118+0000 7f66faa00700 1 -- 172.21.15.81:0/304649183 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f4004220 con 0x7f6704103550 2024-05-03T16:46:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.119+0000 7f6708c00700 1 -- 172.21.15.81:0/304649183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67041a8160 con 0x7f6704103550 2024-05-03T16:46:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.119+0000 7f66faa00700 1 -- 172.21.15.81:0/304649183 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66f4007d30 con 0x7f6704103550 2024-05-03T16:46:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.119+0000 7f66faa00700 1 -- 172.21.15.81:0/304649183 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f4003c40 con 0x7f6704103550 2024-05-03T16:46:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.119+0000 7f6708c00700 1 -- 172.21.15.81:0/304649183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67041a86a0 con 0x7f6704103550 2024-05-03T16:46:42.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.120+0000 7f6708c00700 1 -- 172.21.15.81:0/304649183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6704063b70 con 0x7f6704103550 2024-05-03T16:46:42.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.123+0000 7f66faa00700 1 -- 172.21.15.81:0/304649183 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f66f40078a0 con 0x7f6704103550 2024-05-03T16:46:42.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.124+0000 7f66faa00700 1 --2- 172.21.15.81:0/304649183 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f66e80b2910 0x7f66e80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:42.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.125+0000 7f66faa00700 1 -- 172.21.15.81:0/304649183 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f66f40e2740 con 0x7f6704103550 2024-05-03T16:46:42.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.125+0000 7f6701400700 1 --2- 172.21.15.81:0/304649183 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f66e80b2910 0x7f66e80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:42.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.125+0000 7f66faa00700 1 --2- 172.21.15.81:0/304649183 >> [v2:172.21.15.146:6816/2423161684,v1:172.21.15.146:6817/2423161684] conn(0x7f66e80bdbf0 0x7f66e80c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:42.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.125+0000 7f66faa00700 1 -- 172.21.15.81:0/304649183 --> [v2:172.21.15.146:6816/2423161684,v1:172.21.15.146:6817/2423161684] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66f4012ec0 con 0x7f66e80bdbf0 2024-05-03T16:46:42.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.125+0000 7f66faa00700 1 -- 172.21.15.81:0/304649183 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f66f40e2af0 con 0x7f6704103550 2024-05-03T16:46:42.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.125+0000 7f6701400700 1 --2- 172.21.15.81:0/304649183 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f66e80b2910 0x7f66e80b4dd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f66f0005fd0 tx=0x7f66f0005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:42.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.147+0000 7f6702800700 1 --2- 172.21.15.81:0/304649183 >> [v2:172.21.15.146:6816/2423161684,v1:172.21.15.146:6817/2423161684] conn(0x7f66e80bdbf0 0x7f66e80c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:42.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.148+0000 7f6702800700 1 --2- 172.21.15.81:0/304649183 >> [v2:172.21.15.146:6816/2423161684,v1:172.21.15.146:6817/2423161684] conn(0x7f66e80bdbf0 0x7f66e80c0090 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:42.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.151+0000 7f66faa00700 1 -- 172.21.15.81:0/304649183 <== osd.8 v2:172.21.15.146:6816/2423161684 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f66f4012ec0 con 0x7f66e80bdbf0 2024-05-03T16:46:42.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.169+0000 7f6708c00700 1 -- 172.21.15.81:0/304649183 --> [v2:172.21.15.146:6816/2423161684,v1:172.21.15.146:6817/2423161684] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6704063f70 con 0x7f66e80bdbf0 2024-05-03T16:46:42.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.170+0000 7f66faa00700 1 -- 172.21.15.81:0/304649183 <== osd.8 v2:172.21.15.146:6816/2423161684 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6704063f70 con 0x7f66e80bdbf0 2024-05-03T16:46:42.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.170+0000 7f6708c00700 1 -- 172.21.15.81:0/304649183 >> [v2:172.21.15.146:6816/2423161684,v1:172.21.15.146:6817/2423161684] conn(0x7f66e80bdbf0 msgr2=0x7f66e80c0090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:42.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.170+0000 7f6708c00700 1 --2- 172.21.15.81:0/304649183 >> [v2:172.21.15.146:6816/2423161684,v1:172.21.15.146:6817/2423161684] conn(0x7f66e80bdbf0 0x7f66e80c0090 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.170+0000 7f6708c00700 1 -- 172.21.15.81:0/304649183 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f66e80b2910 msgr2=0x7f66e80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:42.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.170+0000 7f6708c00700 1 --2- 172.21.15.81:0/304649183 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f66e80b2910 0x7f66e80b4dd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f66f0005fd0 tx=0x7f66f0005e20 comp rx=0 tx=0).stop 2024-05-03T16:46:42.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.170+0000 7f6708c00700 1 -- 172.21.15.81:0/304649183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6704103550 msgr2=0x7f67040757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:42.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.170+0000 7f6708c00700 1 --2- 172.21.15.81:0/304649183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6704103550 0x7f67040757a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f66f400c970 tx=0x7f66f400cd30 comp rx=0 tx=0).stop 2024-05-03T16:46:42.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.171+0000 7f6702800700 1 -- 172.21.15.81:0/304649183 reap_dead start 2024-05-03T16:46:42.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.171+0000 7f6708c00700 1 -- 172.21.15.81:0/304649183 shutdown_connections 2024-05-03T16:46:42.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.171+0000 7f6708c00700 1 -- 172.21.15.81:0/304649183 >> 172.21.15.81:0/304649183 conn(0x7f670407a600 msgr2=0x7f67041015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:42.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.171+0000 7f6708c00700 1 -- 172.21.15.81:0/304649183 shutdown_connections 2024-05-03T16:46:42.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.171+0000 7f6708c00700 1 -- 172.21.15.81:0/304649183 wait complete. 2024-05-03T16:46:42.364 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:42 smithi081 ceph-mon[28640]: pgmap v459: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:42.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.383+0000 7ff596a00700 1 -- 172.21.15.81:0/2786099837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5901023a0 msgr2=0x7ff590102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:42.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.383+0000 7ff596a00700 1 --2- 172.21.15.81:0/2786099837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5901023a0 0x7ff590102820 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009990 tx=0x7ff57c009ca0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.383+0000 7ff596a00700 1 -- 172.21.15.81:0/2786099837 shutdown_connections 2024-05-03T16:46:42.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.383+0000 7ff596a00700 1 --2- 172.21.15.81:0/2786099837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff590102d60 0x7ff59010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.383+0000 7ff596a00700 1 --2- 172.21.15.81:0/2786099837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff590108410 0x7ff5901087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.383+0000 7ff596a00700 1 --2- 172.21.15.81:0/2786099837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5901023a0 0x7ff590102820 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.383+0000 7ff596a00700 1 -- 172.21.15.81:0/2786099837 >> 172.21.15.81:0/2786099837 conn(0x7ff590079350 msgr2=0x7ff590079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:42.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.383+0000 7ff596a00700 1 -- 172.21.15.81:0/2786099837 shutdown_connections 2024-05-03T16:46:42.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.383+0000 7ff596a00700 1 -- 172.21.15.81:0/2786099837 wait complete. 2024-05-03T16:46:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.384+0000 7ff596a00700 1 Processor -- start 2024-05-03T16:46:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.384+0000 7ff596a00700 1 -- start start 2024-05-03T16:46:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.384+0000 7ff596a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5901023a0 0x7ff590104080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.384+0000 7ff596a00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff590102d60 0x7ff5901045c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.384+0000 7ff596a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff590108410 0x7ff590104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.384+0000 7ff596a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff590112430 con 0x7ff5901023a0 2024-05-03T16:46:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.384+0000 7ff596a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff5901122b0 con 0x7ff590108410 2024-05-03T16:46:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.384+0000 7ff596a00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff5901125b0 con 0x7ff590102d60 2024-05-03T16:46:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.385+0000 7ff58fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5901023a0 0x7ff590104080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.385+0000 7ff58fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5901023a0 0x7ff590104080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32936/0 (socket says 172.21.15.81:32936) 2024-05-03T16:46:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.385+0000 7ff58fe00700 1 -- 172.21.15.81:0/3109258554 learned_addr learned my addr 172.21.15.81:0/3109258554 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:46:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.385+0000 7ff58f400700 1 --2- 172.21.15.81:0/3109258554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff590102d60 0x7ff5901045c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.385+0000 7ff594a00700 1 --2- 172.21.15.81:0/3109258554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff590108410 0x7ff590104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.385+0000 7ff58fe00700 1 -- 172.21.15.81:0/3109258554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff590102d60 msgr2=0x7ff5901045c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.385+0000 7ff58fe00700 1 --2- 172.21.15.81:0/3109258554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff590102d60 0x7ff5901045c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.385+0000 7ff58fe00700 1 -- 172.21.15.81:0/3109258554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff590108410 msgr2=0x7ff590104b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.385+0000 7ff58fe00700 1 --2- 172.21.15.81:0/3109258554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff590108410 0x7ff590104b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.385+0000 7ff58fe00700 1 -- 172.21.15.81:0/3109258554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5901a7fe0 con 0x7ff5901023a0 2024-05-03T16:46:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.386+0000 7ff58fe00700 1 --2- 172.21.15.81:0/3109258554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5901023a0 0x7ff590104080 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff58000c9b0 tx=0x7ff58000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.386+0000 7ff58cc00700 1 -- 172.21.15.81:0/3109258554 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff580007b00 con 0x7ff5901023a0 2024-05-03T16:46:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.386+0000 7ff58cc00700 1 -- 172.21.15.81:0/3109258554 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff580007ca0 con 0x7ff5901023a0 2024-05-03T16:46:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.386+0000 7ff58cc00700 1 -- 172.21.15.81:0/3109258554 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff580018660 con 0x7ff5901023a0 2024-05-03T16:46:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.386+0000 7ff596a00700 1 -- 172.21.15.81:0/3109258554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5901a82d0 con 0x7ff5901023a0 2024-05-03T16:46:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.386+0000 7ff596a00700 1 -- 172.21.15.81:0/3109258554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5901a87c0 con 0x7ff5901023a0 2024-05-03T16:46:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.387+0000 7ff596a00700 1 -- 172.21.15.81:0/3109258554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff590106490 con 0x7ff5901023a0 2024-05-03T16:46:42.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.390+0000 7ff58cc00700 1 -- 172.21.15.81:0/3109258554 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff58000f450 con 0x7ff5901023a0 2024-05-03T16:46:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.392+0000 7ff58cc00700 1 --2- 172.21.15.81:0/3109258554 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff5740b2990 0x7ff5740b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.392+0000 7ff58cc00700 1 -- 172.21.15.81:0/3109258554 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7ff5800e2b80 con 0x7ff5901023a0 2024-05-03T16:46:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.392+0000 7ff58f400700 1 --2- 172.21.15.81:0/3109258554 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff5740b2990 0x7ff5740b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.392+0000 7ff58cc00700 1 --2- 172.21.15.81:0/3109258554 >> [v2:172.21.15.134:6816/3241993481,v1:172.21.15.134:6817/3241993481] conn(0x7ff5740bdc70 0x7ff5740c0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.392+0000 7ff58cc00700 1 -- 172.21.15.81:0/3109258554 --> [v2:172.21.15.134:6816/3241993481,v1:172.21.15.134:6817/3241993481] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff580007e50 con 0x7ff5740bdc70 2024-05-03T16:46:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.392+0000 7ff58cc00700 1 -- 172.21.15.81:0/3109258554 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7ff5800e2f30 con 0x7ff5901023a0 2024-05-03T16:46:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.393+0000 7ff58f400700 1 --2- 172.21.15.81:0/3109258554 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff5740b2990 0x7ff5740b4e50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00b5c0 tx=0x7ff57c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.393+0000 7ff594a00700 1 --2- 172.21.15.81:0/3109258554 >> [v2:172.21.15.134:6816/3241993481,v1:172.21.15.134:6817/3241993481] conn(0x7ff5740bdc70 0x7ff5740c0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.394+0000 7ff594a00700 1 --2- 172.21.15.81:0/3109258554 >> [v2:172.21.15.134:6816/3241993481,v1:172.21.15.134:6817/3241993481] conn(0x7ff5740bdc70 0x7ff5740c0110 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.396+0000 7ff58cc00700 1 -- 172.21.15.81:0/3109258554 <== osd.7 v2:172.21.15.134:6816/3241993481 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff580007e50 con 0x7ff5740bdc70 2024-05-03T16:46:42.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.414+0000 7ff596a00700 1 -- 172.21.15.81:0/3109258554 --> [v2:172.21.15.134:6816/3241993481,v1:172.21.15.134:6817/3241993481] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff590103ac0 con 0x7ff5740bdc70 2024-05-03T16:46:42.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.415+0000 7ff58cc00700 1 -- 172.21.15.81:0/3109258554 <== osd.7 v2:172.21.15.134:6816/3241993481 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff590103ac0 con 0x7ff5740bdc70 2024-05-03T16:46:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.415+0000 7ff596a00700 1 -- 172.21.15.81:0/3109258554 >> [v2:172.21.15.134:6816/3241993481,v1:172.21.15.134:6817/3241993481] conn(0x7ff5740bdc70 msgr2=0x7ff5740c0110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.415+0000 7ff596a00700 1 --2- 172.21.15.81:0/3109258554 >> [v2:172.21.15.134:6816/3241993481,v1:172.21.15.134:6817/3241993481] conn(0x7ff5740bdc70 0x7ff5740c0110 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.416+0000 7ff596a00700 1 -- 172.21.15.81:0/3109258554 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff5740b2990 msgr2=0x7ff5740b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.416+0000 7ff596a00700 1 --2- 172.21.15.81:0/3109258554 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff5740b2990 0x7ff5740b4e50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00b5c0 tx=0x7ff57c01a040 comp rx=0 tx=0).stop 2024-05-03T16:46:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.416+0000 7ff596a00700 1 -- 172.21.15.81:0/3109258554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5901023a0 msgr2=0x7ff590104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.416+0000 7ff596a00700 1 --2- 172.21.15.81:0/3109258554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5901023a0 0x7ff590104080 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff58000c9b0 tx=0x7ff58000cd70 comp rx=0 tx=0).stop 2024-05-03T16:46:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.416+0000 7ff594a00700 1 -- 172.21.15.81:0/3109258554 reap_dead start 2024-05-03T16:46:42.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.416+0000 7ff596a00700 1 -- 172.21.15.81:0/3109258554 shutdown_connections 2024-05-03T16:46:42.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.416+0000 7ff596a00700 1 -- 172.21.15.81:0/3109258554 >> 172.21.15.81:0/3109258554 conn(0x7ff590079350 msgr2=0x7ff590101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:42.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.416+0000 7ff596a00700 1 -- 172.21.15.81:0/3109258554 shutdown_connections 2024-05-03T16:46:42.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:42.416+0000 7ff596a00700 1 -- 172.21.15.81:0/3109258554 wait complete. 2024-05-03T16:46:42.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:42 smithi134 ceph-mon[31708]: pgmap v459: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:42.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.786+0000 7f335a400700 1 -- 172.21.15.81:0/4111398661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3354106080 msgr2=0x7f3354112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:42.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.786+0000 7f335a400700 1 --2- 172.21.15.81:0/4111398661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3354106080 0x7f3354112590 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f334c00b0a0 tx=0x7f334c00b3b0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.786+0000 7f335a400700 1 -- 172.21.15.81:0/4111398661 shutdown_connections 2024-05-03T16:46:42.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.786+0000 7f335a400700 1 --2- 172.21.15.81:0/4111398661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f335410b6c0 0x7f335410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.786+0000 7f335a400700 1 --2- 172.21.15.81:0/4111398661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3354106080 0x7f3354112590 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.786+0000 7f335a400700 1 --2- 172.21.15.81:0/4111398661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33541056c0 0x7f3354105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.786+0000 7f335a400700 1 -- 172.21.15.81:0/4111398661 >> 172.21.15.81:0/4111398661 conn(0x7f33541011b0 msgr2=0x7f33541035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.787+0000 7f335a400700 1 -- 172.21.15.81:0/4111398661 shutdown_connections 2024-05-03T16:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.787+0000 7f335a400700 1 -- 172.21.15.81:0/4111398661 wait complete. 2024-05-03T16:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.788+0000 7f335a400700 1 Processor -- start 2024-05-03T16:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.788+0000 7f335a400700 1 -- start start 2024-05-03T16:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.789+0000 7f335a400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33541056c0 0x7f33541a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.789+0000 7f335a400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3354106080 0x7f33541a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.789+0000 7f335a400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f335410b6c0 0x7f335419ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.789+0000 7f335a400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f33541157b0 con 0x7f335410b6c0 2024-05-03T16:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.789+0000 7f335a400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3354115630 con 0x7f33541056c0 2024-05-03T16:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.789+0000 7f335a400700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3354115930 con 0x7f3354106080 2024-05-03T16:46:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.789+0000 7f3353e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f335410b6c0 0x7f335419ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.789+0000 7f3353e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f335410b6c0 0x7f335419ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32900/0 (socket says 172.21.15.81:32900) 2024-05-03T16:46:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.789+0000 7f3353e00700 1 -- 172.21.15.81:0/3447730564 learned_addr learned my addr 172.21.15.81:0/3447730564 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:46:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.790+0000 7f3352a00700 1 --2- 172.21.15.81:0/3447730564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3354106080 0x7f33541a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.790+0000 7f3353400700 1 --2- 172.21.15.81:0/3447730564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33541056c0 0x7f33541a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.790+0000 7f3353e00700 1 -- 172.21.15.81:0/3447730564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3354106080 msgr2=0x7f33541a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.790+0000 7f3353e00700 1 --2- 172.21.15.81:0/3447730564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3354106080 0x7f33541a1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.790+0000 7f3353e00700 1 -- 172.21.15.81:0/3447730564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33541056c0 msgr2=0x7f33541a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.790+0000 7f3353e00700 1 --2- 172.21.15.81:0/3447730564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33541056c0 0x7f33541a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.790+0000 7f3353e00700 1 -- 172.21.15.81:0/3447730564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335419c1d0 con 0x7f335410b6c0 2024-05-03T16:46:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.790+0000 7f3352a00700 1 --2- 172.21.15.81:0/3447730564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3354106080 0x7f33541a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:46:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.790+0000 7f3353400700 1 --2- 172.21.15.81:0/3447730564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33541056c0 0x7f33541a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:46:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.790+0000 7f3353e00700 1 --2- 172.21.15.81:0/3447730564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f335410b6c0 0x7f335419ba70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f334c0062a0 tx=0x7f334c004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:42.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.790+0000 7f334be00700 1 -- 172.21.15.81:0/3447730564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c021070 con 0x7f335410b6c0 2024-05-03T16:46:42.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.790+0000 7f334be00700 1 -- 172.21.15.81:0/3447730564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f334c007d00 con 0x7f335410b6c0 2024-05-03T16:46:42.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.790+0000 7f335a400700 1 -- 172.21.15.81:0/3447730564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f335419c460 con 0x7f335410b6c0 2024-05-03T16:46:42.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.790+0000 7f334be00700 1 -- 172.21.15.81:0/3447730564 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c005280 con 0x7f335410b6c0 2024-05-03T16:46:42.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.791+0000 7f335a400700 1 -- 172.21.15.81:0/3447730564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33541a8730 con 0x7f335410b6c0 2024-05-03T16:46:42.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.791+0000 7f335a400700 1 -- 172.21.15.81:0/3447730564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3354063c30 con 0x7f335410b6c0 2024-05-03T16:46:42.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.794+0000 7f334be00700 1 -- 172.21.15.81:0/3447730564 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f334c024070 con 0x7f335410b6c0 2024-05-03T16:46:42.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.796+0000 7f334be00700 1 --2- 172.21.15.81:0/3447730564 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f33380b2910 0x7f33380b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:42.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.796+0000 7f334be00700 1 -- 172.21.15.81:0/3447730564 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f334c0e3ed0 con 0x7f335410b6c0 2024-05-03T16:46:42.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.796+0000 7f3353400700 1 --2- 172.21.15.81:0/3447730564 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f33380b2910 0x7f33380b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:42.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.796+0000 7f334be00700 1 --2- 172.21.15.81:0/3447730564 >> [v2:172.21.15.146:6808/1276988922,v1:172.21.15.146:6809/1276988922] conn(0x7f33380bdbf0 0x7f33380c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:42.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.796+0000 7f334be00700 1 -- 172.21.15.81:0/3447730564 --> [v2:172.21.15.146:6808/1276988922,v1:172.21.15.146:6809/1276988922] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f33380c0760 con 0x7f33380bdbf0 2024-05-03T16:46:42.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.796+0000 7f334be00700 1 -- 172.21.15.81:0/3447730564 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f334c0e4280 con 0x7f335410b6c0 2024-05-03T16:46:42.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.797+0000 7f3353400700 1 --2- 172.21.15.81:0/3447730564 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f33380b2910 0x7f33380b4dd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3344005fd0 tx=0x7f3344005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:42.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.797+0000 7f3352a00700 1 --2- 172.21.15.81:0/3447730564 >> [v2:172.21.15.146:6808/1276988922,v1:172.21.15.146:6809/1276988922] conn(0x7f33380bdbf0 0x7f33380c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:42.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.798+0000 7f3352a00700 1 --2- 172.21.15.81:0/3447730564 >> [v2:172.21.15.146:6808/1276988922,v1:172.21.15.146:6809/1276988922] conn(0x7f33380bdbf0 0x7f33380c0090 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:42.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.801+0000 7f334be00700 1 -- 172.21.15.81:0/3447730564 <== osd.5 v2:172.21.15.146:6808/1276988922 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f33380c0760 con 0x7f33380bdbf0 2024-05-03T16:46:42.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.819+0000 7f335a400700 1 -- 172.21.15.81:0/3447730564 --> [v2:172.21.15.146:6808/1276988922,v1:172.21.15.146:6809/1276988922] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f33540640b0 con 0x7f33380bdbf0 2024-05-03T16:46:42.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.820+0000 7f334be00700 1 -- 172.21.15.81:0/3447730564 <== osd.5 v2:172.21.15.146:6808/1276988922 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f33540640b0 con 0x7f33380bdbf0 2024-05-03T16:46:42.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.820+0000 7f335a400700 1 -- 172.21.15.81:0/3447730564 >> [v2:172.21.15.146:6808/1276988922,v1:172.21.15.146:6809/1276988922] conn(0x7f33380bdbf0 msgr2=0x7f33380c0090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:42.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.820+0000 7f335a400700 1 --2- 172.21.15.81:0/3447730564 >> [v2:172.21.15.146:6808/1276988922,v1:172.21.15.146:6809/1276988922] conn(0x7f33380bdbf0 0x7f33380c0090 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.821+0000 7f335a400700 1 -- 172.21.15.81:0/3447730564 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f33380b2910 msgr2=0x7f33380b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:42.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.821+0000 7f335a400700 1 --2- 172.21.15.81:0/3447730564 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f33380b2910 0x7f33380b4dd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3344005fd0 tx=0x7f3344005d60 comp rx=0 tx=0).stop 2024-05-03T16:46:42.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.821+0000 7f335a400700 1 -- 172.21.15.81:0/3447730564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f335410b6c0 msgr2=0x7f335419ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:42.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.821+0000 7f335a400700 1 --2- 172.21.15.81:0/3447730564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f335410b6c0 0x7f335419ba70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f334c0062a0 tx=0x7f334c004ed0 comp rx=0 tx=0).stop 2024-05-03T16:46:42.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.821+0000 7f3353e00700 1 -- 172.21.15.81:0/3447730564 reap_dead start 2024-05-03T16:46:42.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.821+0000 7f335a400700 1 -- 172.21.15.81:0/3447730564 shutdown_connections 2024-05-03T16:46:42.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.821+0000 7f335a400700 1 -- 172.21.15.81:0/3447730564 >> 172.21.15.81:0/3447730564 conn(0x7f33541011b0 msgr2=0x7f3354101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:42.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.821+0000 7f335a400700 1 -- 172.21.15.81:0/3447730564 shutdown_connections 2024-05-03T16:46:42.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:38.821+0000 7f335a400700 1 -- 172.21.15.81:0/3447730564 wait complete. 2024-05-03T16:46:42.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:42 smithi146 ceph-mon[32357]: pgmap v459: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.270+0000 7f18f9600700 1 -- 172.21.15.81:0/337854811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f410e8b0 msgr2=0x7f18f410ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.270+0000 7f18f9600700 1 --2- 172.21.15.81:0/337854811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f410e8b0 0x7f18f410ec90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009990 tx=0x7f18e4009ca0 comp rx=0 tx=0).stop 2024-05-03T16:46:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.270+0000 7f18f9600700 1 -- 172.21.15.81:0/337854811 shutdown_connections 2024-05-03T16:46:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.270+0000 7f18f9600700 1 --2- 172.21.15.81:0/337854811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f410a3a0 0x7f18f4116840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.270+0000 7f18f9600700 1 --2- 172.21.15.81:0/337854811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f410e8b0 0x7f18f410ec90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.270+0000 7f18f9600700 1 --2- 172.21.15.81:0/337854811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18f41099e0 0x7f18f4109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.270+0000 7f18f9600700 1 -- 172.21.15.81:0/337854811 >> 172.21.15.81:0/337854811 conn(0x7f18f4079230 msgr2=0x7f18f41082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.270+0000 7f18f9600700 1 -- 172.21.15.81:0/337854811 shutdown_connections 2024-05-03T16:46:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.270+0000 7f18f9600700 1 -- 172.21.15.81:0/337854811 wait complete. 2024-05-03T16:46:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.271+0000 7f18f9600700 1 Processor -- start 2024-05-03T16:46:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.271+0000 7f18f9600700 1 -- start start 2024-05-03T16:46:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.271+0000 7f18f9600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f41099e0 0x7f18f419ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.271+0000 7f18f9600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18f410a3a0 0x7f18f41a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.272+0000 7f18f9600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f410e8b0 0x7f18f41a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.272+0000 7f18f9600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18f4119a30 con 0x7f18f41099e0 2024-05-03T16:46:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.272+0000 7f18f9600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f18f41198b0 con 0x7f18f410e8b0 2024-05-03T16:46:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.272+0000 7f18f9600700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f18f4119bb0 con 0x7f18f410a3a0 2024-05-03T16:46:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.272+0000 7f18f3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f41099e0 0x7f18f419ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.272+0000 7f18f3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f41099e0 0x7f18f419ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32960/0 (socket says 172.21.15.81:32960) 2024-05-03T16:46:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.272+0000 7f18f3e00700 1 -- 172.21.15.81:0/3361223664 learned_addr learned my addr 172.21.15.81:0/3361223664 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:46:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.272+0000 7f18f8c00700 1 --2- 172.21.15.81:0/3361223664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f410e8b0 0x7f18f41a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.272+0000 7f18f3e00700 1 -- 172.21.15.81:0/3361223664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18f410a3a0 msgr2=0x7f18f41a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.272+0000 7f18f3400700 1 --2- 172.21.15.81:0/3361223664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18f410a3a0 0x7f18f41a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.272+0000 7f18f3e00700 1 --2- 172.21.15.81:0/3361223664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18f410a3a0 0x7f18f41a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.272+0000 7f18f3e00700 1 -- 172.21.15.81:0/3361223664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f410e8b0 msgr2=0x7f18f41a47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.272+0000 7f18f3e00700 1 --2- 172.21.15.81:0/3361223664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f410e8b0 0x7f18f41a47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.272+0000 7f18f3e00700 1 -- 172.21.15.81:0/3361223664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f41a4f30 con 0x7f18f41099e0 2024-05-03T16:46:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.272+0000 7f18f8c00700 1 --2- 172.21.15.81:0/3361223664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f410e8b0 0x7f18f41a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:46:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.272+0000 7f18f3400700 1 --2- 172.21.15.81:0/3361223664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18f410a3a0 0x7f18f41a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:46:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.273+0000 7f18f3e00700 1 --2- 172.21.15.81:0/3361223664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f41099e0 0x7f18f419ff20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f18e40057f0 tx=0x7f18e4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.273+0000 7f18f0c00700 1 -- 172.21.15.81:0/3361223664 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4027070 con 0x7f18f41099e0 2024-05-03T16:46:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.273+0000 7f18f0c00700 1 -- 172.21.15.81:0/3361223664 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18e400fd60 con 0x7f18f41099e0 2024-05-03T16:46:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.273+0000 7f18f0c00700 1 -- 172.21.15.81:0/3361223664 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4022de0 con 0x7f18f41099e0 2024-05-03T16:46:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.273+0000 7f18f9600700 1 -- 172.21.15.81:0/3361223664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f41a51c0 con 0x7f18f41099e0 2024-05-03T16:46:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.273+0000 7f18f9600700 1 -- 172.21.15.81:0/3361223664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f41acaa0 con 0x7f18f41099e0 2024-05-03T16:46:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.274+0000 7f18f9600700 1 -- 172.21.15.81:0/3361223664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f18f4063bf0 con 0x7f18f41099e0 2024-05-03T16:46:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.277+0000 7f18f0c00700 1 -- 172.21.15.81:0/3361223664 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f18e402a070 con 0x7f18f41099e0 2024-05-03T16:46:43.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.278+0000 7f18f0c00700 1 --2- 172.21.15.81:0/3361223664 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f18d80b2990 0x7f18d80b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:43.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.278+0000 7f18f0c00700 1 -- 172.21.15.81:0/3361223664 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f18e40e3a30 con 0x7f18f41099e0 2024-05-03T16:46:43.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.278+0000 7f18f3400700 1 --2- 172.21.15.81:0/3361223664 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f18d80b2990 0x7f18d80b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:43.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.279+0000 7f18f0c00700 1 --2- 172.21.15.81:0/3361223664 >> [v2:172.21.15.146:6824/2627233639,v1:172.21.15.146:6825/2627233639] conn(0x7f18d80bdc70 0x7f18d80c0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:43.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.279+0000 7f18f0c00700 1 -- 172.21.15.81:0/3361223664 --> [v2:172.21.15.146:6824/2627233639,v1:172.21.15.146:6825/2627233639] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f18e402ee80 con 0x7f18d80bdc70 2024-05-03T16:46:43.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.279+0000 7f18f0c00700 1 -- 172.21.15.81:0/3361223664 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f18e40e3e80 con 0x7f18f41099e0 2024-05-03T16:46:43.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.279+0000 7f18f3400700 1 --2- 172.21.15.81:0/3361223664 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f18d80b2990 0x7f18d80b4e50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f18e0005fd0 tx=0x7f18e0005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:43.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.279+0000 7f18f8c00700 1 --2- 172.21.15.81:0/3361223664 >> [v2:172.21.15.146:6824/2627233639,v1:172.21.15.146:6825/2627233639] conn(0x7f18d80bdc70 0x7f18d80c0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:43.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.280+0000 7f18f8c00700 1 --2- 172.21.15.81:0/3361223664 >> [v2:172.21.15.146:6824/2627233639,v1:172.21.15.146:6825/2627233639] conn(0x7f18d80bdc70 0x7f18d80c0110 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:43.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.283+0000 7f18f0c00700 1 -- 172.21.15.81:0/3361223664 <== osd.11 v2:172.21.15.146:6824/2627233639 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f18e402ee80 con 0x7f18d80bdc70 2024-05-03T16:46:43.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.301+0000 7f18f9600700 1 -- 172.21.15.81:0/3361223664 --> [v2:172.21.15.146:6824/2627233639,v1:172.21.15.146:6825/2627233639] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f18f40640c0 con 0x7f18d80bdc70 2024-05-03T16:46:43.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.302+0000 7f18f0c00700 1 -- 172.21.15.81:0/3361223664 <== osd.11 v2:172.21.15.146:6824/2627233639 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f18f40640c0 con 0x7f18d80bdc70 2024-05-03T16:46:43.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.302+0000 7f18f9600700 1 -- 172.21.15.81:0/3361223664 >> [v2:172.21.15.146:6824/2627233639,v1:172.21.15.146:6825/2627233639] conn(0x7f18d80bdc70 msgr2=0x7f18d80c0110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:43.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.302+0000 7f18f9600700 1 --2- 172.21.15.81:0/3361223664 >> [v2:172.21.15.146:6824/2627233639,v1:172.21.15.146:6825/2627233639] conn(0x7f18d80bdc70 0x7f18d80c0110 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:43.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.303+0000 7f18f9600700 1 -- 172.21.15.81:0/3361223664 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f18d80b2990 msgr2=0x7f18d80b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:43.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.303+0000 7f18f9600700 1 --2- 172.21.15.81:0/3361223664 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f18d80b2990 0x7f18d80b4e50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f18e0005fd0 tx=0x7f18e0005dc0 comp rx=0 tx=0).stop 2024-05-03T16:46:43.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.303+0000 7f18f9600700 1 -- 172.21.15.81:0/3361223664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f41099e0 msgr2=0x7f18f419ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:43.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.303+0000 7f18f9600700 1 --2- 172.21.15.81:0/3361223664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f41099e0 0x7f18f419ff20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f18e40057f0 tx=0x7f18e4009f90 comp rx=0 tx=0).stop 2024-05-03T16:46:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.303+0000 7f18f8c00700 1 -- 172.21.15.81:0/3361223664 reap_dead start 2024-05-03T16:46:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.303+0000 7f18f9600700 1 -- 172.21.15.81:0/3361223664 shutdown_connections 2024-05-03T16:46:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.303+0000 7f18f9600700 1 -- 172.21.15.81:0/3361223664 >> 172.21.15.81:0/3361223664 conn(0x7f18f4079230 msgr2=0x7f18f40798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.303+0000 7f18f9600700 1 -- 172.21.15.81:0/3361223664 shutdown_connections 2024-05-03T16:46:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:43.303+0000 7f18f9600700 1 -- 172.21.15.81:0/3361223664 wait complete. 2024-05-03T16:46:44.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:44 smithi134 ceph-mon[31708]: pgmap v460: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:46:44.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:44 smithi081 ceph-mon[28640]: pgmap v460: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:46:44.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:44 smithi146 ceph-mon[32357]: pgmap v460: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:46:45.438 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:45 smithi081 ceph-mon[28640]: pgmap v461: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:45.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:45 smithi134 ceph-mon[31708]: pgmap v461: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:45.488 INFO:teuthology.orchestra.run.smithi081.stdout:206158430290 2024-05-03T16:46:45.489 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-03T16:46:45.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:45 smithi146 ceph-mon[32357]: pgmap v461: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:46.405 INFO:teuthology.orchestra.run.smithi081.stdout:236223201353 2024-05-03T16:46:46.405 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-03T16:46:46.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.992+0000 7f5c87200700 1 -- 172.21.15.81:0/1709141008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c88104eb0 msgr2=0x7f5c8810d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:46.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.992+0000 7f5c87200700 1 --2- 172.21.15.81:0/1709141008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c88104eb0 0x7f5c8810d3a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5c74009990 tx=0x7f5c74009ca0 comp rx=0 tx=0).stop 2024-05-03T16:46:46.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.992+0000 7f5c87200700 1 -- 172.21.15.81:0/1709141008 shutdown_connections 2024-05-03T16:46:46.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.992+0000 7f5c87200700 1 --2- 172.21.15.81:0/1709141008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c88104590 0x7f5c88104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:46.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.992+0000 7f5c87200700 1 --2- 172.21.15.81:0/1709141008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c8810d9c0 0x7f5c8810fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:46.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.992+0000 7f5c87200700 1 --2- 172.21.15.81:0/1709141008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c88104eb0 0x7f5c8810d3a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:46.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.992+0000 7f5c87200700 1 -- 172.21.15.81:0/1709141008 >> 172.21.15.81:0/1709141008 conn(0x7f5c880fddc0 msgr2=0x7f5c881001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:46.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.993+0000 7f5c87200700 1 -- 172.21.15.81:0/1709141008 shutdown_connections 2024-05-03T16:46:46.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.993+0000 7f5c87200700 1 -- 172.21.15.81:0/1709141008 wait complete. 2024-05-03T16:46:46.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.994+0000 7f5c87200700 1 Processor -- start 2024-05-03T16:46:46.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.994+0000 7f5c87200700 1 -- start start 2024-05-03T16:46:46.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.994+0000 7f5c87200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c88104590 0x7f5c881a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:46.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.994+0000 7f5c87200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c88104eb0 0x7f5c881a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:46.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.994+0000 7f5c87200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c8810d9c0 0x7f5c8819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:46.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.994+0000 7f5c87200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5c881134b0 con 0x7f5c88104590 2024-05-03T16:46:46.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.994+0000 7f5c87200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5c88113330 con 0x7f5c8810d9c0 2024-05-03T16:46:46.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.994+0000 7f5c87200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5c88113630 con 0x7f5c88104eb0 2024-05-03T16:46:46.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.994+0000 7f5c85e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c88104590 0x7f5c881a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:46.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.994+0000 7f5c85e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c88104590 0x7f5c881a1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60178/0 (socket says 172.21.15.81:60178) 2024-05-03T16:46:46.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.995+0000 7f5c85e00700 1 -- 172.21.15.81:0/404804228 learned_addr learned my addr 172.21.15.81:0/404804228 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:46:46.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.995+0000 7f5c85400700 1 --2- 172.21.15.81:0/404804228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c88104eb0 0x7f5c881a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:46.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.995+0000 7f5c86800700 1 --2- 172.21.15.81:0/404804228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c8810d9c0 0x7f5c8819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:46.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.995+0000 7f5c85e00700 1 -- 172.21.15.81:0/404804228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c88104eb0 msgr2=0x7f5c881a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:46.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.995+0000 7f5c85e00700 1 --2- 172.21.15.81:0/404804228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c88104eb0 0x7f5c881a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:46.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.995+0000 7f5c85e00700 1 -- 172.21.15.81:0/404804228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c8810d9c0 msgr2=0x7f5c8819b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:46.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.995+0000 7f5c85e00700 1 --2- 172.21.15.81:0/404804228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c8810d9c0 0x7f5c8819b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:46.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.995+0000 7f5c85e00700 1 -- 172.21.15.81:0/404804228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c8819c150 con 0x7f5c88104590 2024-05-03T16:46:46.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.995+0000 7f5c86800700 1 --2- 172.21.15.81:0/404804228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c8810d9c0 0x7f5c8819b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:46:46.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.995+0000 7f5c85e00700 1 --2- 172.21.15.81:0/404804228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c88104590 0x7f5c881a1830 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800d980 tx=0x7f5c7800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:46.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.995+0000 7f5c7ea00700 1 -- 172.21.15.81:0/404804228 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c78017070 con 0x7f5c88104590 2024-05-03T16:46:46.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.996+0000 7f5c7ea00700 1 -- 172.21.15.81:0/404804228 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c78004830 con 0x7f5c88104590 2024-05-03T16:46:46.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.996+0000 7f5c7ea00700 1 -- 172.21.15.81:0/404804228 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c780053a0 con 0x7f5c88104590 2024-05-03T16:46:46.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.996+0000 7f5c87200700 1 -- 172.21.15.81:0/404804228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c8819c440 con 0x7f5c88104590 2024-05-03T16:46:46.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.996+0000 7f5c87200700 1 -- 172.21.15.81:0/404804228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c881a8700 con 0x7f5c88104590 2024-05-03T16:46:46.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.997+0000 7f5c87200700 1 -- 172.21.15.81:0/404804228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5c88103cd0 con 0x7f5c88104590 2024-05-03T16:46:47.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.999+0000 7f5c7ea00700 1 -- 172.21.15.81:0/404804228 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5c780049e0 con 0x7f5c88104590 2024-05-03T16:46:47.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.001+0000 7f5c7ea00700 1 --2- 172.21.15.81:0/404804228 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5c6c0b2910 0x7f5c6c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:47.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.001+0000 7f5c7ea00700 1 -- 172.21.15.81:0/404804228 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f5c780e2d50 con 0x7f5c88104590 2024-05-03T16:46:47.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.002+0000 7f5c85400700 1 --2- 172.21.15.81:0/404804228 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5c6c0b2910 0x7f5c6c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:47.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.002+0000 7f5c7ea00700 1 --2- 172.21.15.81:0/404804228 >> [v2:172.21.15.134:6800/1928503491,v1:172.21.15.134:6801/1928503491] conn(0x7f5c6c0bdbf0 0x7f5c6c0c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:47.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.002+0000 7f5c7ea00700 1 -- 172.21.15.81:0/404804228 --> [v2:172.21.15.134:6800/1928503491,v1:172.21.15.134:6801/1928503491] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c78013e50 con 0x7f5c6c0bdbf0 2024-05-03T16:46:47.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.002+0000 7f5c7ea00700 1 -- 172.21.15.81:0/404804228 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f5c780e3100 con 0x7f5c88104590 2024-05-03T16:46:47.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.002+0000 7f5c86800700 1 --2- 172.21.15.81:0/404804228 >> [v2:172.21.15.134:6800/1928503491,v1:172.21.15.134:6801/1928503491] conn(0x7f5c6c0bdbf0 0x7f5c6c0c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:47.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.002+0000 7f5c85400700 1 --2- 172.21.15.81:0/404804228 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5c6c0b2910 0x7f5c6c0b4dd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5c7400b5c0 tx=0x7f5c7401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:47.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.003+0000 7f5c86800700 1 --2- 172.21.15.81:0/404804228 >> [v2:172.21.15.134:6800/1928503491,v1:172.21.15.134:6801/1928503491] conn(0x7f5c6c0bdbf0 0x7f5c6c0c0090 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:47.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.006+0000 7f5c7ea00700 1 -- 172.21.15.81:0/404804228 <== osd.1 v2:172.21.15.134:6800/1928503491 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c78013e50 con 0x7f5c6c0bdbf0 2024-05-03T16:46:47.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.024+0000 7f5c87200700 1 -- 172.21.15.81:0/404804228 --> [v2:172.21.15.134:6800/1928503491,v1:172.21.15.134:6801/1928503491] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5c8806ba60 con 0x7f5c6c0bdbf0 2024-05-03T16:46:47.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.025+0000 7f5c7ea00700 1 -- 172.21.15.81:0/404804228 <== osd.1 v2:172.21.15.134:6800/1928503491 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5c8806ba60 con 0x7f5c6c0bdbf0 2024-05-03T16:46:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.025+0000 7f5c87200700 1 -- 172.21.15.81:0/404804228 >> [v2:172.21.15.134:6800/1928503491,v1:172.21.15.134:6801/1928503491] conn(0x7f5c6c0bdbf0 msgr2=0x7f5c6c0c0090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.025+0000 7f5c87200700 1 --2- 172.21.15.81:0/404804228 >> [v2:172.21.15.134:6800/1928503491,v1:172.21.15.134:6801/1928503491] conn(0x7f5c6c0bdbf0 0x7f5c6c0c0090 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.025+0000 7f5c87200700 1 -- 172.21.15.81:0/404804228 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5c6c0b2910 msgr2=0x7f5c6c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.025+0000 7f5c87200700 1 --2- 172.21.15.81:0/404804228 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5c6c0b2910 0x7f5c6c0b4dd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5c7400b5c0 tx=0x7f5c7401a040 comp rx=0 tx=0).stop 2024-05-03T16:46:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.025+0000 7f5c87200700 1 -- 172.21.15.81:0/404804228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c88104590 msgr2=0x7f5c881a1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.025+0000 7f5c87200700 1 --2- 172.21.15.81:0/404804228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c88104590 0x7f5c881a1830 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800d980 tx=0x7f5c7800dd40 comp rx=0 tx=0).stop 2024-05-03T16:46:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.025+0000 7f5c86800700 1 -- 172.21.15.81:0/404804228 reap_dead start 2024-05-03T16:46:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.026+0000 7f5c87200700 1 -- 172.21.15.81:0/404804228 shutdown_connections 2024-05-03T16:46:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.026+0000 7f5c87200700 1 -- 172.21.15.81:0/404804228 >> 172.21.15.81:0/404804228 conn(0x7f5c880fddc0 msgr2=0x7f5c8810ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.026+0000 7f5c87200700 1 -- 172.21.15.81:0/404804228 shutdown_connections 2024-05-03T16:46:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:47.026+0000 7f5c87200700 1 -- 172.21.15.81:0/404804228 wait complete. 2024-05-03T16:46:47.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.233+0000 7f434fc00700 1 -- 172.21.15.81:0/1055111203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f434810b6e0 msgr2=0x7f434810bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:47.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.233+0000 7f434fc00700 1 --2- 172.21.15.81:0/1055111203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f434810b6e0 0x7f434810bac0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f433c009990 tx=0x7f433c009ca0 comp rx=0 tx=0).stop 2024-05-03T16:46:47.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.233+0000 7f434fc00700 1 -- 172.21.15.81:0/1055111203 shutdown_connections 2024-05-03T16:46:47.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.233+0000 7f434fc00700 1 --2- 172.21.15.81:0/1055111203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43481060a0 0x7f43481125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:47.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.233+0000 7f434fc00700 1 --2- 172.21.15.81:0/1055111203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f434810b6e0 0x7f434810bac0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:47.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.233+0000 7f434fc00700 1 --2- 172.21.15.81:0/1055111203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43481056e0 0x7f4348105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:47.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.233+0000 7f434fc00700 1 -- 172.21.15.81:0/1055111203 >> 172.21.15.81:0/1055111203 conn(0x7f43481011d0 msgr2=0x7f43481035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:47.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.234+0000 7f434fc00700 1 -- 172.21.15.81:0/1055111203 shutdown_connections 2024-05-03T16:46:47.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.234+0000 7f434fc00700 1 -- 172.21.15.81:0/1055111203 wait complete. 2024-05-03T16:46:47.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.235+0000 7f434fc00700 1 Processor -- start 2024-05-03T16:46:47.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.236+0000 7f434fc00700 1 -- start start 2024-05-03T16:46:47.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.236+0000 7f434fc00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43481056e0 0x7f43481a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:47.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.236+0000 7f434fc00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43481060a0 0x7f43481a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:47.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.236+0000 7f434fc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f434810b6e0 0x7f434819baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:47.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.236+0000 7f434fc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4348115790 con 0x7f434810b6e0 2024-05-03T16:46:47.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.236+0000 7f434fc00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4348115610 con 0x7f43481056e0 2024-05-03T16:46:47.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.236+0000 7f434fc00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4348115910 con 0x7f43481060a0 2024-05-03T16:46:47.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.236+0000 7f434dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f434810b6e0 0x7f434819baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:47.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.237+0000 7f434dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f434810b6e0 0x7f434819baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32982/0 (socket says 172.21.15.81:32982) 2024-05-03T16:46:47.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.237+0000 7f434dc00700 1 -- 172.21.15.81:0/2111391902 learned_addr learned my addr 172.21.15.81:0/2111391902 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:46:47.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.237+0000 7f4347e00700 1 --2- 172.21.15.81:0/2111391902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43481060a0 0x7f43481a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:47.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.237+0000 7f434d200700 1 --2- 172.21.15.81:0/2111391902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43481056e0 0x7f43481a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:47.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.237+0000 7f434dc00700 1 -- 172.21.15.81:0/2111391902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43481060a0 msgr2=0x7f43481a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.237+0000 7f434dc00700 1 --2- 172.21.15.81:0/2111391902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43481060a0 0x7f43481a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.237+0000 7f434dc00700 1 -- 172.21.15.81:0/2111391902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43481056e0 msgr2=0x7f43481a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.237+0000 7f434dc00700 1 --2- 172.21.15.81:0/2111391902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43481056e0 0x7f43481a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.237+0000 7f434dc00700 1 -- 172.21.15.81:0/2111391902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434819c250 con 0x7f434810b6e0 2024-05-03T16:46:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.238+0000 7f434dc00700 1 --2- 172.21.15.81:0/2111391902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f434810b6e0 0x7f434819baf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4340007ee0 tx=0x7f434000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.238+0000 7f4345600700 1 -- 172.21.15.81:0/2111391902 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4340004bb0 con 0x7f434810b6e0 2024-05-03T16:46:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.238+0000 7f4345600700 1 -- 172.21.15.81:0/2111391902 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4340004d50 con 0x7f434810b6e0 2024-05-03T16:46:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.238+0000 7f4345600700 1 -- 172.21.15.81:0/2111391902 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43400058b0 con 0x7f434810b6e0 2024-05-03T16:46:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.238+0000 7f434fc00700 1 -- 172.21.15.81:0/2111391902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f434819c540 con 0x7f434810b6e0 2024-05-03T16:46:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.238+0000 7f434fc00700 1 -- 172.21.15.81:0/2111391902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43481a8800 con 0x7f434810b6e0 2024-05-03T16:46:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.239+0000 7f434fc00700 1 -- 172.21.15.81:0/2111391902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4348063c30 con 0x7f434810b6e0 2024-05-03T16:46:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.242+0000 7f4345600700 1 -- 172.21.15.81:0/2111391902 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f434001a020 con 0x7f434810b6e0 2024-05-03T16:46:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.243+0000 7f4345600700 1 --2- 172.21.15.81:0/2111391902 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f43300b2910 0x7f43300b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.243+0000 7f4345600700 1 -- 172.21.15.81:0/2111391902 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f43400e2460 con 0x7f434810b6e0 2024-05-03T16:46:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.244+0000 7f434d200700 1 --2- 172.21.15.81:0/2111391902 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f43300b2910 0x7f43300b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.244+0000 7f4345600700 1 --2- 172.21.15.81:0/2111391902 >> [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886] conn(0x7f43300bdbf0 0x7f43300c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.244+0000 7f4345600700 1 -- 172.21.15.81:0/2111391902 --> [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4340012ec0 con 0x7f43300bdbf0 2024-05-03T16:46:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.244+0000 7f4345600700 1 -- 172.21.15.81:0/2111391902 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f43400e28b0 con 0x7f434810b6e0 2024-05-03T16:46:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.244+0000 7f4347e00700 1 --2- 172.21.15.81:0/2111391902 >> [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886] conn(0x7f43300bdbf0 0x7f43300c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.244+0000 7f434d200700 1 --2- 172.21.15.81:0/2111391902 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f43300b2910 0x7f43300b4dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f433c0098e0 tx=0x7f433c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.245+0000 7f4347e00700 1 --2- 172.21.15.81:0/2111391902 >> [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886] conn(0x7f43300bdbf0 0x7f43300c0090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.246+0000 7f4345600700 1 -- 172.21.15.81:0/2111391902 <== osd.9 v2:172.21.15.81:6826/873909886 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4340012ec0 con 0x7f43300bdbf0 2024-05-03T16:46:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.272+0000 7f434fc00700 1 -- 172.21.15.81:0/2111391902 --> [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f43480640b0 con 0x7f43300bdbf0 2024-05-03T16:46:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.273+0000 7f4345600700 1 -- 172.21.15.81:0/2111391902 <== osd.9 v2:172.21.15.81:6826/873909886 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f43480640b0 con 0x7f43300bdbf0 2024-05-03T16:46:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.273+0000 7f434fc00700 1 -- 172.21.15.81:0/2111391902 >> [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886] conn(0x7f43300bdbf0 msgr2=0x7f43300c0090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.273+0000 7f434fc00700 1 --2- 172.21.15.81:0/2111391902 >> [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886] conn(0x7f43300bdbf0 0x7f43300c0090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.274+0000 7f434fc00700 1 -- 172.21.15.81:0/2111391902 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f43300b2910 msgr2=0x7f43300b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.274+0000 7f434fc00700 1 --2- 172.21.15.81:0/2111391902 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f43300b2910 0x7f43300b4dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f433c0098e0 tx=0x7f433c005960 comp rx=0 tx=0).stop 2024-05-03T16:46:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.274+0000 7f434fc00700 1 -- 172.21.15.81:0/2111391902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f434810b6e0 msgr2=0x7f434819baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.274+0000 7f434fc00700 1 --2- 172.21.15.81:0/2111391902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f434810b6e0 0x7f434819baf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4340007ee0 tx=0x7f434000d3b0 comp rx=0 tx=0).stop 2024-05-03T16:46:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.274+0000 7f434dc00700 1 -- 172.21.15.81:0/2111391902 reap_dead start 2024-05-03T16:46:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.274+0000 7f434fc00700 1 -- 172.21.15.81:0/2111391902 shutdown_connections 2024-05-03T16:46:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.274+0000 7f434fc00700 1 -- 172.21.15.81:0/2111391902 >> 172.21.15.81:0/2111391902 conn(0x7f43481011d0 msgr2=0x7f4348101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:47.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.275+0000 7f434fc00700 1 -- 172.21.15.81:0/2111391902 shutdown_connections 2024-05-03T16:46:47.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:45.275+0000 7f434fc00700 1 -- 172.21.15.81:0/2111391902 wait complete. 2024-05-03T16:46:47.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:47 smithi081 ceph-mon[28640]: pgmap v462: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-05-03T16:46:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:47 smithi134 ceph-mon[31708]: pgmap v462: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-05-03T16:46:47.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:47 smithi146 ceph-mon[32357]: pgmap v462: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-05-03T16:46:48.264 INFO:teuthology.orchestra.run.smithi081.stdout:158913790047 2024-05-03T16:46:48.264 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-03T16:46:49.099 INFO:teuthology.orchestra.run.smithi081.stdout:55834574971 2024-05-03T16:46:49.100 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-03T16:46:49.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:49 smithi081 ceph-mon[28640]: pgmap v463: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-05-03T16:46:49.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.888+0000 7ff5f2200700 1 -- 172.21.15.81:0/654802414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec103750 msgr2=0x7ff5ec103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:49.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.888+0000 7ff5f2200700 1 --2- 172.21.15.81:0/654802414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec103750 0x7ff5ec103b30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0099c0 tx=0x7ff5dc009cd0 comp rx=0 tx=0).stop 2024-05-03T16:46:49.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.888+0000 7ff5f2200700 1 -- 172.21.15.81:0/654802414 shutdown_connections 2024-05-03T16:46:49.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.888+0000 7ff5f2200700 1 --2- 172.21.15.81:0/654802414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5ec108850 0x7ff5ec1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:49.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.888+0000 7ff5f2200700 1 --2- 172.21.15.81:0/654802414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec103750 0x7ff5ec103b30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:49.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.888+0000 7ff5f2200700 1 --2- 172.21.15.81:0/654802414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5ec104100 0x7ff5ec108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:49.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.888+0000 7ff5f2200700 1 -- 172.21.15.81:0/654802414 >> 172.21.15.81:0/654802414 conn(0x7ff5ec07a600 msgr2=0x7ff5ec07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:49.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.888+0000 7ff5f2200700 1 -- 172.21.15.81:0/654802414 shutdown_connections 2024-05-03T16:46:49.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.888+0000 7ff5f2200700 1 -- 172.21.15.81:0/654802414 wait complete. 2024-05-03T16:46:49.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.889+0000 7ff5f2200700 1 Processor -- start 2024-05-03T16:46:49.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.889+0000 7ff5f2200700 1 -- start start 2024-05-03T16:46:49.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.890+0000 7ff5f2200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5ec103750 0x7ff5ec19f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:49.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.890+0000 7ff5f2200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5ec104100 0x7ff5ec19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:49.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.890+0000 7ff5f2200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec108850 0x7ff5ec199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:49.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.890+0000 7ff5f2200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ec113610 con 0x7ff5ec108850 2024-05-03T16:46:49.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.890+0000 7ff5f2200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ec113490 con 0x7ff5ec103750 2024-05-03T16:46:49.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.890+0000 7ff5f2200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ec113790 con 0x7ff5ec104100 2024-05-03T16:46:49.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.890+0000 7ff5ebe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec108850 0x7ff5ec199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:49.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.890+0000 7ff5ebe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec108850 0x7ff5ec199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60146/0 (socket says 172.21.15.81:60146) 2024-05-03T16:46:49.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.890+0000 7ff5ebe00700 1 -- 172.21.15.81:0/2537652118 learned_addr learned my addr 172.21.15.81:0/2537652118 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:46:49.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.891+0000 7ff5eb400700 1 --2- 172.21.15.81:0/2537652118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5ec103750 0x7ff5ec19f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:49.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.891+0000 7ff5eaa00700 1 --2- 172.21.15.81:0/2537652118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5ec104100 0x7ff5ec19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:49.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.891+0000 7ff5ebe00700 1 -- 172.21.15.81:0/2537652118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5ec104100 msgr2=0x7ff5ec19fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:49.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.891+0000 7ff5ebe00700 1 --2- 172.21.15.81:0/2537652118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5ec104100 0x7ff5ec19fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:49.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.891+0000 7ff5ebe00700 1 -- 172.21.15.81:0/2537652118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5ec103750 msgr2=0x7ff5ec19f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:49.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.891+0000 7ff5ebe00700 1 --2- 172.21.15.81:0/2537652118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5ec103750 0x7ff5ec19f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:49.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.891+0000 7ff5ebe00700 1 -- 172.21.15.81:0/2537652118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5ec19a090 con 0x7ff5ec108850 2024-05-03T16:46:49.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.891+0000 7ff5eb400700 1 --2- 172.21.15.81:0/2537652118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5ec103750 0x7ff5ec19f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:46:49.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.891+0000 7ff5eaa00700 1 --2- 172.21.15.81:0/2537652118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5ec104100 0x7ff5ec19fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:46:49.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.891+0000 7ff5ebe00700 1 --2- 172.21.15.81:0/2537652118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec108850 0x7ff5ec199930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff5e400b970 tx=0x7ff5e400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:49.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.892+0000 7ff5e3e00700 1 -- 172.21.15.81:0/2537652118 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4019070 con 0x7ff5ec108850 2024-05-03T16:46:49.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.892+0000 7ff5e3e00700 1 -- 172.21.15.81:0/2537652118 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5e400ce40 con 0x7ff5ec108850 2024-05-03T16:46:49.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.892+0000 7ff5e3e00700 1 -- 172.21.15.81:0/2537652118 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4007370 con 0x7ff5ec108850 2024-05-03T16:46:49.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.892+0000 7ff5f2200700 1 -- 172.21.15.81:0/2537652118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5ec19a380 con 0x7ff5ec108850 2024-05-03T16:46:49.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.892+0000 7ff5f2200700 1 -- 172.21.15.81:0/2537652118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5ec1a6640 con 0x7ff5ec108850 2024-05-03T16:46:49.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.893+0000 7ff5f2200700 1 -- 172.21.15.81:0/2537652118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff5cc001030 con 0x7ff5ec108850 2024-05-03T16:46:49.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.897+0000 7ff5e3e00700 1 -- 172.21.15.81:0/2537652118 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff5e401c070 con 0x7ff5ec108850 2024-05-03T16:46:49.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.898+0000 7ff5e3e00700 1 --2- 172.21.15.81:0/2537652118 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff5d00b2990 0x7ff5d00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:49.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.898+0000 7ff5e3e00700 1 -- 172.21.15.81:0/2537652118 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7ff5e40e24f0 con 0x7ff5ec108850 2024-05-03T16:46:49.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.898+0000 7ff5eb400700 1 --2- 172.21.15.81:0/2537652118 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff5d00b2990 0x7ff5d00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:49.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.899+0000 7ff5e3e00700 1 --2- 172.21.15.81:0/2537652118 >> [v2:172.21.15.134:6824/1183629038,v1:172.21.15.134:6825/1183629038] conn(0x7ff5d00bdc70 0x7ff5d00c0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:49.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.899+0000 7ff5e3e00700 1 -- 172.21.15.81:0/2537652118 --> [v2:172.21.15.134:6824/1183629038,v1:172.21.15.134:6825/1183629038] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5e4020e70 con 0x7ff5d00bdc70 2024-05-03T16:46:49.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.899+0000 7ff5e3e00700 1 -- 172.21.15.81:0/2537652118 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7ff5e40e28a0 con 0x7ff5ec108850 2024-05-03T16:46:49.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.899+0000 7ff5eb400700 1 --2- 172.21.15.81:0/2537652118 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff5d00b2990 0x7ff5d00b4e50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009990 tx=0x7ff5dc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:49.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.899+0000 7ff5eaa00700 1 --2- 172.21.15.81:0/2537652118 >> [v2:172.21.15.134:6824/1183629038,v1:172.21.15.134:6825/1183629038] conn(0x7ff5d00bdc70 0x7ff5d00c0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:49.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.901+0000 7ff5eaa00700 1 --2- 172.21.15.81:0/2537652118 >> [v2:172.21.15.134:6824/1183629038,v1:172.21.15.134:6825/1183629038] conn(0x7ff5d00bdc70 0x7ff5d00c0110 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:49.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.903+0000 7ff5e3e00700 1 -- 172.21.15.81:0/2537652118 <== osd.10 v2:172.21.15.134:6824/1183629038 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff5e4020e70 con 0x7ff5d00bdc70 2024-05-03T16:46:49.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.920+0000 7ff5f2200700 1 -- 172.21.15.81:0/2537652118 --> [v2:172.21.15.134:6824/1183629038,v1:172.21.15.134:6825/1183629038] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff5cc002e60 con 0x7ff5d00bdc70 2024-05-03T16:46:49.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.921+0000 7ff5e3e00700 1 -- 172.21.15.81:0/2537652118 <== osd.10 v2:172.21.15.134:6824/1183629038 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff5cc002e60 con 0x7ff5d00bdc70 2024-05-03T16:46:49.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.921+0000 7ff5f2200700 1 -- 172.21.15.81:0/2537652118 >> [v2:172.21.15.134:6824/1183629038,v1:172.21.15.134:6825/1183629038] conn(0x7ff5d00bdc70 msgr2=0x7ff5d00c0110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:49.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.921+0000 7ff5f2200700 1 --2- 172.21.15.81:0/2537652118 >> [v2:172.21.15.134:6824/1183629038,v1:172.21.15.134:6825/1183629038] conn(0x7ff5d00bdc70 0x7ff5d00c0110 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:49.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.921+0000 7ff5f2200700 1 -- 172.21.15.81:0/2537652118 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff5d00b2990 msgr2=0x7ff5d00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:49.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.921+0000 7ff5f2200700 1 --2- 172.21.15.81:0/2537652118 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff5d00b2990 0x7ff5d00b4e50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009990 tx=0x7ff5dc01a040 comp rx=0 tx=0).stop 2024-05-03T16:46:49.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.921+0000 7ff5f2200700 1 -- 172.21.15.81:0/2537652118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec108850 msgr2=0x7ff5ec199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:49.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.921+0000 7ff5f2200700 1 --2- 172.21.15.81:0/2537652118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec108850 0x7ff5ec199930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff5e400b970 tx=0x7ff5e400bd30 comp rx=0 tx=0).stop 2024-05-03T16:46:49.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.921+0000 7ff5ebe00700 1 -- 172.21.15.81:0/2537652118 reap_dead start 2024-05-03T16:46:49.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.921+0000 7ff5f2200700 1 -- 172.21.15.81:0/2537652118 shutdown_connections 2024-05-03T16:46:49.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.921+0000 7ff5f2200700 1 -- 172.21.15.81:0/2537652118 >> 172.21.15.81:0/2537652118 conn(0x7ff5ec07a600 msgr2=0x7ff5ec101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:49.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.921+0000 7ff5f2200700 1 -- 172.21.15.81:0/2537652118 shutdown_connections 2024-05-03T16:46:49.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:46.922+0000 7ff5f2200700 1 -- 172.21.15.81:0/2537652118 wait complete. 2024-05-03T16:46:49.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:49 smithi134 ceph-mon[31708]: pgmap v463: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-05-03T16:46:49.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:49 smithi146 ceph-mon[32357]: pgmap v463: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-05-03T16:46:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.315+0000 7fa10a000700 1 -- 172.21.15.81:0/868522602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa104075ff0 msgr2=0x7fa104114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.315+0000 7fa10a000700 1 --2- 172.21.15.81:0/868522602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa104075ff0 0x7fa104114130 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009990 tx=0x7fa0f0009ca0 comp rx=0 tx=0).stop 2024-05-03T16:46:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.315+0000 7fa10a000700 1 -- 172.21.15.81:0/868522602 shutdown_connections 2024-05-03T16:46:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.315+0000 7fa10a000700 1 --2- 172.21.15.81:0/868522602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1040756d0 0x7fa104075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.315+0000 7fa10a000700 1 --2- 172.21.15.81:0/868522602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa104114670 0x7fa104116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.315+0000 7fa10a000700 1 --2- 172.21.15.81:0/868522602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa104075ff0 0x7fa104114130 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.315+0000 7fa10a000700 1 -- 172.21.15.81:0/868522602 >> 172.21.15.81:0/868522602 conn(0x7fa10407a600 msgr2=0x7fa10407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.315+0000 7fa10a000700 1 -- 172.21.15.81:0/868522602 shutdown_connections 2024-05-03T16:46:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.315+0000 7fa10a000700 1 -- 172.21.15.81:0/868522602 wait complete. 2024-05-03T16:46:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.316+0000 7fa10a000700 1 Processor -- start 2024-05-03T16:46:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.316+0000 7fa10a000700 1 -- start start 2024-05-03T16:46:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.317+0000 7fa10a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1040756d0 0x7fa1041a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.317+0000 7fa10a000700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa104075ff0 0x7fa1041a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.317+0000 7fa10a000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa104114670 0x7fa1041a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.317+0000 7fa10a000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa104119b70 con 0x7fa1040756d0 2024-05-03T16:46:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.317+0000 7fa10a000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa1041199f0 con 0x7fa104114670 2024-05-03T16:46:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.317+0000 7fa10a000700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa104119cf0 con 0x7fa104075ff0 2024-05-03T16:46:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.317+0000 7fa103400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1040756d0 0x7fa1041a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.317+0000 7fa103400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1040756d0 0x7fa1041a0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60210/0 (socket says 172.21.15.81:60210) 2024-05-03T16:46:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.317+0000 7fa103400700 1 -- 172.21.15.81:0/3367680203 learned_addr learned my addr 172.21.15.81:0/3367680203 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:46:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.317+0000 7fa102a00700 1 --2- 172.21.15.81:0/3367680203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa104075ff0 0x7fa1041a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.318+0000 7fa103e00700 1 --2- 172.21.15.81:0/3367680203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa104114670 0x7fa1041a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.318+0000 7fa103400700 1 -- 172.21.15.81:0/3367680203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa104075ff0 msgr2=0x7fa1041a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.318+0000 7fa103400700 1 --2- 172.21.15.81:0/3367680203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa104075ff0 0x7fa1041a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.318+0000 7fa103400700 1 -- 172.21.15.81:0/3367680203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa104114670 msgr2=0x7fa1041a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.318+0000 7fa103400700 1 --2- 172.21.15.81:0/3367680203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa104114670 0x7fa1041a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.318+0000 7fa103400700 1 -- 172.21.15.81:0/3367680203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1041a5170 con 0x7fa1040756d0 2024-05-03T16:46:51.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.318+0000 7fa103e00700 1 --2- 172.21.15.81:0/3367680203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa104114670 0x7fa1041a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:46:51.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.318+0000 7fa103400700 1 --2- 172.21.15.81:0/3367680203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1040756d0 0x7fa1041a0160 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400d980 tx=0x7fa0f400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:51.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.319+0000 7fa0fbe00700 1 -- 172.21.15.81:0/3367680203 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4017070 con 0x7fa1040756d0 2024-05-03T16:46:51.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.319+0000 7fa0fbe00700 1 -- 172.21.15.81:0/3367680203 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0f4005020 con 0x7fa1040756d0 2024-05-03T16:46:51.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.319+0000 7fa10a000700 1 -- 172.21.15.81:0/3367680203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1041a5460 con 0x7fa1040756d0 2024-05-03T16:46:51.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.319+0000 7fa0fbe00700 1 -- 172.21.15.81:0/3367680203 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4009ab0 con 0x7fa1040756d0 2024-05-03T16:46:51.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.319+0000 7fa10a000700 1 -- 172.21.15.81:0/3367680203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1041acce0 con 0x7fa1040756d0 2024-05-03T16:46:51.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.320+0000 7fa10a000700 1 -- 172.21.15.81:0/3367680203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa104110b70 con 0x7fa1040756d0 2024-05-03T16:46:51.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.322+0000 7fa0fbe00700 1 -- 172.21.15.81:0/3367680203 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa0f4009c50 con 0x7fa1040756d0 2024-05-03T16:46:51.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.325+0000 7fa0fbe00700 1 --2- 172.21.15.81:0/3367680203 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa0e80b2910 0x7fa0e80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:51.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.325+0000 7fa0fbe00700 1 -- 172.21.15.81:0/3367680203 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fa0f40e26e0 con 0x7fa1040756d0 2024-05-03T16:46:51.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.325+0000 7fa102a00700 1 --2- 172.21.15.81:0/3367680203 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa0e80b2910 0x7fa0e80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:51.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.325+0000 7fa0fbe00700 1 --2- 172.21.15.81:0/3367680203 >> [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020] conn(0x7fa0e80bdbf0 0x7fa0e80c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:51.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.325+0000 7fa0fbe00700 1 -- 172.21.15.81:0/3367680203 --> [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa0f4015e80 con 0x7fa0e80bdbf0 2024-05-03T16:46:51.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.325+0000 7fa0fbe00700 1 -- 172.21.15.81:0/3367680203 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fa0f40e9050 con 0x7fa1040756d0 2024-05-03T16:46:51.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.326+0000 7fa102a00700 1 --2- 172.21.15.81:0/3367680203 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa0e80b2910 0x7fa0e80b4dd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0003760 tx=0x7fa0f0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:51.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.326+0000 7fa103e00700 1 --2- 172.21.15.81:0/3367680203 >> [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020] conn(0x7fa0e80bdbf0 0x7fa0e80c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:51.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.326+0000 7fa103e00700 1 --2- 172.21.15.81:0/3367680203 >> [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020] conn(0x7fa0e80bdbf0 0x7fa0e80c0090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:51.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.327+0000 7fa0fbe00700 1 -- 172.21.15.81:0/3367680203 <== osd.6 v2:172.21.15.81:6818/3319125020 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa0f4015e80 con 0x7fa0e80bdbf0 2024-05-03T16:46:51.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.345+0000 7fa10a000700 1 -- 172.21.15.81:0/3367680203 --> [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa104076dc0 con 0x7fa0e80bdbf0 2024-05-03T16:46:51.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.346+0000 7fa0fbe00700 1 -- 172.21.15.81:0/3367680203 <== osd.6 v2:172.21.15.81:6818/3319125020 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa104076dc0 con 0x7fa0e80bdbf0 2024-05-03T16:46:51.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.346+0000 7fa10a000700 1 -- 172.21.15.81:0/3367680203 >> [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020] conn(0x7fa0e80bdbf0 msgr2=0x7fa0e80c0090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:51.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.346+0000 7fa10a000700 1 --2- 172.21.15.81:0/3367680203 >> [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020] conn(0x7fa0e80bdbf0 0x7fa0e80c0090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:51.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.347+0000 7fa10a000700 1 -- 172.21.15.81:0/3367680203 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa0e80b2910 msgr2=0x7fa0e80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:51.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.347+0000 7fa10a000700 1 --2- 172.21.15.81:0/3367680203 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa0e80b2910 0x7fa0e80b4dd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0003760 tx=0x7fa0f0005fd0 comp rx=0 tx=0).stop 2024-05-03T16:46:51.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.347+0000 7fa10a000700 1 -- 172.21.15.81:0/3367680203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1040756d0 msgr2=0x7fa1041a0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:51.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.347+0000 7fa10a000700 1 --2- 172.21.15.81:0/3367680203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1040756d0 0x7fa1041a0160 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400d980 tx=0x7fa0f400dc90 comp rx=0 tx=0).stop 2024-05-03T16:46:51.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.347+0000 7fa103e00700 1 -- 172.21.15.81:0/3367680203 reap_dead start 2024-05-03T16:46:51.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.347+0000 7fa10a000700 1 -- 172.21.15.81:0/3367680203 shutdown_connections 2024-05-03T16:46:51.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.347+0000 7fa10a000700 1 -- 172.21.15.81:0/3367680203 >> 172.21.15.81:0/3367680203 conn(0x7fa10407a600 msgr2=0x7fa104110110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:51.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.347+0000 7fa10a000700 1 -- 172.21.15.81:0/3367680203 shutdown_connections 2024-05-03T16:46:51.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:49.347+0000 7fa10a000700 1 -- 172.21.15.81:0/3367680203 wait complete. 2024-05-03T16:46:51.542 INFO:teuthology.orchestra.run.smithi081.stdout:283467841596 2024-05-03T16:46:51.542 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-03T16:46:51.681 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:51 smithi081 ceph-mon[28640]: pgmap v464: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-05-03T16:46:51.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:51 smithi134 ceph-mon[31708]: pgmap v464: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-05-03T16:46:51.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:51 smithi146 ceph-mon[32357]: pgmap v464: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-05-03T16:46:51.962 INFO:teuthology.orchestra.run.smithi081.stdout:309237645365 2024-05-03T16:46:51.962 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-03T16:46:52.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.227+0000 7f3557200700 1 -- 172.21.15.81:0/2027985083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35581055d0 msgr2=0x7f3558105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:52.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.227+0000 7f3557200700 1 --2- 172.21.15.81:0/2027985083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35581055d0 0x7f3558105a50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f35440099c0 tx=0x7f3544009cd0 comp rx=0 tx=0).stop 2024-05-03T16:46:52.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.227+0000 7f3557200700 1 -- 172.21.15.81:0/2027985083 shutdown_connections 2024-05-03T16:46:52.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.227+0000 7f3557200700 1 --2- 172.21.15.81:0/2027985083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f355810b680 0x7f355810ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:52.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.227+0000 7f3557200700 1 --2- 172.21.15.81:0/2027985083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3558105f90 0x7f3558112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:52.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.227+0000 7f3557200700 1 --2- 172.21.15.81:0/2027985083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35581055d0 0x7f3558105a50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:52.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.227+0000 7f3557200700 1 -- 172.21.15.81:0/2027985083 >> 172.21.15.81:0/2027985083 conn(0x7f35581010e0 msgr2=0x7f3558103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:52.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.227+0000 7f3557200700 1 -- 172.21.15.81:0/2027985083 shutdown_connections 2024-05-03T16:46:52.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.228+0000 7f3557200700 1 -- 172.21.15.81:0/2027985083 wait complete. 2024-05-03T16:46:52.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.229+0000 7f3557200700 1 Processor -- start 2024-05-03T16:46:52.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.229+0000 7f3557200700 1 -- start start 2024-05-03T16:46:52.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.230+0000 7f3557200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35581055d0 0x7f35581a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:52.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.230+0000 7f3557200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3558105f90 0x7f35581a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:52.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.230+0000 7f3557200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f355810b680 0x7f355819b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:52.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.230+0000 7f3557200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35581156e0 con 0x7f355810b680 2024-05-03T16:46:52.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.230+0000 7f3557200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3558115560 con 0x7f35581055d0 2024-05-03T16:46:52.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.230+0000 7f3557200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3558115860 con 0x7f3558105f90 2024-05-03T16:46:52.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.230+0000 7f3556800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f355810b680 0x7f355819b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:52.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.230+0000 7f3556800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f355810b680 0x7f355819b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60218/0 (socket says 172.21.15.81:60218) 2024-05-03T16:46:52.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.230+0000 7f3556800700 1 -- 172.21.15.81:0/3984282952 learned_addr learned my addr 172.21.15.81:0/3984282952 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:46:52.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.230+0000 7f3555e00700 1 --2- 172.21.15.81:0/3984282952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35581055d0 0x7f35581a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:52.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.230+0000 7f3555400700 1 --2- 172.21.15.81:0/3984282952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3558105f90 0x7f35581a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:52.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.231+0000 7f3556800700 1 -- 172.21.15.81:0/3984282952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3558105f90 msgr2=0x7f35581a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:52.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.231+0000 7f3556800700 1 --2- 172.21.15.81:0/3984282952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3558105f90 0x7f35581a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:52.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.231+0000 7f3556800700 1 -- 172.21.15.81:0/3984282952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35581055d0 msgr2=0x7f35581a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:52.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.231+0000 7f3556800700 1 --2- 172.21.15.81:0/3984282952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35581055d0 0x7f35581a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:52.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.231+0000 7f3556800700 1 -- 172.21.15.81:0/3984282952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355819c060 con 0x7f355810b680 2024-05-03T16:46:52.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.231+0000 7f3556800700 1 --2- 172.21.15.81:0/3984282952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f355810b680 0x7f355819b900 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3550007d70 tx=0x7f355000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:52.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.231+0000 7f354ea00700 1 -- 172.21.15.81:0/3984282952 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550016020 con 0x7f355810b680 2024-05-03T16:46:52.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.231+0000 7f354ea00700 1 -- 172.21.15.81:0/3984282952 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f355000ad40 con 0x7f355810b680 2024-05-03T16:46:52.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.231+0000 7f3557200700 1 -- 172.21.15.81:0/3984282952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f355819c350 con 0x7f355810b680 2024-05-03T16:46:52.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.231+0000 7f354ea00700 1 -- 172.21.15.81:0/3984282952 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35500115e0 con 0x7f355810b680 2024-05-03T16:46:52.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.232+0000 7f3557200700 1 -- 172.21.15.81:0/3984282952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35581a8610 con 0x7f355810b680 2024-05-03T16:46:52.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.232+0000 7f3557200700 1 -- 172.21.15.81:0/3984282952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3558063c30 con 0x7f355810b680 2024-05-03T16:46:52.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.235+0000 7f354ea00700 1 -- 172.21.15.81:0/3984282952 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3550019020 con 0x7f355810b680 2024-05-03T16:46:52.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.236+0000 7f354ea00700 1 --2- 172.21.15.81:0/3984282952 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f353c0b2990 0x7f353c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:52.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.237+0000 7f354ea00700 1 -- 172.21.15.81:0/3984282952 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f35500e29f0 con 0x7f355810b680 2024-05-03T16:46:52.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.237+0000 7f3555e00700 1 --2- 172.21.15.81:0/3984282952 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f353c0b2990 0x7f353c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:52.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.237+0000 7f354ea00700 1 --2- 172.21.15.81:0/3984282952 >> [v2:172.21.15.146:6800/1233108455,v1:172.21.15.146:6801/1233108455] conn(0x7f353c0bdc70 0x7f353c0c0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:52.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.237+0000 7f354ea00700 1 -- 172.21.15.81:0/3984282952 --> [v2:172.21.15.146:6800/1233108455,v1:172.21.15.146:6801/1233108455] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f353c0c07e0 con 0x7f353c0bdc70 2024-05-03T16:46:52.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.237+0000 7f354ea00700 1 -- 172.21.15.81:0/3984282952 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f35500e2e40 con 0x7f355810b680 2024-05-03T16:46:52.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.237+0000 7f3555e00700 1 --2- 172.21.15.81:0/3984282952 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f353c0b2990 0x7f353c0b4e50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3548005950 tx=0x7f35480058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:52.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.238+0000 7f3555400700 1 --2- 172.21.15.81:0/3984282952 >> [v2:172.21.15.146:6800/1233108455,v1:172.21.15.146:6801/1233108455] conn(0x7f353c0bdc70 0x7f353c0c0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:52.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.239+0000 7f3555400700 1 --2- 172.21.15.81:0/3984282952 >> [v2:172.21.15.146:6800/1233108455,v1:172.21.15.146:6801/1233108455] conn(0x7f353c0bdc70 0x7f353c0c0110 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:52.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.241+0000 7f354ea00700 1 -- 172.21.15.81:0/3984282952 <== osd.2 v2:172.21.15.146:6800/1233108455 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f353c0c07e0 con 0x7f353c0bdc70 2024-05-03T16:46:52.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.260+0000 7f3557200700 1 -- 172.21.15.81:0/3984282952 --> [v2:172.21.15.146:6800/1233108455,v1:172.21.15.146:6801/1233108455] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f35580640b0 con 0x7f353c0bdc70 2024-05-03T16:46:52.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.261+0000 7f354ea00700 1 -- 172.21.15.81:0/3984282952 <== osd.2 v2:172.21.15.146:6800/1233108455 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f35580640b0 con 0x7f353c0bdc70 2024-05-03T16:46:52.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.261+0000 7f3557200700 1 -- 172.21.15.81:0/3984282952 >> [v2:172.21.15.146:6800/1233108455,v1:172.21.15.146:6801/1233108455] conn(0x7f353c0bdc70 msgr2=0x7f353c0c0110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:52.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.261+0000 7f3557200700 1 --2- 172.21.15.81:0/3984282952 >> [v2:172.21.15.146:6800/1233108455,v1:172.21.15.146:6801/1233108455] conn(0x7f353c0bdc70 0x7f353c0c0110 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:52.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.261+0000 7f3557200700 1 -- 172.21.15.81:0/3984282952 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f353c0b2990 msgr2=0x7f353c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:52.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.261+0000 7f3557200700 1 --2- 172.21.15.81:0/3984282952 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f353c0b2990 0x7f353c0b4e50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3548005950 tx=0x7f35480058e0 comp rx=0 tx=0).stop 2024-05-03T16:46:52.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.261+0000 7f3557200700 1 -- 172.21.15.81:0/3984282952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f355810b680 msgr2=0x7f355819b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:52.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.261+0000 7f3557200700 1 --2- 172.21.15.81:0/3984282952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f355810b680 0x7f355819b900 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3550007d70 tx=0x7f355000a340 comp rx=0 tx=0).stop 2024-05-03T16:46:52.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.261+0000 7f3556800700 1 -- 172.21.15.81:0/3984282952 reap_dead start 2024-05-03T16:46:52.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.262+0000 7f3557200700 1 -- 172.21.15.81:0/3984282952 shutdown_connections 2024-05-03T16:46:52.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.262+0000 7f3557200700 1 -- 172.21.15.81:0/3984282952 >> 172.21.15.81:0/3984282952 conn(0x7f35581010e0 msgr2=0x7f35581027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:52.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.262+0000 7f3557200700 1 -- 172.21.15.81:0/3984282952 shutdown_connections 2024-05-03T16:46:52.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:50.262+0000 7f3557200700 1 -- 172.21.15.81:0/3984282952 wait complete. 2024-05-03T16:46:52.918 INFO:teuthology.orchestra.run.smithi081.stdout:77309411445 2024-05-03T16:46:52.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-03T16:46:53.078 INFO:teuthology.orchestra.run.smithi081.stdout:261993005124 2024-05-03T16:46:53.078 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-03T16:46:53.669 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:53 smithi081 ceph-mon[28640]: pgmap v465: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:46:53.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:53 smithi134 ceph-mon[31708]: pgmap v465: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:46:53.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:53 smithi146 ceph-mon[32357]: pgmap v465: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:46:53.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.668+0000 7f6496200700 1 -- 172.21.15.81:0/1645872237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64901056c0 msgr2=0x7f6490105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:53.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.668+0000 7f6496200700 1 --2- 172.21.15.81:0/1645872237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64901056c0 0x7f6490105b40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f647c009990 tx=0x7f647c009ca0 comp rx=0 tx=0).stop 2024-05-03T16:46:53.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.668+0000 7f6496200700 1 -- 172.21.15.81:0/1645872237 shutdown_connections 2024-05-03T16:46:53.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.668+0000 7f6496200700 1 --2- 172.21.15.81:0/1645872237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6490106080 0x7f6490112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:53.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.668+0000 7f6496200700 1 --2- 172.21.15.81:0/1645872237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f649010b6c0 0x7f649010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:53.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.668+0000 7f6496200700 1 --2- 172.21.15.81:0/1645872237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64901056c0 0x7f6490105b40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:53.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.668+0000 7f6496200700 1 -- 172.21.15.81:0/1645872237 >> 172.21.15.81:0/1645872237 conn(0x7f64901011d0 msgr2=0x7f64901035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:53.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.668+0000 7f6496200700 1 -- 172.21.15.81:0/1645872237 shutdown_connections 2024-05-03T16:46:53.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.668+0000 7f6496200700 1 -- 172.21.15.81:0/1645872237 wait complete. 2024-05-03T16:46:53.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.669+0000 7f6496200700 1 Processor -- start 2024-05-03T16:46:53.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.670+0000 7f6496200700 1 -- start start 2024-05-03T16:46:53.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.670+0000 7f6496200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64901056c0 0x7f64901a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:53.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.670+0000 7f6496200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6490106080 0x7f64901a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:53.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.670+0000 7f6496200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f649010b6c0 0x7f649019bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:53.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.670+0000 7f6496200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f64901157b0 con 0x7f649010b6c0 2024-05-03T16:46:53.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.670+0000 7f6496200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6490115630 con 0x7f6490106080 2024-05-03T16:46:53.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.670+0000 7f6496200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6490115930 con 0x7f64901056c0 2024-05-03T16:46:53.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.670+0000 7f648fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f649010b6c0 0x7f649019bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:53.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.671+0000 7f648fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f649010b6c0 0x7f649019bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60248/0 (socket says 172.21.15.81:60248) 2024-05-03T16:46:53.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.671+0000 7f648fe00700 1 -- 172.21.15.81:0/851720277 learned_addr learned my addr 172.21.15.81:0/851720277 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:46:53.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.671+0000 7f648f400700 1 --2- 172.21.15.81:0/851720277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64901056c0 0x7f64901a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:53.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.671+0000 7f648ea00700 1 --2- 172.21.15.81:0/851720277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6490106080 0x7f64901a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:53.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.671+0000 7f648fe00700 1 -- 172.21.15.81:0/851720277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64901056c0 msgr2=0x7f64901a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:53.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.671+0000 7f648fe00700 1 --2- 172.21.15.81:0/851720277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64901056c0 0x7f64901a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:53.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.671+0000 7f648fe00700 1 -- 172.21.15.81:0/851720277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6490106080 msgr2=0x7f64901a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:53.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.671+0000 7f648fe00700 1 --2- 172.21.15.81:0/851720277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6490106080 0x7f64901a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:53.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.671+0000 7f648fe00700 1 -- 172.21.15.81:0/851720277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649019c410 con 0x7f649010b6c0 2024-05-03T16:46:53.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.671+0000 7f648ea00700 1 --2- 172.21.15.81:0/851720277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6490106080 0x7f64901a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:46:53.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.671+0000 7f648fe00700 1 --2- 172.21.15.81:0/851720277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f649010b6c0 0x7f649019bb30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f648800ada0 tx=0x7f648800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:53.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.671+0000 7f6487e00700 1 -- 172.21.15.81:0/851720277 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6488017020 con 0x7f649010b6c0 2024-05-03T16:46:53.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.672+0000 7f6487e00700 1 -- 172.21.15.81:0/851720277 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f648800ce10 con 0x7f649010b6c0 2024-05-03T16:46:53.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.672+0000 7f6496200700 1 -- 172.21.15.81:0/851720277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f649019c700 con 0x7f649010b6c0 2024-05-03T16:46:53.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.672+0000 7f6487e00700 1 -- 172.21.15.81:0/851720277 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6488005440 con 0x7f649010b6c0 2024-05-03T16:46:53.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.672+0000 7f6496200700 1 -- 172.21.15.81:0/851720277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64901a89e0 con 0x7f649010b6c0 2024-05-03T16:46:53.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.673+0000 7f6496200700 1 -- 172.21.15.81:0/851720277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6490063bf0 con 0x7f649010b6c0 2024-05-03T16:46:53.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.675+0000 7f6487e00700 1 -- 172.21.15.81:0/851720277 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f6488004ad0 con 0x7f649010b6c0 2024-05-03T16:46:53.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.676+0000 7f6487e00700 1 --2- 172.21.15.81:0/851720277 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f64740b2910 0x7f64740b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:53.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.677+0000 7f6487e00700 1 -- 172.21.15.81:0/851720277 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f64880e28f0 con 0x7f649010b6c0 2024-05-03T16:46:53.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.677+0000 7f648f400700 1 --2- 172.21.15.81:0/851720277 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f64740b2910 0x7f64740b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:53.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.677+0000 7f6487e00700 1 --2- 172.21.15.81:0/851720277 >> [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465] conn(0x7f64740bdbf0 0x7f64740c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:53.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.677+0000 7f6487e00700 1 -- 172.21.15.81:0/851720277 --> [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64740c0760 con 0x7f64740bdbf0 2024-05-03T16:46:53.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.677+0000 7f6487e00700 1 -- 172.21.15.81:0/851720277 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f64880e2d40 con 0x7f649010b6c0 2024-05-03T16:46:53.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.677+0000 7f648ea00700 1 --2- 172.21.15.81:0/851720277 >> [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465] conn(0x7f64740bdbf0 0x7f64740c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:53.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.678+0000 7f648f400700 1 --2- 172.21.15.81:0/851720277 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f64740b2910 0x7f64740b4dd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6480005950 tx=0x7f64800058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:53.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.678+0000 7f648ea00700 1 --2- 172.21.15.81:0/851720277 >> [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465] conn(0x7f64740bdbf0 0x7f64740c0090 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:53.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.679+0000 7f6487e00700 1 -- 172.21.15.81:0/851720277 <== osd.3 v2:172.21.15.81:6810/4128709465 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f64740c0760 con 0x7f64740bdbf0 2024-05-03T16:46:53.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.697+0000 7f6496200700 1 -- 172.21.15.81:0/851720277 --> [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6490064070 con 0x7f64740bdbf0 2024-05-03T16:46:53.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.698+0000 7f6487e00700 1 -- 172.21.15.81:0/851720277 <== osd.3 v2:172.21.15.81:6810/4128709465 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6490064070 con 0x7f64740bdbf0 2024-05-03T16:46:53.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.698+0000 7f6496200700 1 -- 172.21.15.81:0/851720277 >> [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465] conn(0x7f64740bdbf0 msgr2=0x7f64740c0090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:53.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.698+0000 7f6496200700 1 --2- 172.21.15.81:0/851720277 >> [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465] conn(0x7f64740bdbf0 0x7f64740c0090 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:53.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.698+0000 7f6496200700 1 -- 172.21.15.81:0/851720277 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f64740b2910 msgr2=0x7f64740b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:53.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.698+0000 7f6496200700 1 --2- 172.21.15.81:0/851720277 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f64740b2910 0x7f64740b4dd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6480005950 tx=0x7f64800058e0 comp rx=0 tx=0).stop 2024-05-03T16:46:53.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.698+0000 7f6496200700 1 -- 172.21.15.81:0/851720277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f649010b6c0 msgr2=0x7f649019bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:53.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.698+0000 7f6496200700 1 --2- 172.21.15.81:0/851720277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f649010b6c0 0x7f649019bb30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f648800ada0 tx=0x7f648800c330 comp rx=0 tx=0).stop 2024-05-03T16:46:53.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.699+0000 7f648fe00700 1 -- 172.21.15.81:0/851720277 reap_dead start 2024-05-03T16:46:53.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.699+0000 7f6496200700 1 -- 172.21.15.81:0/851720277 shutdown_connections 2024-05-03T16:46:53.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.699+0000 7f6496200700 1 -- 172.21.15.81:0/851720277 >> 172.21.15.81:0/851720277 conn(0x7f64901011d0 msgr2=0x7f6490101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:53.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.699+0000 7f6496200700 1 -- 172.21.15.81:0/851720277 shutdown_connections 2024-05-03T16:46:53.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.699+0000 7f6496200700 1 -- 172.21.15.81:0/851720277 wait complete. 2024-05-03T16:46:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.913+0000 7f456f600700 1 -- 172.21.15.81:0/2307336215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456810ff50 msgr2=0x7f4568112340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.913+0000 7f456f600700 1 --2- 172.21.15.81:0/2307336215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456810ff50 0x7f4568112340 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4560009990 tx=0x7f4560009ca0 comp rx=0 tx=0).stop 2024-05-03T16:46:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.913+0000 7f456f600700 1 -- 172.21.15.81:0/2307336215 shutdown_connections 2024-05-03T16:46:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.913+0000 7f456f600700 1 --2- 172.21.15.81:0/2307336215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f456806b1b0 0x7f456806b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.913+0000 7f456f600700 1 --2- 172.21.15.81:0/2307336215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456810ff50 0x7f4568112340 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.913+0000 7f456f600700 1 --2- 172.21.15.81:0/2307336215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f456806bad0 0x7f456810fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.913+0000 7f456f600700 1 -- 172.21.15.81:0/2307336215 >> 172.21.15.81:0/2307336215 conn(0x7f4568079350 msgr2=0x7f4568079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.913+0000 7f456f600700 1 -- 172.21.15.81:0/2307336215 shutdown_connections 2024-05-03T16:46:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.913+0000 7f456f600700 1 -- 172.21.15.81:0/2307336215 wait complete. 2024-05-03T16:46:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.914+0000 7f456f600700 1 Processor -- start 2024-05-03T16:46:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.914+0000 7f456f600700 1 -- start start 2024-05-03T16:46:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.915+0000 7f456f600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f456806b1b0 0x7f45681a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.915+0000 7f456f600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456806bad0 0x7f45681a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.915+0000 7f456f600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f456810ff50 0x7f456819bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.915+0000 7f456f600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4568115770 con 0x7f456806bad0 2024-05-03T16:46:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.915+0000 7f456f600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f45681155f0 con 0x7f456810ff50 2024-05-03T16:46:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.915+0000 7f456f600700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f45681158f0 con 0x7f456806b1b0 2024-05-03T16:46:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.915+0000 7f4567e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456806bad0 0x7f45681a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.915+0000 7f4567e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456806bad0 0x7f45681a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60272/0 (socket says 172.21.15.81:60272) 2024-05-03T16:46:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.915+0000 7f4567e00700 1 -- 172.21.15.81:0/1842769048 learned_addr learned my addr 172.21.15.81:0/1842769048 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:46:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.915+0000 7f456cc00700 1 --2- 172.21.15.81:0/1842769048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f456806b1b0 0x7f45681a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.915+0000 7f456d600700 1 --2- 172.21.15.81:0/1842769048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f456810ff50 0x7f456819bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.916+0000 7f4567e00700 1 -- 172.21.15.81:0/1842769048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f456806b1b0 msgr2=0x7f45681a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.916+0000 7f4567e00700 1 --2- 172.21.15.81:0/1842769048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f456806b1b0 0x7f45681a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.916+0000 7f4567e00700 1 -- 172.21.15.81:0/1842769048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f456810ff50 msgr2=0x7f456819bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.916+0000 7f4567e00700 1 --2- 172.21.15.81:0/1842769048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f456810ff50 0x7f456819bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.916+0000 7f4567e00700 1 -- 172.21.15.81:0/1842769048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456819c230 con 0x7f456806bad0 2024-05-03T16:46:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.916+0000 7f4567e00700 1 --2- 172.21.15.81:0/1842769048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456806bad0 0x7f45681a1e50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f455400d950 tx=0x7f455400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.916+0000 7f4565600700 1 -- 172.21.15.81:0/1842769048 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554016070 con 0x7f456806bad0 2024-05-03T16:46:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.916+0000 7f4565600700 1 -- 172.21.15.81:0/1842769048 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4554010460 con 0x7f456806bad0 2024-05-03T16:46:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.916+0000 7f4565600700 1 -- 172.21.15.81:0/1842769048 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455400f620 con 0x7f456806bad0 2024-05-03T16:46:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.916+0000 7f456f600700 1 -- 172.21.15.81:0/1842769048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f456819c520 con 0x7f456806bad0 2024-05-03T16:46:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.916+0000 7f456f600700 1 -- 172.21.15.81:0/1842769048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45681a87e0 con 0x7f456806bad0 2024-05-03T16:46:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.917+0000 7f456f600700 1 -- 172.21.15.81:0/1842769048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4568063c30 con 0x7f456806bad0 2024-05-03T16:46:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.920+0000 7f4565600700 1 -- 172.21.15.81:0/1842769048 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f4554019070 con 0x7f456806bad0 2024-05-03T16:46:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.921+0000 7f4565600700 1 --2- 172.21.15.81:0/1842769048 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f45500b2910 0x7f45500b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.922+0000 7f4565600700 1 -- 172.21.15.81:0/1842769048 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f45540e2860 con 0x7f456806bad0 2024-05-03T16:46:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.922+0000 7f456cc00700 1 --2- 172.21.15.81:0/1842769048 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f45500b2910 0x7f45500b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.922+0000 7f4565600700 1 --2- 172.21.15.81:0/1842769048 >> [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055] conn(0x7f45500bdbf0 0x7f45500c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.922+0000 7f4565600700 1 -- 172.21.15.81:0/1842769048 --> [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45500c0760 con 0x7f45500bdbf0 2024-05-03T16:46:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.922+0000 7f4565600700 1 -- 172.21.15.81:0/1842769048 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f45540e2c10 con 0x7f456806bad0 2024-05-03T16:46:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.922+0000 7f456d600700 1 --2- 172.21.15.81:0/1842769048 >> [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055] conn(0x7f45500bdbf0 0x7f45500c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.923+0000 7f456cc00700 1 --2- 172.21.15.81:0/1842769048 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f45500b2910 0x7f45500b4dd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f455c009d10 tx=0x7f455c009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.923+0000 7f456d600700 1 --2- 172.21.15.81:0/1842769048 >> [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055] conn(0x7f45500bdbf0 0x7f45500c0090 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.924+0000 7f4565600700 1 -- 172.21.15.81:0/1842769048 <== osd.0 v2:172.21.15.81:6802/1639968055 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f45500c0760 con 0x7f45500bdbf0 2024-05-03T16:46:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.942+0000 7f456f600700 1 -- 172.21.15.81:0/1842769048 --> [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f45680640b0 con 0x7f45500bdbf0 2024-05-03T16:46:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.943+0000 7f4565600700 1 -- 172.21.15.81:0/1842769048 <== osd.0 v2:172.21.15.81:6802/1639968055 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f45680640b0 con 0x7f45500bdbf0 2024-05-03T16:46:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.943+0000 7f456f600700 1 -- 172.21.15.81:0/1842769048 >> [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055] conn(0x7f45500bdbf0 msgr2=0x7f45500c0090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.943+0000 7f456f600700 1 --2- 172.21.15.81:0/1842769048 >> [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055] conn(0x7f45500bdbf0 0x7f45500c0090 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.943+0000 7f456f600700 1 -- 172.21.15.81:0/1842769048 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f45500b2910 msgr2=0x7f45500b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.943+0000 7f456f600700 1 --2- 172.21.15.81:0/1842769048 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f45500b2910 0x7f45500b4dd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f455c009d10 tx=0x7f455c009040 comp rx=0 tx=0).stop 2024-05-03T16:46:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.943+0000 7f456f600700 1 -- 172.21.15.81:0/1842769048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456806bad0 msgr2=0x7f45681a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.943+0000 7f456f600700 1 --2- 172.21.15.81:0/1842769048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456806bad0 0x7f45681a1e50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f455400d950 tx=0x7f455400dd10 comp rx=0 tx=0).stop 2024-05-03T16:46:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.943+0000 7f456d600700 1 -- 172.21.15.81:0/1842769048 reap_dead start 2024-05-03T16:46:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.944+0000 7f456f600700 1 -- 172.21.15.81:0/1842769048 shutdown_connections 2024-05-03T16:46:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.944+0000 7f456f600700 1 -- 172.21.15.81:0/1842769048 >> 172.21.15.81:0/1842769048 conn(0x7f4568079350 msgr2=0x7f45681114a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.944+0000 7f456f600700 1 -- 172.21.15.81:0/1842769048 shutdown_connections 2024-05-03T16:46:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:53.944+0000 7f456f600700 1 -- 172.21.15.81:0/1842769048 wait complete. 2024-05-03T16:46:54.791 INFO:teuthology.orchestra.run.smithi081.stdout:184683593817 2024-05-03T16:46:54.792 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-03T16:46:55.379 INFO:teuthology.orchestra.run.smithi081.stdout:111669149806 2024-05-03T16:46:55.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-03T16:46:55.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.642+0000 7eff88e00700 1 -- 172.21.15.81:0/2353139493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff84105f90 msgr2=0x7eff841124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:55.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.642+0000 7eff88e00700 1 --2- 172.21.15.81:0/2353139493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff84105f90 0x7eff841124a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009990 tx=0x7eff7c009ca0 comp rx=0 tx=0).stop 2024-05-03T16:46:55.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.642+0000 7eff88e00700 1 -- 172.21.15.81:0/2353139493 shutdown_connections 2024-05-03T16:46:55.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.642+0000 7eff88e00700 1 --2- 172.21.15.81:0/2353139493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff8410b660 0x7eff8410ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:55.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.642+0000 7eff88e00700 1 --2- 172.21.15.81:0/2353139493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff84105f90 0x7eff841124a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:55.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.642+0000 7eff88e00700 1 --2- 172.21.15.81:0/2353139493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff841055d0 0x7eff84105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:55.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.642+0000 7eff88e00700 1 -- 172.21.15.81:0/2353139493 >> 172.21.15.81:0/2353139493 conn(0x7eff841010c0 msgr2=0x7eff841034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:55.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.643+0000 7eff88e00700 1 -- 172.21.15.81:0/2353139493 shutdown_connections 2024-05-03T16:46:55.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.643+0000 7eff88e00700 1 -- 172.21.15.81:0/2353139493 wait complete. 2024-05-03T16:46:55.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.644+0000 7eff88e00700 1 Processor -- start 2024-05-03T16:46:55.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.644+0000 7eff88e00700 1 -- start start 2024-05-03T16:46:55.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.645+0000 7eff88e00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff841055d0 0x7eff841a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:55.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.645+0000 7eff88e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff84105f90 0x7eff841a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:55.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.645+0000 7eff88e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff8410b660 0x7eff8419b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:55.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.645+0000 7eff88e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7eff841156d0 con 0x7eff8410b660 2024-05-03T16:46:55.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.645+0000 7eff88e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7eff84115550 con 0x7eff84105f90 2024-05-03T16:46:55.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.645+0000 7eff88e00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7eff84115850 con 0x7eff841055d0 2024-05-03T16:46:55.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.645+0000 7eff83e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff8410b660 0x7eff8419b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:55.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.645+0000 7eff83e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff8410b660 0x7eff8419b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60236/0 (socket says 172.21.15.81:60236) 2024-05-03T16:46:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.645+0000 7eff83e00700 1 -- 172.21.15.81:0/1049872286 learned_addr learned my addr 172.21.15.81:0/1049872286 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:46:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.645+0000 7eff83400700 1 --2- 172.21.15.81:0/1049872286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff841055d0 0x7eff841a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.645+0000 7eff83e00700 1 -- 172.21.15.81:0/1049872286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff841055d0 msgr2=0x7eff841a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.645+0000 7eff7aa00700 1 --2- 172.21.15.81:0/1049872286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff84105f90 0x7eff841a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.646+0000 7eff83e00700 1 --2- 172.21.15.81:0/1049872286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff841055d0 0x7eff841a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.646+0000 7eff83e00700 1 -- 172.21.15.81:0/1049872286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff84105f90 msgr2=0x7eff841a1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.646+0000 7eff83e00700 1 --2- 172.21.15.81:0/1049872286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff84105f90 0x7eff841a1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.646+0000 7eff83e00700 1 -- 172.21.15.81:0/1049872286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff8419c010 con 0x7eff8410b660 2024-05-03T16:46:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.646+0000 7eff83400700 1 --2- 172.21.15.81:0/1049872286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff841055d0 0x7eff841a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:46:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.646+0000 7eff7aa00700 1 --2- 172.21.15.81:0/1049872286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff84105f90 0x7eff841a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:46:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.646+0000 7eff83e00700 1 --2- 172.21.15.81:0/1049872286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff8410b660 0x7eff8419b8b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00c010 tx=0x7eff7c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.646+0000 7eff80c00700 1 -- 172.21.15.81:0/1049872286 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c004830 con 0x7eff8410b660 2024-05-03T16:46:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.646+0000 7eff80c00700 1 -- 172.21.15.81:0/1049872286 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff7c00f810 con 0x7eff8410b660 2024-05-03T16:46:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.646+0000 7eff88e00700 1 -- 172.21.15.81:0/1049872286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff8419c2a0 con 0x7eff8410b660 2024-05-03T16:46:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.646+0000 7eff80c00700 1 -- 172.21.15.81:0/1049872286 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c0053a0 con 0x7eff8410b660 2024-05-03T16:46:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.646+0000 7eff88e00700 1 -- 172.21.15.81:0/1049872286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff8419c6d0 con 0x7eff8410b660 2024-05-03T16:46:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.647+0000 7eff88e00700 1 -- 172.21.15.81:0/1049872286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff84063c30 con 0x7eff8410b660 2024-05-03T16:46:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.650+0000 7eff80c00700 1 -- 172.21.15.81:0/1049872286 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7eff7c00f9c0 con 0x7eff8410b660 2024-05-03T16:46:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.651+0000 7eff80c00700 1 --2- 172.21.15.81:0/1049872286 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7eff680b2910 0x7eff680b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.651+0000 7eff80c00700 1 -- 172.21.15.81:0/1049872286 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7eff7c0e40a0 con 0x7eff8410b660 2024-05-03T16:46:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.651+0000 7eff83400700 1 --2- 172.21.15.81:0/1049872286 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7eff680b2910 0x7eff680b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.651+0000 7eff80c00700 1 --2- 172.21.15.81:0/1049872286 >> [v2:172.21.15.134:6808/1498616220,v1:172.21.15.134:6809/1498616220] conn(0x7eff680bdac0 0x7eff680bff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:46:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.651+0000 7eff80c00700 1 -- 172.21.15.81:0/1049872286 --> [v2:172.21.15.134:6808/1498616220,v1:172.21.15.134:6809/1498616220] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff7c00b0b0 con 0x7eff680bdac0 2024-05-03T16:46:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.651+0000 7eff80c00700 1 -- 172.21.15.81:0/1049872286 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7eff7c0e4450 con 0x7eff8410b660 2024-05-03T16:46:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.652+0000 7eff83400700 1 --2- 172.21.15.81:0/1049872286 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7eff680b2910 0x7eff680b4dd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7eff74005fd0 tx=0x7eff74005e60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.673+0000 7eff7aa00700 1 --2- 172.21.15.81:0/1049872286 >> [v2:172.21.15.134:6808/1498616220,v1:172.21.15.134:6809/1498616220] conn(0x7eff680bdac0 0x7eff680bff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:46:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.674+0000 7eff7aa00700 1 --2- 172.21.15.81:0/1049872286 >> [v2:172.21.15.134:6808/1498616220,v1:172.21.15.134:6809/1498616220] conn(0x7eff680bdac0 0x7eff680bff60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:46:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.676+0000 7eff80c00700 1 -- 172.21.15.81:0/1049872286 <== osd.4 v2:172.21.15.134:6808/1498616220 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff7c00b0b0 con 0x7eff680bdac0 2024-05-03T16:46:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.694+0000 7eff88e00700 1 -- 172.21.15.81:0/1049872286 --> [v2:172.21.15.134:6808/1498616220,v1:172.21.15.134:6809/1498616220] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7eff840640b0 con 0x7eff680bdac0 2024-05-03T16:46:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.695+0000 7eff80c00700 1 -- 172.21.15.81:0/1049872286 <== osd.4 v2:172.21.15.134:6808/1498616220 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7eff840640b0 con 0x7eff680bdac0 2024-05-03T16:46:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.696+0000 7eff88e00700 1 -- 172.21.15.81:0/1049872286 >> [v2:172.21.15.134:6808/1498616220,v1:172.21.15.134:6809/1498616220] conn(0x7eff680bdac0 msgr2=0x7eff680bff60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.696+0000 7eff88e00700 1 --2- 172.21.15.81:0/1049872286 >> [v2:172.21.15.134:6808/1498616220,v1:172.21.15.134:6809/1498616220] conn(0x7eff680bdac0 0x7eff680bff60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:46:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.696+0000 7eff88e00700 1 -- 172.21.15.81:0/1049872286 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7eff680b2910 msgr2=0x7eff680b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.696+0000 7eff88e00700 1 --2- 172.21.15.81:0/1049872286 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7eff680b2910 0x7eff680b4dd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7eff74005fd0 tx=0x7eff74005e60 comp rx=0 tx=0).stop 2024-05-03T16:46:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.696+0000 7eff88e00700 1 -- 172.21.15.81:0/1049872286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff8410b660 msgr2=0x7eff8419b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:46:55.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.696+0000 7eff88e00700 1 --2- 172.21.15.81:0/1049872286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff8410b660 0x7eff8419b8b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00c010 tx=0x7eff7c009f90 comp rx=0 tx=0).stop 2024-05-03T16:46:55.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.696+0000 7eff83e00700 1 -- 172.21.15.81:0/1049872286 reap_dead start 2024-05-03T16:46:55.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.697+0000 7eff88e00700 1 -- 172.21.15.81:0/1049872286 shutdown_connections 2024-05-03T16:46:55.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.697+0000 7eff88e00700 1 -- 172.21.15.81:0/1049872286 >> 172.21.15.81:0/1049872286 conn(0x7eff841010c0 msgr2=0x7eff84102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:46:55.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.697+0000 7eff88e00700 1 -- 172.21.15.81:0/1049872286 shutdown_connections 2024-05-03T16:46:55.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:46:52.697+0000 7eff88e00700 1 -- 172.21.15.81:0/1049872286 wait complete. 2024-05-03T16:46:55.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:55 smithi134 ceph-mon[31708]: pgmap v466: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:55.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:55 smithi081 ceph-mon[28640]: pgmap v466: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:55.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:55 smithi146 ceph-mon[32357]: pgmap v466: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:46:56.629 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:56.632 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:56.656 INFO:teuthology.orchestra.run.smithi081.stdout:34359738500 2024-05-03T16:46:56.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-03T16:46:56.820 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:56.828 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:56.842 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:56.871 INFO:teuthology.orchestra.run.smithi081.stdout:137438953576 2024-05-03T16:46:56.871 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-03T16:46:57.670 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:46:57.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:57 smithi134 ceph-mon[31708]: pgmap v467: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:46:57.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:57 smithi081 ceph-mon[28640]: pgmap v467: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:46:57.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:57 smithi146 ceph-mon[32357]: pgmap v467: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:46:59.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:46:59 smithi081 ceph-mon[28640]: pgmap v468: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-05-03T16:46:59.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:46:59 smithi134 ceph-mon[31708]: pgmap v468: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-05-03T16:46:59.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:46:59 smithi146 ceph-mon[32357]: pgmap v468: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-05-03T16:47:01.502 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:01 smithi081 ceph-mon[28640]: pgmap v469: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-05-03T16:47:01.543 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:47:01.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:01 smithi134 ceph-mon[31708]: pgmap v469: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-05-03T16:47:01.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:01 smithi146 ceph-mon[32357]: pgmap v469: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-05-03T16:47:03.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:03 smithi134 ceph-mon[31708]: pgmap v470: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-05-03T16:47:03.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:03 smithi081 ceph-mon[28640]: pgmap v470: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-05-03T16:47:03.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:03 smithi146 ceph-mon[32357]: pgmap v470: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-05-03T16:47:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.364+0000 7f3244800700 1 -- 172.21.15.81:0/2684157109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c1056e0 msgr2=0x7f323c105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.364+0000 7f3244800700 1 --2- 172.21.15.81:0/2684157109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c1056e0 0x7f323c105b60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f322c009990 tx=0x7f322c009ca0 comp rx=0 tx=0).stop 2024-05-03T16:47:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.364+0000 7f3244800700 1 -- 172.21.15.81:0/2684157109 shutdown_connections 2024-05-03T16:47:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.364+0000 7f3244800700 1 --2- 172.21.15.81:0/2684157109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f323c10b6e0 0x7f323c10bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.364+0000 7f3244800700 1 --2- 172.21.15.81:0/2684157109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f323c1060a0 0x7f323c1125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.364+0000 7f3244800700 1 --2- 172.21.15.81:0/2684157109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c1056e0 0x7f323c105b60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.364+0000 7f3244800700 1 -- 172.21.15.81:0/2684157109 >> 172.21.15.81:0/2684157109 conn(0x7f323c1011d0 msgr2=0x7f323c1035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.364+0000 7f3244800700 1 -- 172.21.15.81:0/2684157109 shutdown_connections 2024-05-03T16:47:04.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.365+0000 7f3244800700 1 -- 172.21.15.81:0/2684157109 wait complete. 2024-05-03T16:47:04.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.366+0000 7f3244800700 1 Processor -- start 2024-05-03T16:47:04.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.366+0000 7f3244800700 1 -- start start 2024-05-03T16:47:04.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.366+0000 7f3244800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f323c1056e0 0x7f323c19be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.367+0000 7f3244800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c1060a0 0x7f323c19c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.367+0000 7f3244800700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f323c10b6e0 0x7f323c1a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.367+0000 7f3244800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f323c115880 con 0x7f323c1060a0 2024-05-03T16:47:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.367+0000 7f3244800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f323c115700 con 0x7f323c1056e0 2024-05-03T16:47:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.367+0000 7f3244800700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f323c115a00 con 0x7f323c10b6e0 2024-05-03T16:47:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.367+0000 7f3241400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c1060a0 0x7f323c19c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.367+0000 7f3241400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c1060a0 0x7f323c19c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55982/0 (socket says 172.21.15.81:55982) 2024-05-03T16:47:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.367+0000 7f3241400700 1 -- 172.21.15.81:0/4082834470 learned_addr learned my addr 172.21.15.81:0/4082834470 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.367+0000 7f3241e00700 1 --2- 172.21.15.81:0/4082834470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f323c1056e0 0x7f323c19be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:04.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.367+0000 7f3241400700 1 -- 172.21.15.81:0/4082834470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f323c10b6e0 msgr2=0x7f323c1a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:04.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.367+0000 7f3241400700 1 --2- 172.21.15.81:0/4082834470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f323c10b6e0 0x7f323c1a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:04.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.367+0000 7f3241400700 1 -- 172.21.15.81:0/4082834470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f323c1056e0 msgr2=0x7f323c19be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:04.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.367+0000 7f3241400700 1 --2- 172.21.15.81:0/4082834470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f323c1056e0 0x7f323c19be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:04.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.367+0000 7f3241400700 1 -- 172.21.15.81:0/4082834470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323c1a0e70 con 0x7f323c1060a0 2024-05-03T16:47:04.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.368+0000 7f3241400700 1 --2- 172.21.15.81:0/4082834470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c1060a0 0x7f323c19c3a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f322c005910 tx=0x7f322c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:04.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.368+0000 7f3236a00700 1 -- 172.21.15.81:0/4082834470 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c027070 con 0x7f323c1060a0 2024-05-03T16:47:04.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.368+0000 7f3236a00700 1 -- 172.21.15.81:0/4082834470 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f322c00fce0 con 0x7f323c1060a0 2024-05-03T16:47:04.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.368+0000 7f3244800700 1 -- 172.21.15.81:0/4082834470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f323c1a1100 con 0x7f323c1060a0 2024-05-03T16:47:04.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.368+0000 7f3236a00700 1 -- 172.21.15.81:0/4082834470 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c0173f0 con 0x7f323c1060a0 2024-05-03T16:47:04.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.368+0000 7f3244800700 1 -- 172.21.15.81:0/4082834470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f323c1a89e0 con 0x7f323c1060a0 2024-05-03T16:47:04.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.369+0000 7f3244800700 1 -- 172.21.15.81:0/4082834470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f323c06a190 con 0x7f323c1060a0 2024-05-03T16:47:04.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.371+0000 7f3236a00700 1 -- 172.21.15.81:0/4082834470 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f322c02a070 con 0x7f323c1060a0 2024-05-03T16:47:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.373+0000 7f3236a00700 1 --2- 172.21.15.81:0/4082834470 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f32240b2910 0x7f32240b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.373+0000 7f3236a00700 1 -- 172.21.15.81:0/4082834470 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f322c0e3850 con 0x7f323c1060a0 2024-05-03T16:47:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.373+0000 7f3241e00700 1 --2- 172.21.15.81:0/4082834470 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f32240b2910 0x7f32240b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.374+0000 7f3241e00700 1 --2- 172.21.15.81:0/4082834470 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f32240b2910 0x7f32240b4dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3230006fd0 tx=0x7f3230008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.377+0000 7f3236a00700 1 -- 172.21.15.81:0/4082834470 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f322c05fd70 con 0x7f323c1060a0 2024-05-03T16:47:04.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.618+0000 7f3244800700 1 -- 172.21.15.81:0/4082834470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f323c02e510 con 0x7f323c1060a0 2024-05-03T16:47:04.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.619+0000 7f3236a00700 1 -- 172.21.15.81:0/4082834470 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f322c013070 con 0x7f323c1060a0 2024-05-03T16:47:04.622 INFO:teuthology.orchestra.run.smithi081.stdout:283467841599 2024-05-03T16:47:04.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.622+0000 7f3244800700 1 -- 172.21.15.81:0/4082834470 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f32240b2910 msgr2=0x7f32240b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:04.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.622+0000 7f3244800700 1 --2- 172.21.15.81:0/4082834470 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f32240b2910 0x7f32240b4dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3230006fd0 tx=0x7f3230008040 comp rx=0 tx=0).stop 2024-05-03T16:47:04.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.622+0000 7f3244800700 1 -- 172.21.15.81:0/4082834470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c1060a0 msgr2=0x7f323c19c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:04.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.622+0000 7f3244800700 1 --2- 172.21.15.81:0/4082834470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c1060a0 0x7f323c19c3a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f322c005910 tx=0x7f322c009f90 comp rx=0 tx=0).stop 2024-05-03T16:47:04.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.622+0000 7f3244800700 1 -- 172.21.15.81:0/4082834470 shutdown_connections 2024-05-03T16:47:04.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.622+0000 7f3244800700 1 --2- 172.21.15.81:0/4082834470 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f32240b2910 0x7f32240b4dd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:04.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.622+0000 7f3244800700 1 --2- 172.21.15.81:0/4082834470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f323c10b6e0 0x7f323c1a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:04.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.622+0000 7f3244800700 1 --2- 172.21.15.81:0/4082834470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f323c1056e0 0x7f323c19be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:04.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.622+0000 7f3244800700 1 --2- 172.21.15.81:0/4082834470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c1060a0 0x7f323c19c3a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:04.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.622+0000 7f3244800700 1 -- 172.21.15.81:0/4082834470 >> 172.21.15.81:0/4082834470 conn(0x7f323c1011d0 msgr2=0x7f323c101b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:04.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.623+0000 7f3244800700 1 -- 172.21.15.81:0/4082834470 shutdown_connections 2024-05-03T16:47:04.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.623+0000 7f3244800700 1 -- 172.21.15.81:0/4082834470 wait complete. 2024-05-03T16:47:04.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.960+0000 7f283aa00700 1 -- 172.21.15.81:0/925377273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2834109ad0 msgr2=0x7f2834109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:04.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.960+0000 7f283aa00700 1 --2- 172.21.15.81:0/925377273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2834109ad0 0x7f2834109f50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2820009990 tx=0x7f2820009ca0 comp rx=0 tx=0).stop 2024-05-03T16:47:04.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.960+0000 7f283aa00700 1 -- 172.21.15.81:0/925377273 shutdown_connections 2024-05-03T16:47:04.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.960+0000 7f283aa00700 1 --2- 172.21.15.81:0/925377273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283410fb60 0x7f283410ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:04.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.960+0000 7f283aa00700 1 --2- 172.21.15.81:0/925377273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f283410a490 0x7f28341169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:04.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.960+0000 7f283aa00700 1 --2- 172.21.15.81:0/925377273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2834109ad0 0x7f2834109f50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:04.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.960+0000 7f283aa00700 1 -- 172.21.15.81:0/925377273 >> 172.21.15.81:0/925377273 conn(0x7f2834076c70 msgr2=0x7f28341082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:04.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.960+0000 7f283aa00700 1 -- 172.21.15.81:0/925377273 shutdown_connections 2024-05-03T16:47:04.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.960+0000 7f283aa00700 1 -- 172.21.15.81:0/925377273 wait complete. 2024-05-03T16:47:04.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.962+0000 7f283aa00700 1 Processor -- start 2024-05-03T16:47:04.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.962+0000 7f283aa00700 1 -- start start 2024-05-03T16:47:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.962+0000 7f283aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2834109ad0 0x7f28341a0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.962+0000 7f283aa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f283410a490 0x7f28341a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.962+0000 7f283aa00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283410fb60 0x7f28341a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.962+0000 7f283aa00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2834119c00 con 0x7f2834109ad0 2024-05-03T16:47:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.962+0000 7f283aa00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2834119a80 con 0x7f283410a490 2024-05-03T16:47:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.962+0000 7f283aa00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2834119d80 con 0x7f283410fb60 2024-05-03T16:47:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.963+0000 7f2833e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2834109ad0 0x7f28341a0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.963+0000 7f2833e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2834109ad0 0x7f28341a0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55998/0 (socket says 172.21.15.81:55998) 2024-05-03T16:47:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.963+0000 7f2833e00700 1 -- 172.21.15.81:0/2685020833 learned_addr learned my addr 172.21.15.81:0/2685020833 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.963+0000 7f2833400700 1 --2- 172.21.15.81:0/2685020833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f283410a490 0x7f28341a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.963+0000 7f2838a00700 1 --2- 172.21.15.81:0/2685020833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283410fb60 0x7f28341a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.963+0000 7f2833e00700 1 -- 172.21.15.81:0/2685020833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283410fb60 msgr2=0x7f28341a49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.963+0000 7f2833e00700 1 --2- 172.21.15.81:0/2685020833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283410fb60 0x7f28341a49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.963+0000 7f2833e00700 1 -- 172.21.15.81:0/2685020833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f283410a490 msgr2=0x7f28341a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.963+0000 7f2833e00700 1 --2- 172.21.15.81:0/2685020833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f283410a490 0x7f28341a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.963+0000 7f2833e00700 1 -- 172.21.15.81:0/2685020833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28341a5120 con 0x7f2834109ad0 2024-05-03T16:47:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.963+0000 7f2838a00700 1 --2- 172.21.15.81:0/2685020833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283410fb60 0x7f28341a49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:47:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.964+0000 7f2833e00700 1 --2- 172.21.15.81:0/2685020833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2834109ad0 0x7f28341a0110 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f282400c970 tx=0x7f282400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.964+0000 7f2830c00700 1 -- 172.21.15.81:0/2685020833 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824007aa0 con 0x7f2834109ad0 2024-05-03T16:47:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.964+0000 7f2830c00700 1 -- 172.21.15.81:0/2685020833 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2824004cc0 con 0x7f2834109ad0 2024-05-03T16:47:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.964+0000 7f2830c00700 1 -- 172.21.15.81:0/2685020833 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824005500 con 0x7f2834109ad0 2024-05-03T16:47:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.964+0000 7f283aa00700 1 -- 172.21.15.81:0/2685020833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28341a5410 con 0x7f2834109ad0 2024-05-03T16:47:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.964+0000 7f283aa00700 1 -- 172.21.15.81:0/2685020833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28341acc90 con 0x7f2834109ad0 2024-05-03T16:47:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.965+0000 7f283aa00700 1 -- 172.21.15.81:0/2685020833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2834112060 con 0x7f2834109ad0 2024-05-03T16:47:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.968+0000 7f2830c00700 1 -- 172.21.15.81:0/2685020833 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f2824007c40 con 0x7f2834109ad0 2024-05-03T16:47:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.969+0000 7f2830c00700 1 --2- 172.21.15.81:0/2685020833 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f28180b2990 0x7f28180b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.970+0000 7f2830c00700 1 -- 172.21.15.81:0/2685020833 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f28240e24f0 con 0x7f2834109ad0 2024-05-03T16:47:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.970+0000 7f2833400700 1 --2- 172.21.15.81:0/2685020833 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f28180b2990 0x7f28180b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.971+0000 7f2833400700 1 --2- 172.21.15.81:0/2685020833 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f28180b2990 0x7f28180b4e50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f282000b5c0 tx=0x7f282001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:04.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:04.974+0000 7f2830c00700 1 -- 172.21.15.81:0/2685020833 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f28240a9d30 con 0x7f2834109ad0 2024-05-03T16:47:05.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:05.224+0000 7f283aa00700 1 -- 172.21.15.81:0/2685020833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f28341a1470 con 0x7f2834109ad0 2024-05-03T16:47:05.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:05.225+0000 7f2830c00700 1 -- 172.21.15.81:0/2685020833 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2824005700 con 0x7f2834109ad0 2024-05-03T16:47:05.228 INFO:teuthology.orchestra.run.smithi081.stdout:261993005128 2024-05-03T16:47:05.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:05.229+0000 7f283aa00700 1 -- 172.21.15.81:0/2685020833 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f28180b2990 msgr2=0x7f28180b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:05.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:05.229+0000 7f283aa00700 1 --2- 172.21.15.81:0/2685020833 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f28180b2990 0x7f28180b4e50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f282000b5c0 tx=0x7f282001a040 comp rx=0 tx=0).stop 2024-05-03T16:47:05.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:05.229+0000 7f283aa00700 1 -- 172.21.15.81:0/2685020833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2834109ad0 msgr2=0x7f28341a0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:05.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:05.229+0000 7f283aa00700 1 --2- 172.21.15.81:0/2685020833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2834109ad0 0x7f28341a0110 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f282400c970 tx=0x7f282400cd30 comp rx=0 tx=0).stop 2024-05-03T16:47:05.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:05.230+0000 7f283aa00700 1 -- 172.21.15.81:0/2685020833 shutdown_connections 2024-05-03T16:47:05.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:05.230+0000 7f283aa00700 1 --2- 172.21.15.81:0/2685020833 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f28180b2990 0x7f28180b4e50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:05.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:05.230+0000 7f283aa00700 1 --2- 172.21.15.81:0/2685020833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283410fb60 0x7f28341a49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:05.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:05.230+0000 7f283aa00700 1 --2- 172.21.15.81:0/2685020833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2834109ad0 0x7f28341a0110 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:05.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:05.230+0000 7f283aa00700 1 --2- 172.21.15.81:0/2685020833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f283410a490 0x7f28341a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:05.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:05.230+0000 7f283aa00700 1 -- 172.21.15.81:0/2685020833 >> 172.21.15.81:0/2685020833 conn(0x7f2834076c70 msgr2=0x7f28340772f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:05.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:05.230+0000 7f283aa00700 1 -- 172.21.15.81:0/2685020833 shutdown_connections 2024-05-03T16:47:05.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:05.230+0000 7f283aa00700 1 -- 172.21.15.81:0/2685020833 wait complete. 2024-05-03T16:47:05.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:05 smithi081 ceph-mon[28640]: pgmap v471: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T16:47:05.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:05 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/4082834470' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-03T16:47:05.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:05 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2685020833' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-03T16:47:05.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:05 smithi146 ceph-mon[32357]: pgmap v471: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T16:47:05.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:05 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/4082834470' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-03T16:47:05.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:05 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2685020833' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-03T16:47:05.822 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:47:05.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:05 smithi134 ceph-mon[31708]: pgmap v471: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T16:47:05.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:05 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/4082834470' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-03T16:47:05.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:05 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2685020833' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-03T16:47:06.629 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:06 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:47:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.641+0000 7fc09ae00700 1 -- 172.21.15.81:0/166033532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc09410b680 msgr2=0x7fc09410ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.641+0000 7fc09ae00700 1 --2- 172.21.15.81:0/166033532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc09410b680 0x7fc09410ba60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc0880099c0 tx=0x7fc088009cd0 comp rx=0 tx=0).stop 2024-05-03T16:47:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.641+0000 7fc09ae00700 1 -- 172.21.15.81:0/166033532 shutdown_connections 2024-05-03T16:47:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.641+0000 7fc09ae00700 1 --2- 172.21.15.81:0/166033532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc094105f90 0x7fc094112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.641+0000 7fc09ae00700 1 --2- 172.21.15.81:0/166033532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc09410b680 0x7fc09410ba60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.641+0000 7fc09ae00700 1 --2- 172.21.15.81:0/166033532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0941055d0 0x7fc094105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.641+0000 7fc09ae00700 1 -- 172.21.15.81:0/166033532 >> 172.21.15.81:0/166033532 conn(0x7fc094101080 msgr2=0x7fc0941034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.641+0000 7fc09ae00700 1 -- 172.21.15.81:0/166033532 shutdown_connections 2024-05-03T16:47:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.641+0000 7fc09ae00700 1 -- 172.21.15.81:0/166033532 wait complete. 2024-05-03T16:47:06.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.643+0000 7fc09ae00700 1 Processor -- start 2024-05-03T16:47:06.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.643+0000 7fc09ae00700 1 -- start start 2024-05-03T16:47:06.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.643+0000 7fc09ae00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0941055d0 0x7fc0941a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.643+0000 7fc09ae00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc094105f90 0x7fc0941a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.643+0000 7fc09ae00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc09410b680 0x7fc09419ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.644+0000 7fc09ae00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0941156e0 con 0x7fc094105f90 2024-05-03T16:47:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.644+0000 7fc09ae00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc094115560 con 0x7fc09410b680 2024-05-03T16:47:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.644+0000 7fc09ae00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc094115860 con 0x7fc0941055d0 2024-05-03T16:47:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.644+0000 7fc099000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc094105f90 0x7fc0941a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.644+0000 7fc099000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc094105f90 0x7fc0941a1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34828/0 (socket says 172.21.15.81:34828) 2024-05-03T16:47:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.644+0000 7fc099000700 1 -- 172.21.15.81:0/4098273747 learned_addr learned my addr 172.21.15.81:0/4098273747 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.644+0000 7fc099a00700 1 --2- 172.21.15.81:0/4098273747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0941055d0 0x7fc0941a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.644+0000 7fc09a400700 1 --2- 172.21.15.81:0/4098273747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc09410b680 0x7fc09419ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.644+0000 7fc099000700 1 -- 172.21.15.81:0/4098273747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0941055d0 msgr2=0x7fc0941a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:06.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.644+0000 7fc099000700 1 --2- 172.21.15.81:0/4098273747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0941055d0 0x7fc0941a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:06.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.644+0000 7fc099000700 1 -- 172.21.15.81:0/4098273747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc09410b680 msgr2=0x7fc09419ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:06.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.644+0000 7fc099000700 1 --2- 172.21.15.81:0/4098273747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc09410b680 0x7fc09419ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:06.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.644+0000 7fc099000700 1 -- 172.21.15.81:0/4098273747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc09419c1c0 con 0x7fc094105f90 2024-05-03T16:47:06.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.645+0000 7fc099000700 1 --2- 172.21.15.81:0/4098273747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc094105f90 0x7fc0941a1de0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc08000d950 tx=0x7fc08000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:06.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.645+0000 7fc092000700 1 -- 172.21.15.81:0/4098273747 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080016070 con 0x7fc094105f90 2024-05-03T16:47:06.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.645+0000 7fc092000700 1 -- 172.21.15.81:0/4098273747 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc080009dd0 con 0x7fc094105f90 2024-05-03T16:47:06.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.645+0000 7fc09ae00700 1 -- 172.21.15.81:0/4098273747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc09419c4b0 con 0x7fc094105f90 2024-05-03T16:47:06.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.645+0000 7fc09ae00700 1 -- 172.21.15.81:0/4098273747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0941a8770 con 0x7fc094105f90 2024-05-03T16:47:06.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.645+0000 7fc092000700 1 -- 172.21.15.81:0/4098273747 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08000f3c0 con 0x7fc094105f90 2024-05-03T16:47:06.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.646+0000 7fc09ae00700 1 -- 172.21.15.81:0/4098273747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc09410db10 con 0x7fc094105f90 2024-05-03T16:47:06.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.649+0000 7fc092000700 1 -- 172.21.15.81:0/4098273747 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc080019070 con 0x7fc094105f90 2024-05-03T16:47:06.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.650+0000 7fc092000700 1 --2- 172.21.15.81:0/4098273747 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fc07c0b2990 0x7fc07c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:06.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.651+0000 7fc092000700 1 -- 172.21.15.81:0/4098273747 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fc0800e24b0 con 0x7fc094105f90 2024-05-03T16:47:06.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.651+0000 7fc099a00700 1 --2- 172.21.15.81:0/4098273747 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fc07c0b2990 0x7fc07c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:06.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.652+0000 7fc099a00700 1 --2- 172.21.15.81:0/4098273747 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fc07c0b2990 0x7fc07c0b4e50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc088009990 tx=0x7fc088005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:06.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.653+0000 7fc092000700 1 -- 172.21.15.81:0/4098273747 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc0800a9cc0 con 0x7fc094105f90 2024-05-03T16:47:06.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:06 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:47:06.857 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:47:06.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.899+0000 7fc09ae00700 1 -- 172.21.15.81:0/4098273747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc09419cf90 con 0x7fc094105f90 2024-05-03T16:47:06.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.900+0000 7fc092000700 1 -- 172.21.15.81:0/4098273747 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc0800a95c0 con 0x7fc094105f90 2024-05-03T16:47:06.902 INFO:teuthology.orchestra.run.smithi081.stdout:158913790053 2024-05-03T16:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.903+0000 7fc09ae00700 1 -- 172.21.15.81:0/4098273747 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fc07c0b2990 msgr2=0x7fc07c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.903+0000 7fc09ae00700 1 --2- 172.21.15.81:0/4098273747 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fc07c0b2990 0x7fc07c0b4e50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc088009990 tx=0x7fc088005fb0 comp rx=0 tx=0).stop 2024-05-03T16:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.903+0000 7fc09ae00700 1 -- 172.21.15.81:0/4098273747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc094105f90 msgr2=0x7fc0941a1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.903+0000 7fc09ae00700 1 --2- 172.21.15.81:0/4098273747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc094105f90 0x7fc0941a1de0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc08000d950 tx=0x7fc08000dc60 comp rx=0 tx=0).stop 2024-05-03T16:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.903+0000 7fc09ae00700 1 -- 172.21.15.81:0/4098273747 shutdown_connections 2024-05-03T16:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.903+0000 7fc09ae00700 1 --2- 172.21.15.81:0/4098273747 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fc07c0b2990 0x7fc07c0b4e50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.903+0000 7fc09ae00700 1 --2- 172.21.15.81:0/4098273747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0941055d0 0x7fc0941a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.903+0000 7fc09ae00700 1 --2- 172.21.15.81:0/4098273747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc09410b680 0x7fc09419ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.903+0000 7fc09ae00700 1 --2- 172.21.15.81:0/4098273747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc094105f90 0x7fc0941a1de0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.903+0000 7fc09ae00700 1 -- 172.21.15.81:0/4098273747 >> 172.21.15.81:0/4098273747 conn(0x7fc094101080 msgr2=0x7fc094102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.904+0000 7fc09ae00700 1 -- 172.21.15.81:0/4098273747 shutdown_connections 2024-05-03T16:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:06.904+0000 7fc09ae00700 1 -- 172.21.15.81:0/4098273747 wait complete. 2024-05-03T16:47:06.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:06 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:47:07.614 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:07 smithi081 ceph-mon[28640]: pgmap v472: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:47:07.615 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:07 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/4098273747' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-03T16:47:07.615 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:07 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:47:07.615 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:07 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:47:07.615 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:07 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:47:07.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:07 smithi146 ceph-mon[32357]: pgmap v472: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:47:07.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:07 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/4098273747' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-03T16:47:07.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:47:07.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:47:07.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:07 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:47:07.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:07 smithi134 ceph-mon[31708]: pgmap v472: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:47:07.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:07 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/4098273747' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-03T16:47:07.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:07 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:47:07.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:07 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:47:07.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:07 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:47:09.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.952+0000 7f1dcee00700 1 -- 172.21.15.81:0/195915499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc8108380 msgr2=0x7f1dc806ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:09.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.952+0000 7f1dcee00700 1 --2- 172.21.15.81:0/195915499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc8108380 0x7f1dc806ba10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc009990 tx=0x7f1dbc009ca0 comp rx=0 tx=0).stop 2024-05-03T16:47:09.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.952+0000 7f1dcee00700 1 -- 172.21.15.81:0/195915499 shutdown_connections 2024-05-03T16:47:09.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.952+0000 7f1dcee00700 1 --2- 172.21.15.81:0/195915499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1dc8105e20 0x7f1dc81062a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:09.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.952+0000 7f1dcee00700 1 --2- 172.21.15.81:0/195915499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc8108380 0x7f1dc806ba10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:09.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.952+0000 7f1dcee00700 1 --2- 172.21.15.81:0/195915499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc806bf50 0x7f1dc806c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:09.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.952+0000 7f1dcee00700 1 -- 172.21.15.81:0/195915499 >> 172.21.15.81:0/195915499 conn(0x7f1dc80791e0 msgr2=0x7f1dc80795f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:09.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.953+0000 7f1dcee00700 1 -- 172.21.15.81:0/195915499 shutdown_connections 2024-05-03T16:47:09.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.953+0000 7f1dcee00700 1 -- 172.21.15.81:0/195915499 wait complete. 2024-05-03T16:47:09.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.954+0000 7f1dcee00700 1 Processor -- start 2024-05-03T16:47:09.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.954+0000 7f1dcee00700 1 -- start start 2024-05-03T16:47:09.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.954+0000 7f1dcee00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1dc806bf50 0x7f1dc819ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:09.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.954+0000 7f1dcee00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc8105e20 0x7f1dc81a0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:09.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.954+0000 7f1dcee00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc8108380 0x7f1dc81a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:09.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.954+0000 7f1dcee00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc81199e0 con 0x7f1dc8108380 2024-05-03T16:47:09.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.954+0000 7f1dcee00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc8119860 con 0x7f1dc806bf50 2024-05-03T16:47:09.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.954+0000 7f1dcee00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc8119b60 con 0x7f1dc8105e20 2024-05-03T16:47:09.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.955+0000 7f1dce400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc8108380 0x7f1dc81a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:09.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.955+0000 7f1dce400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc8108380 0x7f1dc81a47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34852/0 (socket says 172.21.15.81:34852) 2024-05-03T16:47:09.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.955+0000 7f1dce400700 1 -- 172.21.15.81:0/2124484937 learned_addr learned my addr 172.21.15.81:0/2124484937 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:09.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.955+0000 7f1dcda00700 1 --2- 172.21.15.81:0/2124484937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1dc806bf50 0x7f1dc819ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:09.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.955+0000 7f1dcd000700 1 --2- 172.21.15.81:0/2124484937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc8105e20 0x7f1dc81a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:09.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.955+0000 7f1dce400700 1 -- 172.21.15.81:0/2124484937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc8105e20 msgr2=0x7f1dc81a0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:09.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.955+0000 7f1dce400700 1 --2- 172.21.15.81:0/2124484937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc8105e20 0x7f1dc81a0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:09.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.955+0000 7f1dce400700 1 -- 172.21.15.81:0/2124484937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1dc806bf50 msgr2=0x7f1dc819ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:09.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.955+0000 7f1dce400700 1 --2- 172.21.15.81:0/2124484937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1dc806bf50 0x7f1dc819ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:09.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.955+0000 7f1dce400700 1 -- 172.21.15.81:0/2124484937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc81a4ef0 con 0x7f1dc8108380 2024-05-03T16:47:09.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.955+0000 7f1dcda00700 1 --2- 172.21.15.81:0/2124484937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1dc806bf50 0x7f1dc819ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:47:09.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.956+0000 7f1dce400700 1 --2- 172.21.15.81:0/2124484937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc8108380 0x7f1dc81a47b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000ab50 tx=0x7f1dc000af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:09.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.956+0000 7f1dc6000700 1 -- 172.21.15.81:0/2124484937 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0017020 con 0x7f1dc8108380 2024-05-03T16:47:09.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.956+0000 7f1dc6000700 1 -- 172.21.15.81:0/2124484937 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1dc0004bb0 con 0x7f1dc8108380 2024-05-03T16:47:09.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.956+0000 7f1dc6000700 1 -- 172.21.15.81:0/2124484937 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0005280 con 0x7f1dc8108380 2024-05-03T16:47:09.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.956+0000 7f1dcee00700 1 -- 172.21.15.81:0/2124484937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc81a51e0 con 0x7f1dc8108380 2024-05-03T16:47:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.956+0000 7f1dcee00700 1 -- 172.21.15.81:0/2124484937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc81aca60 con 0x7f1dc8108380 2024-05-03T16:47:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.957+0000 7f1dcee00700 1 -- 172.21.15.81:0/2124484937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dc806a190 con 0x7f1dc8108380 2024-05-03T16:47:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.960+0000 7f1dc6000700 1 -- 172.21.15.81:0/2124484937 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f1dc000c6d0 con 0x7f1dc8108380 2024-05-03T16:47:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.961+0000 7f1dc6000700 1 --2- 172.21.15.81:0/2124484937 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f1db00b2990 0x7f1db00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.961+0000 7f1dc6000700 1 -- 172.21.15.81:0/2124484937 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f1dc00e23c0 con 0x7f1dc8108380 2024-05-03T16:47:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.962+0000 7f1dcda00700 1 --2- 172.21.15.81:0/2124484937 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f1db00b2990 0x7f1db00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.962+0000 7f1dcda00700 1 --2- 172.21.15.81:0/2124484937 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f1db00b2990 0x7f1db00b4e50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc003760 tx=0x7f1dbc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:08.964+0000 7f1dc6000700 1 -- 172.21.15.81:0/2124484937 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f1dc0021020 con 0x7f1dc8108380 2024-05-03T16:47:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:09.201+0000 7f1dcee00700 1 -- 172.21.15.81:0/2124484937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1dc81acc30 con 0x7f1dc8108380 2024-05-03T16:47:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:09.202+0000 7f1dc6000700 1 -- 172.21.15.81:0/2124484937 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1dc00a9c00 con 0x7f1dc8108380 2024-05-03T16:47:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:09.205+0000 7f1dcee00700 1 -- 172.21.15.81:0/2124484937 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f1db00b2990 msgr2=0x7f1db00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:09.205+0000 7f1dcee00700 1 --2- 172.21.15.81:0/2124484937 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f1db00b2990 0x7f1db00b4e50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc003760 tx=0x7f1dbc01a040 comp rx=0 tx=0).stop 2024-05-03T16:47:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:09.205+0000 7f1dcee00700 1 -- 172.21.15.81:0/2124484937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc8108380 msgr2=0x7f1dc81a47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:09.205+0000 7f1dcee00700 1 --2- 172.21.15.81:0/2124484937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc8108380 0x7f1dc81a47b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000ab50 tx=0x7f1dc000af10 comp rx=0 tx=0).stop 2024-05-03T16:47:09.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:09.205+0000 7f1dcee00700 1 -- 172.21.15.81:0/2124484937 shutdown_connections 2024-05-03T16:47:09.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:09.205+0000 7f1dcee00700 1 --2- 172.21.15.81:0/2124484937 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f1db00b2990 0x7f1db00b4e50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:09.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:09.205+0000 7f1dcee00700 1 --2- 172.21.15.81:0/2124484937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc8108380 0x7f1dc81a47b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:09.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:09.205+0000 7f1dcee00700 1 --2- 172.21.15.81:0/2124484937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1dc806bf50 0x7f1dc819ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:09.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:09.205+0000 7f1dcee00700 1 --2- 172.21.15.81:0/2124484937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc8105e20 0x7f1dc81a0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:09.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:09.205+0000 7f1dcee00700 1 -- 172.21.15.81:0/2124484937 >> 172.21.15.81:0/2124484937 conn(0x7f1dc80791e0 msgr2=0x7f1dc8101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:09.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:09.206+0000 7f1dcee00700 1 -- 172.21.15.81:0/2124484937 shutdown_connections 2024-05-03T16:47:09.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:09.206+0000 7f1dcee00700 1 -- 172.21.15.81:0/2124484937 wait complete. 2024-05-03T16:47:09.238 INFO:teuthology.orchestra.run.smithi081.stdout:55834574976 2024-05-03T16:47:09.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:09 smithi081 ceph-mon[28640]: pgmap v473: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T16:47:09.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:09 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2124484937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-03T16:47:09.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:09 smithi146 ceph-mon[32357]: pgmap v473: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T16:47:09.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:09 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2124484937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-03T16:47:09.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:09 smithi134 ceph-mon[31708]: pgmap v473: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T16:47:09.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:09 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2124484937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-03T16:47:10.688 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841596 got 283467841599 for osd.10 2024-05-03T16:47:10.688 DEBUG:teuthology.parallel:result is None 2024-05-03T16:47:10.948 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574971 got 55834574976 for osd.1 2024-05-03T16:47:10.948 DEBUG:teuthology.parallel:result is None 2024-05-03T16:47:11.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:11 smithi081 ceph-mon[28640]: pgmap v474: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T16:47:11.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:11 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2302044260' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-03T16:47:11.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:11 smithi146 ceph-mon[32357]: pgmap v474: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T16:47:11.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:11 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2302044260' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-03T16:47:11.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:11 smithi134 ceph-mon[31708]: pgmap v474: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T16:47:11.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:11 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2302044260' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-03T16:47:13.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.037+0000 7fea22600700 1 -- 172.21.15.81:0/1843004916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1c105690 msgr2=0x7fea1c105b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:13.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.037+0000 7fea22600700 1 --2- 172.21.15.81:0/1843004916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1c105690 0x7fea1c105b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fea04009990 tx=0x7fea04009ca0 comp rx=0 tx=0).stop 2024-05-03T16:47:13.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.038+0000 7fea22600700 1 -- 172.21.15.81:0/1843004916 shutdown_connections 2024-05-03T16:47:13.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.038+0000 7fea22600700 1 --2- 172.21.15.81:0/1843004916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea1c106050 0x7fea1c112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:13.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.038+0000 7fea22600700 1 --2- 172.21.15.81:0/1843004916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea1c10b690 0x7fea1c10ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:13.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.038+0000 7fea22600700 1 --2- 172.21.15.81:0/1843004916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1c105690 0x7fea1c105b10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:13.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.038+0000 7fea22600700 1 -- 172.21.15.81:0/1843004916 >> 172.21.15.81:0/1843004916 conn(0x7fea1c101180 msgr2=0x7fea1c1035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:13.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.038+0000 7fea22600700 1 -- 172.21.15.81:0/1843004916 shutdown_connections 2024-05-03T16:47:13.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.038+0000 7fea22600700 1 -- 172.21.15.81:0/1843004916 wait complete. 2024-05-03T16:47:13.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.039+0000 7fea22600700 1 Processor -- start 2024-05-03T16:47:13.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.039+0000 7fea22600700 1 -- start start 2024-05-03T16:47:13.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.039+0000 7fea22600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea1c105690 0x7fea1c1a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:13.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.039+0000 7fea22600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea1c106050 0x7fea1c1a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:13.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.039+0000 7fea22600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1c10b690 0x7fea1c19baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:13.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.039+0000 7fea22600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea1c115780 con 0x7fea1c10b690 2024-05-03T16:47:13.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.039+0000 7fea22600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fea1c115600 con 0x7fea1c106050 2024-05-03T16:47:13.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.039+0000 7fea22600700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fea1c115900 con 0x7fea1c105690 2024-05-03T16:47:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.040+0000 7fea1be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1c10b690 0x7fea1c19baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.040+0000 7fea1be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1c10b690 0x7fea1c19baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34866/0 (socket says 172.21.15.81:34866) 2024-05-03T16:47:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.040+0000 7fea1be00700 1 -- 172.21.15.81:0/2302044260 learned_addr learned my addr 172.21.15.81:0/2302044260 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.040+0000 7fea12a00700 1 --2- 172.21.15.81:0/2302044260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea1c106050 0x7fea1c1a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.040+0000 7fea1b400700 1 --2- 172.21.15.81:0/2302044260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea1c105690 0x7fea1c1a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.040+0000 7fea1be00700 1 -- 172.21.15.81:0/2302044260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea1c105690 msgr2=0x7fea1c1a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.040+0000 7fea1be00700 1 --2- 172.21.15.81:0/2302044260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea1c105690 0x7fea1c1a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.040+0000 7fea1be00700 1 -- 172.21.15.81:0/2302044260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea1c106050 msgr2=0x7fea1c1a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.040+0000 7fea1be00700 1 --2- 172.21.15.81:0/2302044260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea1c106050 0x7fea1c1a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.040+0000 7fea1be00700 1 -- 172.21.15.81:0/2302044260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1c19c200 con 0x7fea1c10b690 2024-05-03T16:47:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.041+0000 7fea1be00700 1 --2- 172.21.15.81:0/2302044260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1c10b690 0x7fea1c19baa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fea14007ee0 tx=0x7fea1400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.041+0000 7fea18c00700 1 -- 172.21.15.81:0/2302044260 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1400dbd0 con 0x7fea1c10b690 2024-05-03T16:47:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.041+0000 7fea18c00700 1 -- 172.21.15.81:0/2302044260 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea1400dd70 con 0x7fea1c10b690 2024-05-03T16:47:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.041+0000 7fea22600700 1 -- 172.21.15.81:0/2302044260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea1c19c4f0 con 0x7fea1c10b690 2024-05-03T16:47:13.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.041+0000 7fea18c00700 1 -- 172.21.15.81:0/2302044260 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea140058d0 con 0x7fea1c10b690 2024-05-03T16:47:13.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.041+0000 7fea22600700 1 -- 172.21.15.81:0/2302044260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea1c1a87b0 con 0x7fea1c10b690 2024-05-03T16:47:13.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.042+0000 7fea22600700 1 -- 172.21.15.81:0/2302044260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea1c06a190 con 0x7fea1c10b690 2024-05-03T16:47:13.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.045+0000 7fea18c00700 1 -- 172.21.15.81:0/2302044260 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fea1401a020 con 0x7fea1c10b690 2024-05-03T16:47:13.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.046+0000 7fea18c00700 1 --2- 172.21.15.81:0/2302044260 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fea000b2910 0x7fea000b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:13.538 INFO:teuthology.orchestra.run.smithi081.stdout:309237645370 2024-05-03T16:47:13.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.047+0000 7fea18c00700 1 -- 172.21.15.81:0/2302044260 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fea140e26b0 con 0x7fea1c10b690 2024-05-03T16:47:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.047+0000 7fea1b400700 1 --2- 172.21.15.81:0/2302044260 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fea000b2910 0x7fea000b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.048+0000 7fea1b400700 1 --2- 172.21.15.81:0/2302044260 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fea000b2910 0x7fea000b4dd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fea1c19cbe0 tx=0x7fea0c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.049+0000 7fea18c00700 1 -- 172.21.15.81:0/2302044260 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fea14010070 con 0x7fea1c10b690 2024-05-03T16:47:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.310+0000 7fea22600700 1 -- 172.21.15.81:0/2302044260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fea1c02e510 con 0x7fea1c10b690 2024-05-03T16:47:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.310+0000 7fea18c00700 1 -- 172.21.15.81:0/2302044260 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fea140a9e60 con 0x7fea1c10b690 2024-05-03T16:47:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.313+0000 7fea22600700 1 -- 172.21.15.81:0/2302044260 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fea000b2910 msgr2=0x7fea000b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.313+0000 7fea22600700 1 --2- 172.21.15.81:0/2302044260 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fea000b2910 0x7fea000b4dd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fea1c19cbe0 tx=0x7fea0c009260 comp rx=0 tx=0).stop 2024-05-03T16:47:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.313+0000 7fea22600700 1 -- 172.21.15.81:0/2302044260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1c10b690 msgr2=0x7fea1c19baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.313+0000 7fea22600700 1 --2- 172.21.15.81:0/2302044260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1c10b690 0x7fea1c19baa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fea14007ee0 tx=0x7fea1400d3b0 comp rx=0 tx=0).stop 2024-05-03T16:47:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.313+0000 7fea22600700 1 -- 172.21.15.81:0/2302044260 shutdown_connections 2024-05-03T16:47:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.313+0000 7fea22600700 1 --2- 172.21.15.81:0/2302044260 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fea000b2910 0x7fea000b4dd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.313+0000 7fea22600700 1 --2- 172.21.15.81:0/2302044260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea1c105690 0x7fea1c1a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.313+0000 7fea22600700 1 --2- 172.21.15.81:0/2302044260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1c10b690 0x7fea1c19baa0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.313+0000 7fea22600700 1 --2- 172.21.15.81:0/2302044260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea1c106050 0x7fea1c1a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:13.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.313+0000 7fea22600700 1 -- 172.21.15.81:0/2302044260 >> 172.21.15.81:0/2302044260 conn(0x7fea1c101180 msgr2=0x7fea1c101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:13.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.313+0000 7fea22600700 1 -- 172.21.15.81:0/2302044260 shutdown_connections 2024-05-03T16:47:13.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:11.313+0000 7fea22600700 1 -- 172.21.15.81:0/2302044260 wait complete. 2024-05-03T16:47:13.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:13 smithi146 ceph-mon[32357]: pgmap v475: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T16:47:13.905 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:13 smithi081 ceph-mon[28640]: pgmap v475: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T16:47:13.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:13 smithi134 ceph-mon[31708]: pgmap v475: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T16:47:14.562 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645365 got 309237645370 for osd.11 2024-05-03T16:47:14.562 DEBUG:teuthology.parallel:result is None 2024-05-03T16:47:14.920 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005124 got 261993005128 for osd.9 2024-05-03T16:47:14.920 DEBUG:teuthology.parallel:result is None 2024-05-03T16:47:15.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.197+0000 7fa7caa00700 1 -- 172.21.15.81:0/2690960773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7c4103750 msgr2=0x7fa7c4103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:15.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.197+0000 7fa7caa00700 1 --2- 172.21.15.81:0/2690960773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7c4103750 0x7fa7c4103b30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40099c0 tx=0x7fa7b4009cd0 comp rx=0 tx=0).stop 2024-05-03T16:47:15.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.197+0000 7fa7caa00700 1 -- 172.21.15.81:0/2690960773 shutdown_connections 2024-05-03T16:47:15.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.197+0000 7fa7caa00700 1 --2- 172.21.15.81:0/2690960773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c4108850 0x7fa7c41103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:15.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.197+0000 7fa7caa00700 1 --2- 172.21.15.81:0/2690960773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7c4103750 0x7fa7c4103b30 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:15.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.197+0000 7fa7caa00700 1 --2- 172.21.15.81:0/2690960773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7c4104100 0x7fa7c4108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:15.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.197+0000 7fa7caa00700 1 -- 172.21.15.81:0/2690960773 >> 172.21.15.81:0/2690960773 conn(0x7fa7c407a600 msgr2=0x7fa7c407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:15.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.197+0000 7fa7caa00700 1 -- 172.21.15.81:0/2690960773 shutdown_connections 2024-05-03T16:47:15.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.197+0000 7fa7caa00700 1 -- 172.21.15.81:0/2690960773 wait complete. 2024-05-03T16:47:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.198+0000 7fa7caa00700 1 Processor -- start 2024-05-03T16:47:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.198+0000 7fa7caa00700 1 -- start start 2024-05-03T16:47:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.198+0000 7fa7caa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7c4103750 0x7fa7c41a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.199+0000 7fa7caa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c4104100 0x7fa7c41a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.199+0000 7fa7caa00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7c4108850 0x7fa7c419bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.199+0000 7fa7caa00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c4113590 con 0x7fa7c4103750 2024-05-03T16:47:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.199+0000 7fa7caa00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c4113410 con 0x7fa7c4104100 2024-05-03T16:47:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.199+0000 7fa7caa00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c4113710 con 0x7fa7c4108850 2024-05-03T16:47:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.199+0000 7fa7c3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7c4103750 0x7fa7c41a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.199+0000 7fa7c3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7c4103750 0x7fa7c41a1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34880/0 (socket says 172.21.15.81:34880) 2024-05-03T16:47:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.199+0000 7fa7c3e00700 1 -- 172.21.15.81:0/1477582647 learned_addr learned my addr 172.21.15.81:0/1477582647 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:15.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.199+0000 7fa7c8a00700 1 --2- 172.21.15.81:0/1477582647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7c4108850 0x7fa7c419bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:15.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.199+0000 7fa7c3400700 1 --2- 172.21.15.81:0/1477582647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c4104100 0x7fa7c41a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:15.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.199+0000 7fa7c3e00700 1 -- 172.21.15.81:0/1477582647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7c4108850 msgr2=0x7fa7c419bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:15.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.199+0000 7fa7c3e00700 1 --2- 172.21.15.81:0/1477582647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7c4108850 0x7fa7c419bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:15.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.199+0000 7fa7c3e00700 1 -- 172.21.15.81:0/1477582647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c4104100 msgr2=0x7fa7c41a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:15.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.199+0000 7fa7c3e00700 1 --2- 172.21.15.81:0/1477582647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c4104100 0x7fa7c41a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:15.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.199+0000 7fa7c3e00700 1 -- 172.21.15.81:0/1477582647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c419c410 con 0x7fa7c4103750 2024-05-03T16:47:15.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.200+0000 7fa7c3e00700 1 --2- 172.21.15.81:0/1477582647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7c4103750 0x7fa7c41a1a60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4000c00 tx=0x7fa7b400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:15.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.200+0000 7fa7c0c00700 1 -- 172.21.15.81:0/1477582647 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4027070 con 0x7fa7c4103750 2024-05-03T16:47:15.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.200+0000 7fa7caa00700 1 -- 172.21.15.81:0/1477582647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c419c6a0 con 0x7fa7c4103750 2024-05-03T16:47:15.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.200+0000 7fa7c0c00700 1 -- 172.21.15.81:0/1477582647 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa7b40056d0 con 0x7fa7c4103750 2024-05-03T16:47:15.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.200+0000 7fa7c0c00700 1 -- 172.21.15.81:0/1477582647 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b40173f0 con 0x7fa7c4103750 2024-05-03T16:47:15.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.200+0000 7fa7caa00700 1 -- 172.21.15.81:0/1477582647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c41a89e0 con 0x7fa7c4103750 2024-05-03T16:47:15.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.201+0000 7fa7caa00700 1 -- 172.21.15.81:0/1477582647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c4104be0 con 0x7fa7c4103750 2024-05-03T16:47:15.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.204+0000 7fa7c0c00700 1 -- 172.21.15.81:0/1477582647 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa7b402a070 con 0x7fa7c4103750 2024-05-03T16:47:15.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.205+0000 7fa7c0c00700 1 --2- 172.21.15.81:0/1477582647 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa7a80b2990 0x7fa7a80b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.206+0000 7fa7c3400700 1 --2- 172.21.15.81:0/1477582647 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa7a80b2990 0x7fa7a80b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.206+0000 7fa7c0c00700 1 -- 172.21.15.81:0/1477582647 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fa7b40e3880 con 0x7fa7c4103750 2024-05-03T16:47:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.206+0000 7fa7c3400700 1 --2- 172.21.15.81:0/1477582647 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa7a80b2990 0x7fa7a80b4e50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0006fd0 tx=0x7fa7b0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:15.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.208+0000 7fa7c0c00700 1 -- 172.21.15.81:0/1477582647 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa7b4031080 con 0x7fa7c4103750 2024-05-03T16:47:15.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.445+0000 7fa7caa00700 1 -- 172.21.15.81:0/1477582647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa7c419cff0 con 0x7fa7c4103750 2024-05-03T16:47:15.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.446+0000 7fa7c0c00700 1 -- 172.21.15.81:0/1477582647 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa7b4013070 con 0x7fa7c4103750 2024-05-03T16:47:15.448 INFO:teuthology.orchestra.run.smithi081.stdout:206158430296 2024-05-03T16:47:15.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.449+0000 7fa7caa00700 1 -- 172.21.15.81:0/1477582647 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa7a80b2990 msgr2=0x7fa7a80b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:15.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.449+0000 7fa7caa00700 1 --2- 172.21.15.81:0/1477582647 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa7a80b2990 0x7fa7a80b4e50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0006fd0 tx=0x7fa7b0008040 comp rx=0 tx=0).stop 2024-05-03T16:47:15.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.449+0000 7fa7caa00700 1 -- 172.21.15.81:0/1477582647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7c4103750 msgr2=0x7fa7c41a1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:15.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.449+0000 7fa7caa00700 1 --2- 172.21.15.81:0/1477582647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7c4103750 0x7fa7c41a1a60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4000c00 tx=0x7fa7b400f740 comp rx=0 tx=0).stop 2024-05-03T16:47:15.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.450+0000 7fa7caa00700 1 -- 172.21.15.81:0/1477582647 shutdown_connections 2024-05-03T16:47:15.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.450+0000 7fa7caa00700 1 --2- 172.21.15.81:0/1477582647 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa7a80b2990 0x7fa7a80b4e50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:15.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.450+0000 7fa7caa00700 1 --2- 172.21.15.81:0/1477582647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7c4108850 0x7fa7c419bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:15.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.450+0000 7fa7caa00700 1 --2- 172.21.15.81:0/1477582647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7c4103750 0x7fa7c41a1a60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:15.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.450+0000 7fa7caa00700 1 --2- 172.21.15.81:0/1477582647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c4104100 0x7fa7c41a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:15.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.450+0000 7fa7caa00700 1 -- 172.21.15.81:0/1477582647 >> 172.21.15.81:0/1477582647 conn(0x7fa7c407a600 msgr2=0x7fa7c4101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:15.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.450+0000 7fa7caa00700 1 -- 172.21.15.81:0/1477582647 shutdown_connections 2024-05-03T16:47:15.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:15.450+0000 7fa7caa00700 1 -- 172.21.15.81:0/1477582647 wait complete. 2024-05-03T16:47:15.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:15 smithi081 ceph-mon[28640]: pgmap v476: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T16:47:15.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:15 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1477582647' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-03T16:47:15.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:15 smithi146 ceph-mon[32357]: pgmap v476: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T16:47:15.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:15 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/1477582647' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-03T16:47:15.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:15 smithi134 ceph-mon[31708]: pgmap v476: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T16:47:15.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:15 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/1477582647' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-03T16:47:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.889+0000 7fd549200700 1 -- 172.21.15.81:0/1538934341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd54406bb40 msgr2=0x7fd544110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.889+0000 7fd549200700 1 --2- 172.21.15.81:0/1538934341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd54406bb40 0x7fd544110330 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00b0a0 tx=0x7fd53c00b3b0 comp rx=0 tx=0).stop 2024-05-03T16:47:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.889+0000 7fd549200700 1 -- 172.21.15.81:0/1538934341 shutdown_connections 2024-05-03T16:47:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.889+0000 7fd549200700 1 --2- 172.21.15.81:0/1538934341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd54406bb40 0x7fd544110330 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.889+0000 7fd549200700 1 --2- 172.21.15.81:0/1538934341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd544109510 0x7fd5441098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.889+0000 7fd549200700 1 --2- 172.21.15.81:0/1538934341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd54406b180 0x7fd54406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.889+0000 7fd549200700 1 -- 172.21.15.81:0/1538934341 >> 172.21.15.81:0/1538934341 conn(0x7fd544079350 msgr2=0x7fd544079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.889+0000 7fd549200700 1 -- 172.21.15.81:0/1538934341 shutdown_connections 2024-05-03T16:47:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.889+0000 7fd549200700 1 -- 172.21.15.81:0/1538934341 wait complete. 2024-05-03T16:47:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.891+0000 7fd549200700 1 Processor -- start 2024-05-03T16:47:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.891+0000 7fd549200700 1 -- start start 2024-05-03T16:47:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.891+0000 7fd549200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd54406b180 0x7fd5441a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.891+0000 7fd549200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd54406bb40 0x7fd5441a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.891+0000 7fd549200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd544109510 0x7fd54419ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.891+0000 7fd549200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd5441134f0 con 0x7fd544109510 2024-05-03T16:47:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.891+0000 7fd549200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd544113370 con 0x7fd54406b180 2024-05-03T16:47:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.891+0000 7fd549200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd544113670 con 0x7fd54406bb40 2024-05-03T16:47:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.892+0000 7fd542800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd544109510 0x7fd54419ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.892+0000 7fd542800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd544109510 0x7fd54419ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35230/0 (socket says 172.21.15.81:35230) 2024-05-03T16:47:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.892+0000 7fd542800700 1 -- 172.21.15.81:0/3756917417 learned_addr learned my addr 172.21.15.81:0/3756917417 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.892+0000 7fd541e00700 1 --2- 172.21.15.81:0/3756917417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd54406b180 0x7fd5441a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.892+0000 7fd541400700 1 --2- 172.21.15.81:0/3756917417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd54406bb40 0x7fd5441a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.892+0000 7fd542800700 1 -- 172.21.15.81:0/3756917417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd54406bb40 msgr2=0x7fd5441a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.892+0000 7fd542800700 1 --2- 172.21.15.81:0/3756917417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd54406bb40 0x7fd5441a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.892+0000 7fd542800700 1 -- 172.21.15.81:0/3756917417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd54406b180 msgr2=0x7fd5441a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.892+0000 7fd542800700 1 --2- 172.21.15.81:0/3756917417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd54406b180 0x7fd5441a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.892+0000 7fd542800700 1 -- 172.21.15.81:0/3756917417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54419c1d0 con 0x7fd544109510 2024-05-03T16:47:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.893+0000 7fd542800700 1 --2- 172.21.15.81:0/3756917417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd544109510 0x7fd54419ba70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00b830 tx=0x7fd53c004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.894+0000 7fd53aa00700 1 -- 172.21.15.81:0/3756917417 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53c021070 con 0x7fd544109510 2024-05-03T16:47:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.894+0000 7fd53aa00700 1 -- 172.21.15.81:0/3756917417 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd53c007b80 con 0x7fd544109510 2024-05-03T16:47:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.894+0000 7fd549200700 1 -- 172.21.15.81:0/3756917417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd54419c460 con 0x7fd544109510 2024-05-03T16:47:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.894+0000 7fd53aa00700 1 -- 172.21.15.81:0/3756917417 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53c0052a0 con 0x7fd544109510 2024-05-03T16:47:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.894+0000 7fd549200700 1 -- 172.21.15.81:0/3756917417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5441a8780 con 0x7fd544109510 2024-05-03T16:47:16.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.896+0000 7fd549200700 1 -- 172.21.15.81:0/3756917417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd54406a190 con 0x7fd544109510 2024-05-03T16:47:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.897+0000 7fd53aa00700 1 -- 172.21.15.81:0/3756917417 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd53c024070 con 0x7fd544109510 2024-05-03T16:47:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.899+0000 7fd53aa00700 1 --2- 172.21.15.81:0/3756917417 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd5280b2990 0x7fd5280b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.899+0000 7fd53aa00700 1 -- 172.21.15.81:0/3756917417 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fd53c00f020 con 0x7fd544109510 2024-05-03T16:47:16.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.899+0000 7fd541e00700 1 --2- 172.21.15.81:0/3756917417 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd5280b2990 0x7fd5280b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:16.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.900+0000 7fd541e00700 1 --2- 172.21.15.81:0/3756917417 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd5280b2990 0x7fd5280b4e50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd54419cbb0 tx=0x7fd53400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:16.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.904+0000 7fd53aa00700 1 -- 172.21.15.81:0/3756917417 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd53c02b020 con 0x7fd544109510 2024-05-03T16:47:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.147+0000 7fd549200700 1 -- 172.21.15.81:0/3756917417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd5441a8950 con 0x7fd544109510 2024-05-03T16:47:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.148+0000 7fd53aa00700 1 -- 172.21.15.81:0/3756917417 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd53c0ab5b0 con 0x7fd544109510 2024-05-03T16:47:17.150 INFO:teuthology.orchestra.run.smithi081.stdout:77309411450 2024-05-03T16:47:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.151+0000 7fd549200700 1 -- 172.21.15.81:0/3756917417 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd5280b2990 msgr2=0x7fd5280b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.151+0000 7fd549200700 1 --2- 172.21.15.81:0/3756917417 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd5280b2990 0x7fd5280b4e50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd54419cbb0 tx=0x7fd53400b410 comp rx=0 tx=0).stop 2024-05-03T16:47:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.151+0000 7fd549200700 1 -- 172.21.15.81:0/3756917417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd544109510 msgr2=0x7fd54419ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.151+0000 7fd549200700 1 --2- 172.21.15.81:0/3756917417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd544109510 0x7fd54419ba70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00b830 tx=0x7fd53c004d00 comp rx=0 tx=0).stop 2024-05-03T16:47:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.151+0000 7fd549200700 1 -- 172.21.15.81:0/3756917417 shutdown_connections 2024-05-03T16:47:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.151+0000 7fd549200700 1 --2- 172.21.15.81:0/3756917417 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd5280b2990 0x7fd5280b4e50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.151+0000 7fd549200700 1 --2- 172.21.15.81:0/3756917417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd544109510 0x7fd54419ba70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.151+0000 7fd549200700 1 --2- 172.21.15.81:0/3756917417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd54406b180 0x7fd5441a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.151+0000 7fd549200700 1 --2- 172.21.15.81:0/3756917417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd54406bb40 0x7fd5441a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.151+0000 7fd549200700 1 -- 172.21.15.81:0/3756917417 >> 172.21.15.81:0/3756917417 conn(0x7fd544079350 msgr2=0x7fd54410e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.151+0000 7fd549200700 1 -- 172.21.15.81:0/3756917417 shutdown_connections 2024-05-03T16:47:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.151+0000 7fd549200700 1 -- 172.21.15.81:0/3756917417 wait complete. 2024-05-03T16:47:17.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.755+0000 7fce87c00700 1 -- 172.21.15.81:0/2919393406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce80108850 msgr2=0x7fce801103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:17.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.755+0000 7fce87c00700 1 --2- 172.21.15.81:0/2919393406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce80108850 0x7fce801103d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fce7800b0d0 tx=0x7fce7800b3e0 comp rx=0 tx=0).stop 2024-05-03T16:47:17.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.755+0000 7fce87c00700 1 -- 172.21.15.81:0/2919393406 shutdown_connections 2024-05-03T16:47:17.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.755+0000 7fce87c00700 1 --2- 172.21.15.81:0/2919393406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce80103750 0x7fce80103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:17.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.755+0000 7fce87c00700 1 --2- 172.21.15.81:0/2919393406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce80108850 0x7fce801103d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:17.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.755+0000 7fce87c00700 1 --2- 172.21.15.81:0/2919393406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80104100 0x7fce80108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:17.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.755+0000 7fce87c00700 1 -- 172.21.15.81:0/2919393406 >> 172.21.15.81:0/2919393406 conn(0x7fce8007a600 msgr2=0x7fce8007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:17.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.755+0000 7fce87c00700 1 -- 172.21.15.81:0/2919393406 shutdown_connections 2024-05-03T16:47:17.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.755+0000 7fce87c00700 1 -- 172.21.15.81:0/2919393406 wait complete. 2024-05-03T16:47:17.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.756+0000 7fce87c00700 1 Processor -- start 2024-05-03T16:47:17.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.756+0000 7fce87c00700 1 -- start start 2024-05-03T16:47:17.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.757+0000 7fce87c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80103750 0x7fce801a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.757+0000 7fce87c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce80104100 0x7fce801a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.757+0000 7fce87c00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce80108850 0x7fce8019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.757+0000 7fce87c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fce80113550 con 0x7fce80104100 2024-05-03T16:47:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.757+0000 7fce87c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fce801133d0 con 0x7fce80103750 2024-05-03T16:47:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.757+0000 7fce87c00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fce801136d0 con 0x7fce80108850 2024-05-03T16:47:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.757+0000 7fce7fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce80104100 0x7fce801a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.757+0000 7fce7fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce80104100 0x7fce801a1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35204/0 (socket says 172.21.15.81:35204) 2024-05-03T16:47:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.757+0000 7fce7fe00700 1 -- 172.21.15.81:0/4054168857 learned_addr learned my addr 172.21.15.81:0/4054168857 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.757+0000 7fce85200700 1 --2- 172.21.15.81:0/4054168857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80103750 0x7fce801a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.757+0000 7fce7fe00700 1 -- 172.21.15.81:0/4054168857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce80108850 msgr2=0x7fce8019b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.757+0000 7fce7fe00700 1 --2- 172.21.15.81:0/4054168857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce80108850 0x7fce8019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.757+0000 7fce7fe00700 1 -- 172.21.15.81:0/4054168857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80103750 msgr2=0x7fce801a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.757+0000 7fce7fe00700 1 --2- 172.21.15.81:0/4054168857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80103750 0x7fce801a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.757+0000 7fce7fe00700 1 -- 172.21.15.81:0/4054168857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8019c150 con 0x7fce80104100 2024-05-03T16:47:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.758+0000 7fce7fe00700 1 --2- 172.21.15.81:0/4054168857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce80104100 0x7fce801a1d20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00c9b0 tx=0x7fce6c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.758+0000 7fce7d600700 1 -- 172.21.15.81:0/4054168857 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c007b00 con 0x7fce80104100 2024-05-03T16:47:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.758+0000 7fce87c00700 1 -- 172.21.15.81:0/4054168857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce8019c440 con 0x7fce80104100 2024-05-03T16:47:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.758+0000 7fce7d600700 1 -- 172.21.15.81:0/4054168857 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce6c007ca0 con 0x7fce80104100 2024-05-03T16:47:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.758+0000 7fce7d600700 1 -- 172.21.15.81:0/4054168857 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c004a30 con 0x7fce80104100 2024-05-03T16:47:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.758+0000 7fce87c00700 1 -- 172.21.15.81:0/4054168857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce801a8730 con 0x7fce80104100 2024-05-03T16:47:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.759+0000 7fce87c00700 1 -- 172.21.15.81:0/4054168857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce8006a190 con 0x7fce80104100 2024-05-03T16:47:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.762+0000 7fce7d600700 1 -- 172.21.15.81:0/4054168857 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fce6c004c90 con 0x7fce80104100 2024-05-03T16:47:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.763+0000 7fce7d600700 1 --2- 172.21.15.81:0/4054168857 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fce680b2910 0x7fce680b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.763+0000 7fce7d600700 1 -- 172.21.15.81:0/4054168857 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fce6c0e28c0 con 0x7fce80104100 2024-05-03T16:47:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.764+0000 7fce85200700 1 --2- 172.21.15.81:0/4054168857 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fce680b2910 0x7fce680b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.764+0000 7fce85200700 1 --2- 172.21.15.81:0/4054168857 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fce680b2910 0x7fce680b4dd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fce74006fd0 tx=0x7fce74008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:16.767+0000 7fce7d600700 1 -- 172.21.15.81:0/4054168857 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fce6c014030 con 0x7fce80104100 2024-05-03T16:47:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.007+0000 7fce87c00700 1 -- 172.21.15.81:0/4054168857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fce801a89f0 con 0x7fce80104100 2024-05-03T16:47:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.008+0000 7fce7d600700 1 -- 172.21.15.81:0/4054168857 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fce6c0aa070 con 0x7fce80104100 2024-05-03T16:47:17.248 INFO:teuthology.orchestra.run.smithi081.stdout:111669149810 2024-05-03T16:47:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.011+0000 7fce87c00700 1 -- 172.21.15.81:0/4054168857 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fce680b2910 msgr2=0x7fce680b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.011+0000 7fce87c00700 1 --2- 172.21.15.81:0/4054168857 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fce680b2910 0x7fce680b4dd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fce74006fd0 tx=0x7fce74008040 comp rx=0 tx=0).stop 2024-05-03T16:47:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.011+0000 7fce87c00700 1 -- 172.21.15.81:0/4054168857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce80104100 msgr2=0x7fce801a1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.011+0000 7fce87c00700 1 --2- 172.21.15.81:0/4054168857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce80104100 0x7fce801a1d20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00c9b0 tx=0x7fce6c00cd70 comp rx=0 tx=0).stop 2024-05-03T16:47:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.011+0000 7fce87c00700 1 -- 172.21.15.81:0/4054168857 shutdown_connections 2024-05-03T16:47:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.011+0000 7fce87c00700 1 --2- 172.21.15.81:0/4054168857 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fce680b2910 0x7fce680b4dd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.011+0000 7fce87c00700 1 --2- 172.21.15.81:0/4054168857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce80108850 0x7fce8019b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.011+0000 7fce87c00700 1 --2- 172.21.15.81:0/4054168857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80103750 0x7fce801a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.011+0000 7fce87c00700 1 --2- 172.21.15.81:0/4054168857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce80104100 0x7fce801a1d20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.011+0000 7fce87c00700 1 -- 172.21.15.81:0/4054168857 >> 172.21.15.81:0/4054168857 conn(0x7fce8007a600 msgr2=0x7fce80101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.011+0000 7fce87c00700 1 -- 172.21.15.81:0/4054168857 shutdown_connections 2024-05-03T16:47:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:17.011+0000 7fce87c00700 1 -- 172.21.15.81:0/4054168857 wait complete. 2024-05-03T16:47:17.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:17 smithi146 ceph-mon[32357]: pgmap v477: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-05-03T16:47:17.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:17 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/4054168857' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-03T16:47:17.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:17 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3756917417' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-03T16:47:17.833 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:17 smithi081 ceph-mon[28640]: pgmap v477: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-05-03T16:47:17.833 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:17 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/4054168857' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-03T16:47:17.833 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:17 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3756917417' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-03T16:47:17.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:17 smithi134 ceph-mon[31708]: pgmap v477: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-05-03T16:47:17.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:17 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/4054168857' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-03T16:47:17.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:17 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3756917417' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-03T16:47:18.028 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790047 got 158913790053 for osd.5 2024-05-03T16:47:18.028 DEBUG:teuthology.parallel:result is None 2024-05-03T16:47:18.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.242+0000 7fc44b200700 1 -- 172.21.15.81:0/1756805214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c103d90 msgr2=0x7fc44c1102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:18.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.242+0000 7fc44b200700 1 --2- 172.21.15.81:0/1756805214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c103d90 0x7fc44c1102a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc444009990 tx=0x7fc444009ca0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.242+0000 7fc44b200700 1 -- 172.21.15.81:0/1756805214 shutdown_connections 2024-05-03T16:47:18.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.242+0000 7fc44b200700 1 --2- 172.21.15.81:0/1756805214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c103d90 0x7fc44c1102a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.242+0000 7fc44b200700 1 --2- 172.21.15.81:0/1756805214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc44c109460 0x7fc44c109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.242+0000 7fc44b200700 1 --2- 172.21.15.81:0/1756805214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc44c1033d0 0x7fc44c103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.242+0000 7fc44b200700 1 -- 172.21.15.81:0/1756805214 >> 172.21.15.81:0/1756805214 conn(0x7fc44c0fef20 msgr2=0x7fc44c101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:18.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.242+0000 7fc44b200700 1 -- 172.21.15.81:0/1756805214 shutdown_connections 2024-05-03T16:47:18.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.242+0000 7fc44b200700 1 -- 172.21.15.81:0/1756805214 wait complete. 2024-05-03T16:47:18.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.243+0000 7fc44b200700 1 Processor -- start 2024-05-03T16:47:18.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.243+0000 7fc44b200700 1 -- start start 2024-05-03T16:47:18.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.243+0000 7fc44b200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc44c1033d0 0x7fc44c1a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:18.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.243+0000 7fc44b200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc44c103d90 0x7fc44c1a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:18.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.243+0000 7fc44b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c109460 0x7fc44c19b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:18.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.244+0000 7fc44b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c113420 con 0x7fc44c109460 2024-05-03T16:47:18.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.244+0000 7fc44b200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1132a0 con 0x7fc44c1033d0 2024-05-03T16:47:18.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.244+0000 7fc44b200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1135a0 con 0x7fc44c103d90 2024-05-03T16:47:18.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.244+0000 7fc44a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c109460 0x7fc44c19b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:18.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.244+0000 7fc44a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c109460 0x7fc44c19b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35252/0 (socket says 172.21.15.81:35252) 2024-05-03T16:47:18.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.244+0000 7fc44a800700 1 -- 172.21.15.81:0/3106819905 learned_addr learned my addr 172.21.15.81:0/3106819905 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:18.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.244+0000 7fc449e00700 1 --2- 172.21.15.81:0/3106819905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc44c1033d0 0x7fc44c1a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:18.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.244+0000 7fc443e00700 1 --2- 172.21.15.81:0/3106819905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc44c103d90 0x7fc44c1a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:18.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.244+0000 7fc44a800700 1 -- 172.21.15.81:0/3106819905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc44c103d90 msgr2=0x7fc44c1a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:18.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.244+0000 7fc44a800700 1 --2- 172.21.15.81:0/3106819905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc44c103d90 0x7fc44c1a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.244+0000 7fc44a800700 1 -- 172.21.15.81:0/3106819905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc44c1033d0 msgr2=0x7fc44c1a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:18.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.244+0000 7fc44a800700 1 --2- 172.21.15.81:0/3106819905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc44c1033d0 0x7fc44c1a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.244+0000 7fc44a800700 1 -- 172.21.15.81:0/3106819905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44c19c100 con 0x7fc44c109460 2024-05-03T16:47:18.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.245+0000 7fc449e00700 1 --2- 172.21.15.81:0/3106819905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc44c1033d0 0x7fc44c1a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:47:18.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.245+0000 7fc44a800700 1 --2- 172.21.15.81:0/3106819905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c109460 0x7fc44c19b9a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc4440057c0 tx=0x7fc4440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:18.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.245+0000 7fc442a00700 1 -- 172.21.15.81:0/3106819905 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444027070 con 0x7fc44c109460 2024-05-03T16:47:18.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.245+0000 7fc442a00700 1 -- 172.21.15.81:0/3106819905 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc44400fb80 con 0x7fc44c109460 2024-05-03T16:47:18.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.245+0000 7fc44b200700 1 -- 172.21.15.81:0/3106819905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44c19c390 con 0x7fc44c109460 2024-05-03T16:47:18.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.245+0000 7fc442a00700 1 -- 172.21.15.81:0/3106819905 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444022cd0 con 0x7fc44c109460 2024-05-03T16:47:18.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.245+0000 7fc44b200700 1 -- 172.21.15.81:0/3106819905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44c1a86b0 con 0x7fc44c109460 2024-05-03T16:47:18.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.246+0000 7fc44b200700 1 -- 172.21.15.81:0/3106819905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc44c06a190 con 0x7fc44c109460 2024-05-03T16:47:18.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.249+0000 7fc442a00700 1 -- 172.21.15.81:0/3106819905 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc44402a070 con 0x7fc44c109460 2024-05-03T16:47:18.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.251+0000 7fc442a00700 1 --2- 172.21.15.81:0/3106819905 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fc4300b2990 0x7fc4300b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:18.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.251+0000 7fc442a00700 1 -- 172.21.15.81:0/3106819905 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fc4440e3840 con 0x7fc44c109460 2024-05-03T16:47:18.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.251+0000 7fc449e00700 1 --2- 172.21.15.81:0/3106819905 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fc4300b2990 0x7fc4300b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:18.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.252+0000 7fc449e00700 1 --2- 172.21.15.81:0/3106819905 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fc4300b2990 0x7fc4300b4e50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc44c19cae0 tx=0x7fc43c009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:18.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.254+0000 7fc442a00700 1 -- 172.21.15.81:0/3106819905 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc444031080 con 0x7fc44c109460 2024-05-03T16:47:18.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.493+0000 7fc44b200700 1 -- 172.21.15.81:0/3106819905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fc44c1a8880 con 0x7fc44c109460 2024-05-03T16:47:18.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.494+0000 7fc442a00700 1 -- 172.21.15.81:0/3106819905 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc444013070 con 0x7fc44c109460 2024-05-03T16:47:18.497 INFO:teuthology.orchestra.run.smithi081.stdout:236223201360 2024-05-03T16:47:18.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.497+0000 7fc44b200700 1 -- 172.21.15.81:0/3106819905 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fc4300b2990 msgr2=0x7fc4300b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:18.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.497+0000 7fc44b200700 1 --2- 172.21.15.81:0/3106819905 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fc4300b2990 0x7fc4300b4e50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc44c19cae0 tx=0x7fc43c009040 comp rx=0 tx=0).stop 2024-05-03T16:47:18.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.497+0000 7fc44b200700 1 -- 172.21.15.81:0/3106819905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c109460 msgr2=0x7fc44c19b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:18.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.497+0000 7fc44b200700 1 --2- 172.21.15.81:0/3106819905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c109460 0x7fc44c19b9a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc4440057c0 tx=0x7fc4440057f0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.497+0000 7fc44b200700 1 -- 172.21.15.81:0/3106819905 shutdown_connections 2024-05-03T16:47:18.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.497+0000 7fc44b200700 1 --2- 172.21.15.81:0/3106819905 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fc4300b2990 0x7fc4300b4e50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.497+0000 7fc44b200700 1 --2- 172.21.15.81:0/3106819905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c109460 0x7fc44c19b9a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.497+0000 7fc44b200700 1 --2- 172.21.15.81:0/3106819905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc44c1033d0 0x7fc44c1a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.497+0000 7fc44b200700 1 --2- 172.21.15.81:0/3106819905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc44c103d90 0x7fc44c1a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.497+0000 7fc44b200700 1 -- 172.21.15.81:0/3106819905 >> 172.21.15.81:0/3106819905 conn(0x7fc44c0fef20 msgr2=0x7fc44c0ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:18.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.498+0000 7fc44b200700 1 -- 172.21.15.81:0/3106819905 shutdown_connections 2024-05-03T16:47:18.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.498+0000 7fc44b200700 1 -- 172.21.15.81:0/3106819905 wait complete. 2024-05-03T16:47:18.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.515+0000 7fee11e00700 1 -- 172.21.15.81:0/3201682168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c104100 msgr2=0x7fee0c108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:18.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.515+0000 7fee11e00700 1 --2- 172.21.15.81:0/3201682168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c104100 0x7fee0c108120 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fedf80099c0 tx=0x7fedf8009cd0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.515+0000 7fee11e00700 1 -- 172.21.15.81:0/3201682168 shutdown_connections 2024-05-03T16:47:18.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.515+0000 7fee11e00700 1 --2- 172.21.15.81:0/3201682168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0c103750 0x7fee0c103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.515+0000 7fee11e00700 1 --2- 172.21.15.81:0/3201682168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee0c108850 0x7fee0c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.515+0000 7fee11e00700 1 --2- 172.21.15.81:0/3201682168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c104100 0x7fee0c108120 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.515+0000 7fee11e00700 1 -- 172.21.15.81:0/3201682168 >> 172.21.15.81:0/3201682168 conn(0x7fee0c07a600 msgr2=0x7fee0c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:18.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.516+0000 7fee11e00700 1 -- 172.21.15.81:0/3201682168 shutdown_connections 2024-05-03T16:47:18.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.516+0000 7fee11e00700 1 -- 172.21.15.81:0/3201682168 wait complete. 2024-05-03T16:47:18.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.517+0000 7fee11e00700 1 Processor -- start 2024-05-03T16:47:18.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.518+0000 7fee11e00700 1 -- start start 2024-05-03T16:47:18.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.518+0000 7fee11e00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0c103750 0x7fee0c1a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:18.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.518+0000 7fee11e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee0c104100 0x7fee0c1a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:18.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.518+0000 7fee11e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c108850 0x7fee0c19ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:18.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.518+0000 7fee11e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c113530 con 0x7fee0c108850 2024-05-03T16:47:18.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.518+0000 7fee11e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c1133b0 con 0x7fee0c104100 2024-05-03T16:47:18.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.518+0000 7fee11e00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c1136b0 con 0x7fee0c103750 2024-05-03T16:47:18.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.519+0000 7fee0b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c108850 0x7fee0c19ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:18.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.519+0000 7fee0b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c108850 0x7fee0c19ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35266/0 (socket says 172.21.15.81:35266) 2024-05-03T16:47:18.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.519+0000 7fee0b400700 1 -- 172.21.15.81:0/3305531378 learned_addr learned my addr 172.21.15.81:0/3305531378 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:18.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.519+0000 7fee0a000700 1 --2- 172.21.15.81:0/3305531378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee0c104100 0x7fee0c1a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:18.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.519+0000 7fee0aa00700 1 --2- 172.21.15.81:0/3305531378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0c103750 0x7fee0c1a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:18.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.519+0000 7fee0b400700 1 -- 172.21.15.81:0/3305531378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0c103750 msgr2=0x7fee0c1a18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:18.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.519+0000 7fee0b400700 1 --2- 172.21.15.81:0/3305531378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0c103750 0x7fee0c1a18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.519+0000 7fee0b400700 1 -- 172.21.15.81:0/3305531378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee0c104100 msgr2=0x7fee0c1a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:18.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.519+0000 7fee0b400700 1 --2- 172.21.15.81:0/3305531378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee0c104100 0x7fee0c1a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.519+0000 7fee0b400700 1 -- 172.21.15.81:0/3305531378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0c19c1f0 con 0x7fee0c108850 2024-05-03T16:47:18.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.520+0000 7fee0b400700 1 --2- 172.21.15.81:0/3305531378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c108850 0x7fee0c19ba90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fee04007ee0 tx=0x7fee0400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.524+0000 7fee10a00700 1 -- 172.21.15.81:0/3305531378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0400dbd0 con 0x7fee0c108850 2024-05-03T16:47:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.524+0000 7fee10a00700 1 -- 172.21.15.81:0/3305531378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee0400dd70 con 0x7fee0c108850 2024-05-03T16:47:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.524+0000 7fee10a00700 1 -- 172.21.15.81:0/3305531378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee040058d0 con 0x7fee0c108850 2024-05-03T16:47:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.524+0000 7fee11e00700 1 -- 172.21.15.81:0/3305531378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee0c19c4e0 con 0x7fee0c108850 2024-05-03T16:47:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.524+0000 7fee11e00700 1 -- 172.21.15.81:0/3305531378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee0c1a87a0 con 0x7fee0c108850 2024-05-03T16:47:18.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.526+0000 7fee11e00700 1 -- 172.21.15.81:0/3305531378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee0c06a190 con 0x7fee0c108850 2024-05-03T16:47:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.530+0000 7fee10a00700 1 -- 172.21.15.81:0/3305531378 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fee0401a020 con 0x7fee0c108850 2024-05-03T16:47:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.531+0000 7fee10a00700 1 --2- 172.21.15.81:0/3305531378 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fedf00b2990 0x7fedf00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.531+0000 7fee10a00700 1 -- 172.21.15.81:0/3305531378 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fee040e2540 con 0x7fee0c108850 2024-05-03T16:47:18.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.532+0000 7fee0aa00700 1 --2- 172.21.15.81:0/3305531378 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fedf00b2990 0x7fedf00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:18.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.532+0000 7fee0aa00700 1 --2- 172.21.15.81:0/3305531378 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fedf00b2990 0x7fedf00b4e50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fedfc005950 tx=0x7fedfc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:18.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.533+0000 7fee10a00700 1 -- 172.21.15.81:0/3305531378 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fee04010070 con 0x7fee0c108850 2024-05-03T16:47:18.668 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:18 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3106819905' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-03T16:47:18.710 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:47:18.711 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:47:18.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.790+0000 7fee11e00700 1 -- 172.21.15.81:0/3305531378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fee0c1a89a0 con 0x7fee0c108850 2024-05-03T16:47:18.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.790+0000 7fee10a00700 1 -- 172.21.15.81:0/3305531378 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fee040a9d50 con 0x7fee0c108850 2024-05-03T16:47:18.793 INFO:teuthology.orchestra.run.smithi081.stdout:184683593823 2024-05-03T16:47:18.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.793+0000 7fee11e00700 1 -- 172.21.15.81:0/3305531378 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fedf00b2990 msgr2=0x7fedf00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.793+0000 7fee11e00700 1 --2- 172.21.15.81:0/3305531378 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fedf00b2990 0x7fedf00b4e50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fedfc005950 tx=0x7fedfc0058e0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.793+0000 7fee11e00700 1 -- 172.21.15.81:0/3305531378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c108850 msgr2=0x7fee0c19ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.793+0000 7fee11e00700 1 --2- 172.21.15.81:0/3305531378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c108850 0x7fee0c19ba90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fee04007ee0 tx=0x7fee0400d3b0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.793+0000 7fee11e00700 1 -- 172.21.15.81:0/3305531378 shutdown_connections 2024-05-03T16:47:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.793+0000 7fee11e00700 1 --2- 172.21.15.81:0/3305531378 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fedf00b2990 0x7fedf00b4e50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.793+0000 7fee11e00700 1 --2- 172.21.15.81:0/3305531378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0c103750 0x7fee0c1a18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.793+0000 7fee11e00700 1 --2- 172.21.15.81:0/3305531378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c108850 0x7fee0c19ba90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.793+0000 7fee11e00700 1 --2- 172.21.15.81:0/3305531378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee0c104100 0x7fee0c1a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.793+0000 7fee11e00700 1 -- 172.21.15.81:0/3305531378 >> 172.21.15.81:0/3305531378 conn(0x7fee0c07a600 msgr2=0x7fee0c10fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.793+0000 7fee11e00700 1 -- 172.21.15.81:0/3305531378 shutdown_connections 2024-05-03T16:47:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:18.793+0000 7fee11e00700 1 -- 172.21.15.81:0/3305531378 wait complete. 2024-05-03T16:47:18.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:18 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3106819905' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-03T16:47:18.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:18 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3106819905' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-03T16:47:19.658 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:19 smithi081 ceph-mon[28640]: pgmap v478: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T16:47:19.659 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:19 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3305531378' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-03T16:47:19.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:19 smithi146 ceph-mon[32357]: pgmap v478: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T16:47:19.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:19 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3305531378' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-03T16:47:19.882 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411445 got 77309411450 for osd.2 2024-05-03T16:47:19.883 DEBUG:teuthology.parallel:result is None 2024-05-03T16:47:19.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:19 smithi134 ceph-mon[31708]: pgmap v478: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T16:47:19.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:19 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3305531378' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-03T16:47:20.236 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149806 got 111669149810 for osd.3 2024-05-03T16:47:20.236 DEBUG:teuthology.parallel:result is None 2024-05-03T16:47:21.015 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593817 got 184683593823 for osd.6 2024-05-03T16:47:21.015 DEBUG:teuthology.parallel:result is None 2024-05-03T16:47:21.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:21 smithi146 ceph-mon[32357]: pgmap v479: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:21.890 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:21 smithi081 ceph-mon[28640]: pgmap v479: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:21.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:21 smithi134 ceph-mon[31708]: pgmap v479: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:22.348 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430290 got 206158430296 for osd.7 2024-05-03T16:47:22.348 DEBUG:teuthology.parallel:result is None 2024-05-03T16:47:22.995 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201353 got 236223201360 for osd.8 2024-05-03T16:47:22.996 DEBUG:teuthology.parallel:result is None 2024-05-03T16:47:23.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:23 smithi081 ceph-mon[28640]: pgmap v480: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:47:23.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:23 smithi146 ceph-mon[32357]: pgmap v480: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:47:23.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:23 smithi134 ceph-mon[31708]: pgmap v480: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:47:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.775+0000 7f13d6e00700 1 -- 172.21.15.81:0/2218836308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13d010b660 msgr2=0x7f13d010ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.775+0000 7f13d6e00700 1 --2- 172.21.15.81:0/2218836308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13d010b660 0x7f13d010ba40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f13c4009990 tx=0x7f13c4009ca0 comp rx=0 tx=0).stop 2024-05-03T16:47:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.775+0000 7f13d6e00700 1 -- 172.21.15.81:0/2218836308 shutdown_connections 2024-05-03T16:47:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.775+0000 7f13d6e00700 1 --2- 172.21.15.81:0/2218836308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13d0105f90 0x7f13d01124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.775+0000 7f13d6e00700 1 --2- 172.21.15.81:0/2218836308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13d010b660 0x7f13d010ba40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.775+0000 7f13d6e00700 1 --2- 172.21.15.81:0/2218836308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13d01055d0 0x7f13d0105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.775+0000 7f13d6e00700 1 -- 172.21.15.81:0/2218836308 >> 172.21.15.81:0/2218836308 conn(0x7f13d01010c0 msgr2=0x7f13d01034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.775+0000 7f13d6e00700 1 -- 172.21.15.81:0/2218836308 shutdown_connections 2024-05-03T16:47:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.775+0000 7f13d6e00700 1 -- 172.21.15.81:0/2218836308 wait complete. 2024-05-03T16:47:24.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.776+0000 7f13d6e00700 1 Processor -- start 2024-05-03T16:47:24.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.776+0000 7f13d6e00700 1 -- start start 2024-05-03T16:47:24.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.777+0000 7f13d6e00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13d01055d0 0x7f13d01a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:24.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.777+0000 7f13d6e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13d0105f90 0x7f13d01a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:24.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.777+0000 7f13d6e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13d010b660 0x7f13d019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:24.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.777+0000 7f13d6e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13d01156d0 con 0x7f13d010b660 2024-05-03T16:47:24.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.777+0000 7f13d6e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f13d0115550 con 0x7f13d0105f90 2024-05-03T16:47:24.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.777+0000 7f13d6e00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f13d0115850 con 0x7f13d01055d0 2024-05-03T16:47:24.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.777+0000 7f13d6400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13d010b660 0x7f13d019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:24.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.778+0000 7f13d6400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13d010b660 0x7f13d019b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35286/0 (socket says 172.21.15.81:35286) 2024-05-03T16:47:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.778+0000 7f13d6400700 1 -- 172.21.15.81:0/3921097853 learned_addr learned my addr 172.21.15.81:0/3921097853 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.778+0000 7f13d5a00700 1 --2- 172.21.15.81:0/3921097853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13d01055d0 0x7f13d01a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.778+0000 7f13d5000700 1 --2- 172.21.15.81:0/3921097853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13d0105f90 0x7f13d01a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.778+0000 7f13d6400700 1 -- 172.21.15.81:0/3921097853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13d01055d0 msgr2=0x7f13d01a17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.778+0000 7f13d6400700 1 --2- 172.21.15.81:0/3921097853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13d01055d0 0x7f13d01a17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.778+0000 7f13d6400700 1 -- 172.21.15.81:0/3921097853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13d0105f90 msgr2=0x7f13d01a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.778+0000 7f13d6400700 1 --2- 172.21.15.81:0/3921097853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13d0105f90 0x7f13d01a1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.778+0000 7f13d6400700 1 -- 172.21.15.81:0/3921097853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d019c110 con 0x7f13d010b660 2024-05-03T16:47:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.778+0000 7f13d5000700 1 --2- 172.21.15.81:0/3921097853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13d0105f90 0x7f13d01a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:47:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.778+0000 7f13d6400700 1 --2- 172.21.15.81:0/3921097853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13d010b660 0x7f13d019b9b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f13c800ada0 tx=0x7f13c800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:24.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.779+0000 7f13ce000700 1 -- 172.21.15.81:0/3921097853 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8017020 con 0x7f13d010b660 2024-05-03T16:47:24.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.779+0000 7f13ce000700 1 -- 172.21.15.81:0/3921097853 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13c800ce10 con 0x7f13d010b660 2024-05-03T16:47:24.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.779+0000 7f13ce000700 1 -- 172.21.15.81:0/3921097853 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8005280 con 0x7f13d010b660 2024-05-03T16:47:24.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.779+0000 7f13d6e00700 1 -- 172.21.15.81:0/3921097853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d019c400 con 0x7f13d010b660 2024-05-03T16:47:24.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.779+0000 7f13d6e00700 1 -- 172.21.15.81:0/3921097853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d01a8670 con 0x7f13d010b660 2024-05-03T16:47:24.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.780+0000 7f13d6e00700 1 -- 172.21.15.81:0/3921097853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13d006a190 con 0x7f13d010b660 2024-05-03T16:47:24.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.782+0000 7f13ce000700 1 -- 172.21.15.81:0/3921097853 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f13c800c980 con 0x7f13d010b660 2024-05-03T16:47:24.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.784+0000 7f13ce000700 1 --2- 172.21.15.81:0/3921097853 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f13b80b2990 0x7f13b80b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:24.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.784+0000 7f13ce000700 1 -- 172.21.15.81:0/3921097853 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f13c80e1e70 con 0x7f13d010b660 2024-05-03T16:47:24.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.784+0000 7f13d5a00700 1 --2- 172.21.15.81:0/3921097853 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f13b80b2990 0x7f13b80b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:24.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.785+0000 7f13d5a00700 1 --2- 172.21.15.81:0/3921097853 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f13b80b2990 0x7f13b80b4e50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f13d010a800 tx=0x7f13c400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:24.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:24.789+0000 7f13ce000700 1 -- 172.21.15.81:0/3921097853 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f13c8021020 con 0x7f13d010b660 2024-05-03T16:47:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.027+0000 7f13d6e00700 1 -- 172.21.15.81:0/3921097853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f13d002e510 con 0x7f13d010b660 2024-05-03T16:47:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.028+0000 7f13ce000700 1 -- 172.21.15.81:0/3921097853 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f13c80a96b0 con 0x7f13d010b660 2024-05-03T16:47:25.031 INFO:teuthology.orchestra.run.smithi081.stdout:137438953582 2024-05-03T16:47:25.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.033+0000 7f13d6e00700 1 -- 172.21.15.81:0/3921097853 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f13b80b2990 msgr2=0x7f13b80b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:25.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.033+0000 7f13d6e00700 1 --2- 172.21.15.81:0/3921097853 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f13b80b2990 0x7f13b80b4e50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f13d010a800 tx=0x7f13c400b540 comp rx=0 tx=0).stop 2024-05-03T16:47:25.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.033+0000 7f13d6e00700 1 -- 172.21.15.81:0/3921097853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13d010b660 msgr2=0x7f13d019b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:25.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.033+0000 7f13d6e00700 1 --2- 172.21.15.81:0/3921097853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13d010b660 0x7f13d019b9b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f13c800ada0 tx=0x7f13c800c330 comp rx=0 tx=0).stop 2024-05-03T16:47:25.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.034+0000 7f13d6e00700 1 -- 172.21.15.81:0/3921097853 shutdown_connections 2024-05-03T16:47:25.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.034+0000 7f13d6e00700 1 --2- 172.21.15.81:0/3921097853 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f13b80b2990 0x7f13b80b4e50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:25.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.034+0000 7f13d6e00700 1 --2- 172.21.15.81:0/3921097853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13d01055d0 0x7f13d01a17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:25.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.034+0000 7f13d6e00700 1 --2- 172.21.15.81:0/3921097853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13d010b660 0x7f13d019b9b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:25.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.034+0000 7f13d6e00700 1 --2- 172.21.15.81:0/3921097853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13d0105f90 0x7f13d01a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:25.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.034+0000 7f13d6e00700 1 -- 172.21.15.81:0/3921097853 >> 172.21.15.81:0/3921097853 conn(0x7f13d01010c0 msgr2=0x7f13d0102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:25.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.034+0000 7f13d6e00700 1 -- 172.21.15.81:0/3921097853 shutdown_connections 2024-05-03T16:47:25.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.034+0000 7f13d6e00700 1 -- 172.21.15.81:0/3921097853 wait complete. 2024-05-03T16:47:25.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.239+0000 7fdee4200700 1 -- 172.21.15.81:0/2345976834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdedc1056c0 msgr2=0x7fdedc105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:25.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.239+0000 7fdee4200700 1 --2- 172.21.15.81:0/2345976834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdedc1056c0 0x7fdedc105b40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdec8009990 tx=0x7fdec8009ca0 comp rx=0 tx=0).stop 2024-05-03T16:47:25.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.239+0000 7fdee4200700 1 -- 172.21.15.81:0/2345976834 shutdown_connections 2024-05-03T16:47:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.239+0000 7fdee4200700 1 --2- 172.21.15.81:0/2345976834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdedc106080 0x7fdedc112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.239+0000 7fdee4200700 1 --2- 172.21.15.81:0/2345976834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdedc10b6c0 0x7fdedc10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.240+0000 7fdee4200700 1 --2- 172.21.15.81:0/2345976834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdedc1056c0 0x7fdedc105b40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.240+0000 7fdee4200700 1 -- 172.21.15.81:0/2345976834 >> 172.21.15.81:0/2345976834 conn(0x7fdedc1011b0 msgr2=0x7fdedc1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.240+0000 7fdee4200700 1 -- 172.21.15.81:0/2345976834 shutdown_connections 2024-05-03T16:47:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.240+0000 7fdee4200700 1 -- 172.21.15.81:0/2345976834 wait complete. 2024-05-03T16:47:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.241+0000 7fdee4200700 1 Processor -- start 2024-05-03T16:47:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.241+0000 7fdee4200700 1 -- start start 2024-05-03T16:47:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.241+0000 7fdee4200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdedc1056c0 0x7fdedc1a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.241+0000 7fdee4200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdedc106080 0x7fdedc1a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.241+0000 7fdee4200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdedc10b6c0 0x7fdedc19baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.241+0000 7fdee4200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc115800 con 0x7fdedc106080 2024-05-03T16:47:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.241+0000 7fdee4200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc115680 con 0x7fdedc10b6c0 2024-05-03T16:47:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.241+0000 7fdee4200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc115980 con 0x7fdedc1056c0 2024-05-03T16:47:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.242+0000 7fdee0e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdedc106080 0x7fdedc1a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.242+0000 7fdee0e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdedc106080 0x7fdedc1a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35304/0 (socket says 172.21.15.81:35304) 2024-05-03T16:47:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.242+0000 7fdee0e00700 1 -- 172.21.15.81:0/3340313602 learned_addr learned my addr 172.21.15.81:0/3340313602 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.242+0000 7fdee1800700 1 --2- 172.21.15.81:0/3340313602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdedc1056c0 0x7fdedc1a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.242+0000 7fdee2200700 1 --2- 172.21.15.81:0/3340313602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdedc10b6c0 0x7fdedc19baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.242+0000 7fdee0e00700 1 -- 172.21.15.81:0/3340313602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdedc1056c0 msgr2=0x7fdedc1a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.242+0000 7fdee0e00700 1 --2- 172.21.15.81:0/3340313602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdedc1056c0 0x7fdedc1a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.242+0000 7fdee0e00700 1 -- 172.21.15.81:0/3340313602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdedc10b6c0 msgr2=0x7fdedc19baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.242+0000 7fdee0e00700 1 --2- 172.21.15.81:0/3340313602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdedc10b6c0 0x7fdedc19baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.242+0000 7fdee0e00700 1 -- 172.21.15.81:0/3340313602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdedc19c200 con 0x7fdedc106080 2024-05-03T16:47:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.242+0000 7fdee0e00700 1 --2- 172.21.15.81:0/3340313602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdedc106080 0x7fdedc1a1e20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdec8000c00 tx=0x7fdec80036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.243+0000 7fdeda000700 1 -- 172.21.15.81:0/3340313602 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8027070 con 0x7fdedc106080 2024-05-03T16:47:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.243+0000 7fdeda000700 1 -- 172.21.15.81:0/3340313602 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdec800fc80 con 0x7fdedc106080 2024-05-03T16:47:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.243+0000 7fdee4200700 1 -- 172.21.15.81:0/3340313602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdedc19c490 con 0x7fdedc106080 2024-05-03T16:47:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.243+0000 7fdeda000700 1 -- 172.21.15.81:0/3340313602 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8022d60 con 0x7fdedc106080 2024-05-03T16:47:25.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.243+0000 7fdee4200700 1 -- 172.21.15.81:0/3340313602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdedc1a87b0 con 0x7fdedc106080 2024-05-03T16:47:25.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.244+0000 7fdee4200700 1 -- 172.21.15.81:0/3340313602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdedc06a190 con 0x7fdedc106080 2024-05-03T16:47:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.248+0000 7fdeda000700 1 -- 172.21.15.81:0/3340313602 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fdec802a070 con 0x7fdedc106080 2024-05-03T16:47:25.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.250+0000 7fdeda000700 1 --2- 172.21.15.81:0/3340313602 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fdec40b2990 0x7fdec40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:25.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.250+0000 7fdeda000700 1 -- 172.21.15.81:0/3340313602 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fdec80e3830 con 0x7fdedc106080 2024-05-03T16:47:25.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.250+0000 7fdee1800700 1 --2- 172.21.15.81:0/3340313602 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fdec40b2990 0x7fdec40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:25.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.251+0000 7fdee1800700 1 --2- 172.21.15.81:0/3340313602 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fdec40b2990 0x7fdec40b4e50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fded0005fd0 tx=0x7fded0005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:25.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.253+0000 7fdeda000700 1 -- 172.21.15.81:0/3340313602 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fdec8031080 con 0x7fdedc106080 2024-05-03T16:47:25.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.508+0000 7fdee4200700 1 -- 172.21.15.81:0/3340313602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fdedc02e510 con 0x7fdedc106080 2024-05-03T16:47:25.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.509+0000 7fdeda000700 1 -- 172.21.15.81:0/3340313602 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdec8013070 con 0x7fdedc106080 2024-05-03T16:47:25.511 INFO:teuthology.orchestra.run.smithi081.stdout:34359738506 2024-05-03T16:47:25.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.512+0000 7fdee4200700 1 -- 172.21.15.81:0/3340313602 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fdec40b2990 msgr2=0x7fdec40b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:25.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.512+0000 7fdee4200700 1 --2- 172.21.15.81:0/3340313602 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fdec40b2990 0x7fdec40b4e50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fded0005fd0 tx=0x7fded0005db0 comp rx=0 tx=0).stop 2024-05-03T16:47:25.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.512+0000 7fdee4200700 1 -- 172.21.15.81:0/3340313602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdedc106080 msgr2=0x7fdedc1a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:25.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.512+0000 7fdee4200700 1 --2- 172.21.15.81:0/3340313602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdedc106080 0x7fdedc1a1e20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdec8000c00 tx=0x7fdec80036f0 comp rx=0 tx=0).stop 2024-05-03T16:47:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.512+0000 7fdee4200700 1 -- 172.21.15.81:0/3340313602 shutdown_connections 2024-05-03T16:47:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.512+0000 7fdee4200700 1 --2- 172.21.15.81:0/3340313602 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fdec40b2990 0x7fdec40b4e50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.512+0000 7fdee4200700 1 --2- 172.21.15.81:0/3340313602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdedc1056c0 0x7fdedc1a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.512+0000 7fdee4200700 1 --2- 172.21.15.81:0/3340313602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdedc10b6c0 0x7fdedc19baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.512+0000 7fdee4200700 1 --2- 172.21.15.81:0/3340313602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdedc106080 0x7fdedc1a1e20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.512+0000 7fdee4200700 1 -- 172.21.15.81:0/3340313602 >> 172.21.15.81:0/3340313602 conn(0x7fdedc1011b0 msgr2=0x7fdedc101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.513+0000 7fdee4200700 1 -- 172.21.15.81:0/3340313602 shutdown_connections 2024-05-03T16:47:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:25.513+0000 7fdee4200700 1 -- 172.21.15.81:0/3340313602 wait complete. 2024-05-03T16:47:25.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:25 smithi146 ceph-mon[32357]: pgmap v481: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:25.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:25 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3921097853' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-03T16:47:25.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:25 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3340313602' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-03T16:47:25.952 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:25 smithi081 ceph-mon[28640]: pgmap v481: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:25.952 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:25 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3921097853' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-03T16:47:25.952 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:25 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3340313602' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-03T16:47:25.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:25 smithi134 ceph-mon[31708]: pgmap v481: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:25.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:25 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3921097853' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-03T16:47:25.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:25 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3340313602' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-03T16:47:26.319 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953576 got 137438953582 for osd.4 2024-05-03T16:47:26.319 DEBUG:teuthology.parallel:result is None 2024-05-03T16:47:26.865 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738500 got 34359738506 for osd.0 2024-05-03T16:47:26.865 DEBUG:teuthology.parallel:result is None 2024-05-03T16:47:26.865 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-03T16:47:26.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-03T16:47:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:47:27.716 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:27 smithi081 ceph-mon[28640]: pgmap v482: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:47:27.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:27 smithi146 ceph-mon[32357]: pgmap v482: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:47:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:27 smithi134 ceph-mon[31708]: pgmap v482: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:47:29.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.608+0000 7f083d200700 1 -- 172.21.15.81:0/23478548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f083810fb60 msgr2=0x7f083810ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:29.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.608+0000 7f083d200700 1 --2- 172.21.15.81:0/23478548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f083810fb60 0x7f083810ff40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0828009990 tx=0x7f0828009ca0 comp rx=0 tx=0).stop 2024-05-03T16:47:29.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.608+0000 7f083d200700 1 -- 172.21.15.81:0/23478548 shutdown_connections 2024-05-03T16:47:29.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.608+0000 7f083d200700 1 --2- 172.21.15.81:0/23478548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f083810a490 0x7f08381169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:29.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.608+0000 7f083d200700 1 --2- 172.21.15.81:0/23478548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f083810fb60 0x7f083810ff40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:29.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.608+0000 7f083d200700 1 --2- 172.21.15.81:0/23478548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0838109ad0 0x7f0838109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:29.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.608+0000 7f083d200700 1 -- 172.21.15.81:0/23478548 >> 172.21.15.81:0/23478548 conn(0x7f0838076c70 msgr2=0x7f08381082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:29.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.609+0000 7f083d200700 1 -- 172.21.15.81:0/23478548 shutdown_connections 2024-05-03T16:47:29.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.609+0000 7f083d200700 1 -- 172.21.15.81:0/23478548 wait complete. 2024-05-03T16:47:29.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.610+0000 7f083d200700 1 Processor -- start 2024-05-03T16:47:29.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.610+0000 7f083d200700 1 -- start start 2024-05-03T16:47:29.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.611+0000 7f083d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0838109ad0 0x7f08381a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:29.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.611+0000 7f083d200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f083810a490 0x7f08381a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:29.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.611+0000 7f083d200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f083810fb60 0x7f08381a4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:29.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.611+0000 7f083d200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0838119bd0 con 0x7f0838109ad0 2024-05-03T16:47:29.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.611+0000 7f083d200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0838119a50 con 0x7f083810a490 2024-05-03T16:47:29.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.611+0000 7f083d200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0838119d50 con 0x7f083810fb60 2024-05-03T16:47:29.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.611+0000 7f0835e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0838109ad0 0x7f08381a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:29.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.611+0000 7f0835e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0838109ad0 0x7f08381a00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40940/0 (socket says 172.21.15.81:40940) 2024-05-03T16:47:29.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.611+0000 7f0835e00700 1 -- 172.21.15.81:0/580160599 learned_addr learned my addr 172.21.15.81:0/580160599 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:29.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.611+0000 7f0835400700 1 --2- 172.21.15.81:0/580160599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f083810a490 0x7f08381a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:29.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.611+0000 7f0836800700 1 --2- 172.21.15.81:0/580160599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f083810fb60 0x7f08381a4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:29.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.611+0000 7f0835e00700 1 -- 172.21.15.81:0/580160599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f083810fb60 msgr2=0x7f08381a4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.611+0000 7f0835e00700 1 --2- 172.21.15.81:0/580160599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f083810fb60 0x7f08381a4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.611+0000 7f0835e00700 1 -- 172.21.15.81:0/580160599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f083810a490 msgr2=0x7f08381a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.611+0000 7f0835e00700 1 --2- 172.21.15.81:0/580160599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f083810a490 0x7f08381a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.611+0000 7f0835e00700 1 -- 172.21.15.81:0/580160599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08381a50b0 con 0x7f0838109ad0 2024-05-03T16:47:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.612+0000 7f0835e00700 1 --2- 172.21.15.81:0/580160599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0838109ad0 0x7f08381a00a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f082800b650 tx=0x7f082800bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.612+0000 7f082ea00700 1 -- 172.21.15.81:0/580160599 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828027070 con 0x7f0838109ad0 2024-05-03T16:47:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.612+0000 7f082ea00700 1 -- 172.21.15.81:0/580160599 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0828022470 con 0x7f0838109ad0 2024-05-03T16:47:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.612+0000 7f083d200700 1 -- 172.21.15.81:0/580160599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08381a5340 con 0x7f0838109ad0 2024-05-03T16:47:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.612+0000 7f082ea00700 1 -- 172.21.15.81:0/580160599 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828017650 con 0x7f0838109ad0 2024-05-03T16:47:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.612+0000 7f083d200700 1 -- 172.21.15.81:0/580160599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08381acc20 con 0x7f0838109ad0 2024-05-03T16:47:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.613+0000 7f083d200700 1 -- 172.21.15.81:0/580160599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f083806a190 con 0x7f0838109ad0 2024-05-03T16:47:29.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.616+0000 7f082ea00700 1 -- 172.21.15.81:0/580160599 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0828009d10 con 0x7f0838109ad0 2024-05-03T16:47:29.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.618+0000 7f082ea00700 1 --2- 172.21.15.81:0/580160599 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f081c0b2910 0x7f081c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:29.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.618+0000 7f082ea00700 1 -- 172.21.15.81:0/580160599 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f08280e36e0 con 0x7f0838109ad0 2024-05-03T16:47:29.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.618+0000 7f0835400700 1 --2- 172.21.15.81:0/580160599 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f081c0b2910 0x7f081c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:29.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.619+0000 7f0835400700 1 --2- 172.21.15.81:0/580160599 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f081c0b2910 0x7f081c0b4dd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0838078bd0 tx=0x7f0824009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:29.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.620+0000 7f082ea00700 1 -- 172.21.15.81:0/580160599 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0828030080 con 0x7f0838109ad0 2024-05-03T16:47:29.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:29 smithi081 ceph-mon[28640]: pgmap v483: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:47:29.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:29 smithi146 ceph-mon[32357]: pgmap v483: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:47:29.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.846+0000 7f083d200700 1 -- 172.21.15.81:0/580160599 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f08381a1400 con 0x7f081c0b2910 2024-05-03T16:47:29.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.877+0000 7f082ea00700 1 -- 172.21.15.81:0/580160599 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340418 (secure 0 0 0) 0x7f08381a1400 con 0x7f081c0b2910 2024-05-03T16:47:29.884 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:47:29.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.884+0000 7f083d200700 1 -- 172.21.15.81:0/580160599 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f081c0b2910 msgr2=0x7f081c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:29.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.884+0000 7f083d200700 1 --2- 172.21.15.81:0/580160599 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f081c0b2910 0x7f081c0b4dd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0838078bd0 tx=0x7f0824009260 comp rx=0 tx=0).stop 2024-05-03T16:47:29.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.884+0000 7f083d200700 1 -- 172.21.15.81:0/580160599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0838109ad0 msgr2=0x7f08381a00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:29.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.884+0000 7f083d200700 1 --2- 172.21.15.81:0/580160599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0838109ad0 0x7f08381a00a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f082800b650 tx=0x7f082800bfc0 comp rx=0 tx=0).stop 2024-05-03T16:47:29.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.884+0000 7f083d200700 1 -- 172.21.15.81:0/580160599 shutdown_connections 2024-05-03T16:47:29.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.884+0000 7f083d200700 1 --2- 172.21.15.81:0/580160599 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f081c0b2910 0x7f081c0b4dd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:29.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.884+0000 7f083d200700 1 --2- 172.21.15.81:0/580160599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f083810fb60 0x7f08381a4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:29.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.884+0000 7f083d200700 1 --2- 172.21.15.81:0/580160599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0838109ad0 0x7f08381a00a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:29.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.884+0000 7f083d200700 1 --2- 172.21.15.81:0/580160599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f083810a490 0x7f08381a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:29.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.884+0000 7f083d200700 1 -- 172.21.15.81:0/580160599 >> 172.21.15.81:0/580160599 conn(0x7f0838076c70 msgr2=0x7f0838077290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:29.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.884+0000 7f083d200700 1 -- 172.21.15.81:0/580160599 shutdown_connections 2024-05-03T16:47:29.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:29.885+0000 7f083d200700 1 -- 172.21.15.81:0/580160599 wait complete. 2024-05-03T16:47:29.889 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-03T16:47:29.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:29 smithi134 ceph-mon[31708]: pgmap v483: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:47:30.775 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":483,"stamp":"2024-05-03T16:47:28.373471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651542,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1300,"num_read_kb":746,"num_write":371,"num_write_kb":2285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952456,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359448,"kb_used_data":14456,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124582376,"statfs":{"total":1151940427776,"available":1151572353024,"internally_reserved":0,"allocated":14802944,"data_stored":8230304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":54,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006047"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.105518+0000","last_change":"2024-05-03T16:43:55.937413+0000","last_active":"2024-05-03T16:45:06.105518+0000","last_peered":"2024-05-03T16:45:06.105518+0000","last_clean":"2024-05-03T16:45:06.105518+0000","last_became_active":"2024-05-03T16:43:55.935792+0000","last_became_peered":"2024-05-03T16:43:55.935792+0000","last_unstale":"2024-05-03T16:45:06.105518+0000","last_undegraded":"2024-05-03T16:45:06.105518+0000","last_fullsized":"2024-05-03T16:45:06.105518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:42:51.277432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170992+0000","last_change":"2024-05-03T16:43:55.950299+0000","last_active":"2024-05-03T16:45:06.170992+0000","last_peered":"2024-05-03T16:45:06.170992+0000","last_clean":"2024-05-03T16:45:06.170992+0000","last_became_active":"2024-05-03T16:43:55.948163+0000","last_became_peered":"2024-05-03T16:43:55.948163+0000","last_unstale":"2024-05-03T16:45:06.170992+0000","last_undegraded":"2024-05-03T16:45:06.170992+0000","last_fullsized":"2024-05-03T16:45:06.170992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:39:33.225914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169889+0000","last_change":"2024-05-03T16:43:55.942136+0000","last_active":"2024-05-03T16:45:06.169889+0000","last_peered":"2024-05-03T16:45:06.169889+0000","last_clean":"2024-05-03T16:45:06.169889+0000","last_became_active":"2024-05-03T16:43:55.941402+0000","last_became_peered":"2024-05-03T16:43:55.941402+0000","last_unstale":"2024-05-03T16:45:06.169889+0000","last_undegraded":"2024-05-03T16:45:06.169889+0000","last_fullsized":"2024-05-03T16:45:06.169889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:50:19.328978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.108202+0000","last_change":"2024-05-03T16:43:55.940573+0000","last_active":"2024-05-03T16:45:06.108202+0000","last_peered":"2024-05-03T16:45:06.108202+0000","last_clean":"2024-05-03T16:45:06.108202+0000","last_became_active":"2024-05-03T16:43:55.939406+0000","last_became_peered":"2024-05-03T16:43:55.939406+0000","last_unstale":"2024-05-03T16:45:06.108202+0000","last_undegraded":"2024-05-03T16:45:06.108202+0000","last_fullsized":"2024-05-03T16:45:06.108202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:29:35.290602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.108797+0000","last_change":"2024-05-03T16:43:55.937068+0000","last_active":"2024-05-03T16:45:06.108797+0000","last_peered":"2024-05-03T16:45:06.108797+0000","last_clean":"2024-05-03T16:45:06.108797+0000","last_became_active":"2024-05-03T16:43:55.934858+0000","last_became_peered":"2024-05-03T16:43:55.934858+0000","last_unstale":"2024-05-03T16:45:06.108797+0000","last_undegraded":"2024-05-03T16:45:06.108797+0000","last_fullsized":"2024-05-03T16:45:06.108797+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:50:41.839587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.105135+0000","last_change":"2024-05-03T16:43:55.936367+0000","last_active":"2024-05-03T16:45:06.105135+0000","last_peered":"2024-05-03T16:45:06.105135+0000","last_clean":"2024-05-03T16:45:06.105135+0000","last_became_active":"2024-05-03T16:43:55.936045+0000","last_became_peered":"2024-05-03T16:43:55.936045+0000","last_unstale":"2024-05-03T16:45:06.105135+0000","last_undegraded":"2024-05-03T16:45:06.105135+0000","last_fullsized":"2024-05-03T16:45:06.105135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:34.718036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170015+0000","last_change":"2024-05-03T16:43:55.947918+0000","last_active":"2024-05-03T16:45:06.170015+0000","last_peered":"2024-05-03T16:45:06.170015+0000","last_clean":"2024-05-03T16:45:06.170015+0000","last_became_active":"2024-05-03T16:43:55.947541+0000","last_became_peered":"2024-05-03T16:43:55.947541+0000","last_unstale":"2024-05-03T16:45:06.170015+0000","last_undegraded":"2024-05-03T16:45:06.170015+0000","last_fullsized":"2024-05-03T16:45:06.170015+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:11:53.101483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172865+0000","last_change":"2024-05-03T16:43:55.947104+0000","last_active":"2024-05-03T16:45:06.172865+0000","last_peered":"2024-05-03T16:45:06.172865+0000","last_clean":"2024-05-03T16:45:06.172865+0000","last_became_active":"2024-05-03T16:43:55.946733+0000","last_became_peered":"2024-05-03T16:43:55.946733+0000","last_unstale":"2024-05-03T16:45:06.172865+0000","last_undegraded":"2024-05-03T16:45:06.172865+0000","last_fullsized":"2024-05-03T16:45:06.172865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:00:49.865951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.102034+0000","last_change":"2024-05-03T16:43:55.935238+0000","last_active":"2024-05-03T16:45:06.102034+0000","last_peered":"2024-05-03T16:45:06.102034+0000","last_clean":"2024-05-03T16:45:06.102034+0000","last_became_active":"2024-05-03T16:43:55.934821+0000","last_became_peered":"2024-05-03T16:43:55.934821+0000","last_unstale":"2024-05-03T16:45:06.102034+0000","last_undegraded":"2024-05-03T16:45:06.102034+0000","last_fullsized":"2024-05-03T16:45:06.102034+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:53:00.895000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.106834+0000","last_change":"2024-05-03T16:43:55.940084+0000","last_active":"2024-05-03T16:45:06.106834+0000","last_peered":"2024-05-03T16:45:06.106834+0000","last_clean":"2024-05-03T16:45:06.106834+0000","last_became_active":"2024-05-03T16:43:55.939788+0000","last_became_peered":"2024-05-03T16:43:55.939788+0000","last_unstale":"2024-05-03T16:45:06.106834+0000","last_undegraded":"2024-05-03T16:45:06.106834+0000","last_fullsized":"2024-05-03T16:45:06.106834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:05:04.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171461+0000","last_change":"2024-05-03T16:43:55.941343+0000","last_active":"2024-05-03T16:45:06.171461+0000","last_peered":"2024-05-03T16:45:06.171461+0000","last_clean":"2024-05-03T16:45:06.171461+0000","last_became_active":"2024-05-03T16:43:55.940187+0000","last_became_peered":"2024-05-03T16:43:55.940187+0000","last_unstale":"2024-05-03T16:45:06.171461+0000","last_undegraded":"2024-05-03T16:45:06.171461+0000","last_fullsized":"2024-05-03T16:45:06.171461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:56:32.974369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.098416+0000","last_change":"2024-05-03T16:44:06.018850+0000","last_active":"2024-05-03T16:45:06.098416+0000","last_peered":"2024-05-03T16:45:06.098416+0000","last_clean":"2024-05-03T16:45:06.098416+0000","last_became_active":"2024-05-03T16:44:06.018311+0000","last_became_peered":"2024-05-03T16:44:06.018311+0000","last_unstale":"2024-05-03T16:45:06.098416+0000","last_undegraded":"2024-05-03T16:45:06.098416+0000","last_fullsized":"2024-05-03T16:45:06.098416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:02:09.949030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.174063+0000","last_change":"2024-05-03T16:43:55.938218+0000","last_active":"2024-05-03T16:45:06.174063+0000","last_peered":"2024-05-03T16:45:06.174063+0000","last_clean":"2024-05-03T16:45:06.174063+0000","last_became_active":"2024-05-03T16:43:55.937559+0000","last_became_peered":"2024-05-03T16:43:55.937559+0000","last_unstale":"2024-05-03T16:45:06.174063+0000","last_undegraded":"2024-05-03T16:45:06.174063+0000","last_fullsized":"2024-05-03T16:45:06.174063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:59:03.766052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171602+0000","last_change":"2024-05-03T16:43:55.950325+0000","last_active":"2024-05-03T16:45:06.171602+0000","last_peered":"2024-05-03T16:45:06.171602+0000","last_clean":"2024-05-03T16:45:06.171602+0000","last_became_active":"2024-05-03T16:43:55.948615+0000","last_became_peered":"2024-05-03T16:43:55.948615+0000","last_unstale":"2024-05-03T16:45:06.171602+0000","last_undegraded":"2024-05-03T16:45:06.171602+0000","last_fullsized":"2024-05-03T16:45:06.171602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:53:06.143381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169587+0000","last_change":"2024-05-03T16:44:06.021139+0000","last_active":"2024-05-03T16:45:06.169587+0000","last_peered":"2024-05-03T16:45:06.169587+0000","last_clean":"2024-05-03T16:45:06.169587+0000","last_became_active":"2024-05-03T16:44:06.020348+0000","last_became_peered":"2024-05-03T16:44:06.020348+0000","last_unstale":"2024-05-03T16:45:06.169587+0000","last_undegraded":"2024-05-03T16:45:06.169587+0000","last_fullsized":"2024-05-03T16:45:06.169587+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:59:45.974113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099039+0000","last_change":"2024-05-03T16:43:55.934973+0000","last_active":"2024-05-03T16:45:06.099039+0000","last_peered":"2024-05-03T16:45:06.099039+0000","last_clean":"2024-05-03T16:45:06.099039+0000","last_became_active":"2024-05-03T16:43:55.934650+0000","last_became_peered":"2024-05-03T16:43:55.934650+0000","last_unstale":"2024-05-03T16:45:06.099039+0000","last_undegraded":"2024-05-03T16:45:06.099039+0000","last_fullsized":"2024-05-03T16:45:06.099039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:17:05.164194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.106204+0000","last_change":"2024-05-03T16:43:55.937828+0000","last_active":"2024-05-03T16:45:06.106204+0000","last_peered":"2024-05-03T16:45:06.106204+0000","last_clean":"2024-05-03T16:45:06.106204+0000","last_became_active":"2024-05-03T16:43:55.936380+0000","last_became_peered":"2024-05-03T16:43:55.936380+0000","last_unstale":"2024-05-03T16:45:06.106204+0000","last_undegraded":"2024-05-03T16:45:06.106204+0000","last_fullsized":"2024-05-03T16:45:06.106204+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:23:17.199501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099163+0000","last_change":"2024-05-03T16:43:55.945162+0000","last_active":"2024-05-03T16:45:06.099163+0000","last_peered":"2024-05-03T16:45:06.099163+0000","last_clean":"2024-05-03T16:45:06.099163+0000","last_became_active":"2024-05-03T16:43:55.944210+0000","last_became_peered":"2024-05-03T16:43:55.944210+0000","last_unstale":"2024-05-03T16:45:06.099163+0000","last_undegraded":"2024-05-03T16:45:06.099163+0000","last_fullsized":"2024-05-03T16:45:06.099163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:41:57.674653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.101269+0000","last_change":"2024-05-03T16:43:55.939350+0000","last_active":"2024-05-03T16:45:06.101269+0000","last_peered":"2024-05-03T16:45:06.101269+0000","last_clean":"2024-05-03T16:45:06.101269+0000","last_became_active":"2024-05-03T16:43:55.936920+0000","last_became_peered":"2024-05-03T16:43:55.936920+0000","last_unstale":"2024-05-03T16:45:06.101269+0000","last_undegraded":"2024-05-03T16:45:06.101269+0000","last_fullsized":"2024-05-03T16:45:06.101269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:06:00.716153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099386+0000","last_change":"2024-05-03T16:44:11.090719+0000","last_active":"2024-05-03T16:45:06.099386+0000","last_peered":"2024-05-03T16:45:06.099386+0000","last_clean":"2024-05-03T16:45:06.099386+0000","last_became_active":"2024-05-03T16:44:11.090155+0000","last_became_peered":"2024-05-03T16:44:11.090155+0000","last_unstale":"2024-05-03T16:45:06.099386+0000","last_undegraded":"2024-05-03T16:45:06.099386+0000","last_fullsized":"2024-05-03T16:45:06.099386+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:05:01.406303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'13","reported_seq":191,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:47:25.967379+0000","last_change":"2024-05-03T16:44:06.029215+0000","last_active":"2024-05-03T16:47:25.967379+0000","last_peered":"2024-05-03T16:47:25.967379+0000","last_clean":"2024-05-03T16:47:25.967379+0000","last_became_active":"2024-05-03T16:44:06.013972+0000","last_became_peered":"2024-05-03T16:44:06.013972+0000","last_unstale":"2024-05-03T16:47:25.967379+0000","last_undegraded":"2024-05-03T16:47:25.967379+0000","last_fullsized":"2024-05-03T16:47:25.967379+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:01:58.464781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.100049+0000","last_change":"2024-05-03T16:44:06.023393+0000","last_active":"2024-05-03T16:45:06.100049+0000","last_peered":"2024-05-03T16:45:06.100049+0000","last_clean":"2024-05-03T16:45:06.100049+0000","last_became_active":"2024-05-03T16:44:06.022614+0000","last_became_peered":"2024-05-03T16:44:06.022614+0000","last_unstale":"2024-05-03T16:45:06.100049+0000","last_undegraded":"2024-05-03T16:45:06.100049+0000","last_fullsized":"2024-05-03T16:45:06.100049+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:21:04.946792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.105882+0000","last_change":"2024-05-03T16:44:11.094113+0000","last_active":"2024-05-03T16:45:06.105882+0000","last_peered":"2024-05-03T16:45:06.105882+0000","last_clean":"2024-05-03T16:45:06.105882+0000","last_became_active":"2024-05-03T16:44:11.092499+0000","last_became_peered":"2024-05-03T16:44:11.092499+0000","last_unstale":"2024-05-03T16:45:06.105882+0000","last_undegraded":"2024-05-03T16:45:06.105882+0000","last_fullsized":"2024-05-03T16:45:06.105882+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:00:38.261341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:24.587168+0000","last_change":"2024-05-03T16:43:51.837525+0000","last_active":"2024-05-03T16:45:24.587168+0000","last_peered":"2024-05-03T16:45:24.587168+0000","last_clean":"2024-05-03T16:45:24.587168+0000","last_became_active":"2024-05-03T16:43:51.837056+0000","last_became_peered":"2024-05-03T16:43:51.837056+0000","last_unstale":"2024-05-03T16:45:24.587168+0000","last_undegraded":"2024-05-03T16:45:24.587168+0000","last_fullsized":"2024-05-03T16:45:24.587168+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:34:07.077471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170361+0000","last_change":"2024-05-03T16:43:55.933576+0000","last_active":"2024-05-03T16:45:06.170361+0000","last_peered":"2024-05-03T16:45:06.170361+0000","last_clean":"2024-05-03T16:45:06.170361+0000","last_became_active":"2024-05-03T16:43:55.932711+0000","last_became_peered":"2024-05-03T16:43:55.932711+0000","last_unstale":"2024-05-03T16:45:06.170361+0000","last_undegraded":"2024-05-03T16:45:06.170361+0000","last_fullsized":"2024-05-03T16:45:06.170361+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:35:44.769103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.107104+0000","last_change":"2024-05-03T16:44:11.093379+0000","last_active":"2024-05-03T16:45:06.107104+0000","last_peered":"2024-05-03T16:45:06.107104+0000","last_clean":"2024-05-03T16:45:06.107104+0000","last_became_active":"2024-05-03T16:44:11.091280+0000","last_became_peered":"2024-05-03T16:44:11.091280+0000","last_unstale":"2024-05-03T16:45:06.107104+0000","last_undegraded":"2024-05-03T16:45:06.107104+0000","last_fullsized":"2024-05-03T16:45:06.107104+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:20:11.987590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":58,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.625487+0000","last_change":"2024-05-03T16:43:51.820233+0000","last_active":"2024-05-03T16:45:27.625487+0000","last_peered":"2024-05-03T16:45:27.625487+0000","last_clean":"2024-05-03T16:45:27.625487+0000","last_became_active":"2024-05-03T16:43:51.818823+0000","last_became_peered":"2024-05-03T16:43:51.818823+0000","last_unstale":"2024-05-03T16:45:27.625487+0000","last_undegraded":"2024-05-03T16:45:27.625487+0000","last_fullsized":"2024-05-03T16:45:27.625487+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:48:06.135496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099578+0000","last_change":"2024-05-03T16:43:55.946298+0000","last_active":"2024-05-03T16:45:06.099578+0000","last_peered":"2024-05-03T16:45:06.099578+0000","last_clean":"2024-05-03T16:45:06.099578+0000","last_became_active":"2024-05-03T16:43:55.944228+0000","last_became_peered":"2024-05-03T16:43:55.944228+0000","last_unstale":"2024-05-03T16:45:06.099578+0000","last_undegraded":"2024-05-03T16:45:06.099578+0000","last_fullsized":"2024-05-03T16:45:06.099578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:42:50.437264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.106250+0000","last_change":"2024-05-03T16:44:11.086723+0000","last_active":"2024-05-03T16:45:06.106250+0000","last_peered":"2024-05-03T16:45:06.106250+0000","last_clean":"2024-05-03T16:45:06.106250+0000","last_became_active":"2024-05-03T16:44:11.086189+0000","last_became_peered":"2024-05-03T16:44:11.086189+0000","last_unstale":"2024-05-03T16:45:06.106250+0000","last_undegraded":"2024-05-03T16:45:06.106250+0000","last_fullsized":"2024-05-03T16:45:06.106250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:23:41.292942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.632106+0000","last_change":"2024-05-03T16:43:51.817737+0000","last_active":"2024-05-03T16:45:27.632106+0000","last_peered":"2024-05-03T16:45:27.632106+0000","last_clean":"2024-05-03T16:45:27.632106+0000","last_became_active":"2024-05-03T16:43:51.817191+0000","last_became_peered":"2024-05-03T16:43:51.817191+0000","last_unstale":"2024-05-03T16:45:27.632106+0000","last_undegraded":"2024-05-03T16:45:27.632106+0000","last_fullsized":"2024-05-03T16:45:27.632106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:21:16.875189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.098652+0000","last_change":"2024-05-03T16:44:06.180066+0000","last_active":"2024-05-03T16:45:06.098652+0000","last_peered":"2024-05-03T16:45:06.098652+0000","last_clean":"2024-05-03T16:45:06.098652+0000","last_became_active":"2024-05-03T16:44:06.178981+0000","last_became_peered":"2024-05-03T16:44:06.178981+0000","last_unstale":"2024-05-03T16:45:06.098652+0000","last_undegraded":"2024-05-03T16:45:06.098652+0000","last_fullsized":"2024-05-03T16:45:06.098652+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:18:10.683947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.100676+0000","last_change":"2024-05-03T16:44:11.092472+0000","last_active":"2024-05-03T16:45:06.100676+0000","last_peered":"2024-05-03T16:45:06.100676+0000","last_clean":"2024-05-03T16:45:06.100676+0000","last_became_active":"2024-05-03T16:44:11.091225+0000","last_became_peered":"2024-05-03T16:44:11.091225+0000","last_unstale":"2024-05-03T16:45:06.100676+0000","last_undegraded":"2024-05-03T16:45:06.100676+0000","last_fullsized":"2024-05-03T16:45:06.100676+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:24:09.194801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'5","reported_seq":176,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:47:23.973940+0000","last_change":"2024-05-03T16:44:06.180557+0000","last_active":"2024-05-03T16:47:23.973940+0000","last_peered":"2024-05-03T16:47:23.973940+0000","last_clean":"2024-05-03T16:47:23.973940+0000","last_became_active":"2024-05-03T16:44:06.179612+0000","last_became_peered":"2024-05-03T16:44:06.179612+0000","last_unstale":"2024-05-03T16:47:23.973940+0000","last_undegraded":"2024-05-03T16:47:23.973940+0000","last_fullsized":"2024-05-03T16:47:23.973940+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:39:33.469080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.109456+0000","last_change":"2024-05-03T16:43:55.942416+0000","last_active":"2024-05-03T16:45:06.109456+0000","last_peered":"2024-05-03T16:45:06.109456+0000","last_clean":"2024-05-03T16:45:06.109456+0000","last_became_active":"2024-05-03T16:43:55.942041+0000","last_became_peered":"2024-05-03T16:43:55.942041+0000","last_unstale":"2024-05-03T16:45:06.109456+0000","last_undegraded":"2024-05-03T16:45:06.109456+0000","last_fullsized":"2024-05-03T16:45:06.109456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:40:29.384354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.100115+0000","last_change":"2024-05-03T16:44:11.096209+0000","last_active":"2024-05-03T16:45:06.100115+0000","last_peered":"2024-05-03T16:45:06.100115+0000","last_clean":"2024-05-03T16:45:06.100115+0000","last_became_active":"2024-05-03T16:44:11.095724+0000","last_became_peered":"2024-05-03T16:44:11.095724+0000","last_unstale":"2024-05-03T16:45:06.100115+0000","last_undegraded":"2024-05-03T16:45:06.100115+0000","last_fullsized":"2024-05-03T16:45:06.100115+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:41:30.883988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":58,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:25.606655+0000","last_change":"2024-05-03T16:44:06.021453+0000","last_active":"2024-05-03T16:45:25.606655+0000","last_peered":"2024-05-03T16:45:25.606655+0000","last_clean":"2024-05-03T16:45:25.606655+0000","last_became_active":"2024-05-03T16:44:06.020443+0000","last_became_peered":"2024-05-03T16:44:06.020443+0000","last_unstale":"2024-05-03T16:45:25.606655+0000","last_undegraded":"2024-05-03T16:45:25.606655+0000","last_fullsized":"2024-05-03T16:45:25.606655+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:55:43.435774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171494+0000","last_change":"2024-05-03T16:43:55.938655+0000","last_active":"2024-05-03T16:45:06.171494+0000","last_peered":"2024-05-03T16:45:06.171494+0000","last_clean":"2024-05-03T16:45:06.171494+0000","last_became_active":"2024-05-03T16:43:55.938269+0000","last_became_peered":"2024-05-03T16:43:55.938269+0000","last_unstale":"2024-05-03T16:45:06.171494+0000","last_undegraded":"2024-05-03T16:45:06.171494+0000","last_fullsized":"2024-05-03T16:45:06.171494+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:51:42.550932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104803+0000","last_change":"2024-05-03T16:44:11.096724+0000","last_active":"2024-05-03T16:45:06.104803+0000","last_peered":"2024-05-03T16:45:06.104803+0000","last_clean":"2024-05-03T16:45:06.104803+0000","last_became_active":"2024-05-03T16:44:11.095877+0000","last_became_peered":"2024-05-03T16:44:11.095877+0000","last_unstale":"2024-05-03T16:45:06.104803+0000","last_undegraded":"2024-05-03T16:45:06.104803+0000","last_fullsized":"2024-05-03T16:45:06.104803+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:08:46.696046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.626029+0000","last_change":"2024-05-03T16:43:51.818919+0000","last_active":"2024-05-03T16:45:26.626029+0000","last_peered":"2024-05-03T16:45:26.626029+0000","last_clean":"2024-05-03T16:45:26.626029+0000","last_became_active":"2024-05-03T16:43:51.817574+0000","last_became_peered":"2024-05-03T16:43:51.817574+0000","last_unstale":"2024-05-03T16:45:26.626029+0000","last_undegraded":"2024-05-03T16:45:26.626029+0000","last_fullsized":"2024-05-03T16:45:26.626029+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:18:17.335988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172600+0000","last_change":"2024-05-03T16:43:55.935647+0000","last_active":"2024-05-03T16:45:06.172600+0000","last_peered":"2024-05-03T16:45:06.172600+0000","last_clean":"2024-05-03T16:45:06.172600+0000","last_became_active":"2024-05-03T16:43:55.935266+0000","last_became_peered":"2024-05-03T16:43:55.935266+0000","last_unstale":"2024-05-03T16:45:06.172600+0000","last_undegraded":"2024-05-03T16:45:06.172600+0000","last_fullsized":"2024-05-03T16:45:06.172600+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:51:48.743197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170973+0000","last_change":"2024-05-03T16:44:11.085588+0000","last_active":"2024-05-03T16:45:06.170973+0000","last_peered":"2024-05-03T16:45:06.170973+0000","last_clean":"2024-05-03T16:45:06.170973+0000","last_became_active":"2024-05-03T16:44:11.084993+0000","last_became_peered":"2024-05-03T16:44:11.084993+0000","last_unstale":"2024-05-03T16:45:06.170973+0000","last_undegraded":"2024-05-03T16:45:06.170973+0000","last_fullsized":"2024-05-03T16:45:06.170973+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:50:42.349365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.633449+0000","last_change":"2024-05-03T16:43:51.828689+0000","last_active":"2024-05-03T16:45:27.633449+0000","last_peered":"2024-05-03T16:45:27.633449+0000","last_clean":"2024-05-03T16:45:27.633449+0000","last_became_active":"2024-05-03T16:43:51.828212+0000","last_became_peered":"2024-05-03T16:43:51.828212+0000","last_unstale":"2024-05-03T16:45:27.633449+0000","last_undegraded":"2024-05-03T16:45:27.633449+0000","last_fullsized":"2024-05-03T16:45:27.633449+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:06:18.947792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.097884+0000","last_change":"2024-05-03T16:43:55.945043+0000","last_active":"2024-05-03T16:45:06.097884+0000","last_peered":"2024-05-03T16:45:06.097884+0000","last_clean":"2024-05-03T16:45:06.097884+0000","last_became_active":"2024-05-03T16:43:55.944702+0000","last_became_peered":"2024-05-03T16:43:55.944702+0000","last_unstale":"2024-05-03T16:45:06.097884+0000","last_undegraded":"2024-05-03T16:45:06.097884+0000","last_fullsized":"2024-05-03T16:45:06.097884+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:28:51.434232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172905+0000","last_change":"2024-05-03T16:44:11.080122+0000","last_active":"2024-05-03T16:45:06.172905+0000","last_peered":"2024-05-03T16:45:06.172905+0000","last_clean":"2024-05-03T16:45:06.172905+0000","last_became_active":"2024-05-03T16:44:11.078792+0000","last_became_peered":"2024-05-03T16:44:11.078792+0000","last_unstale":"2024-05-03T16:45:06.172905+0000","last_undegraded":"2024-05-03T16:45:06.172905+0000","last_fullsized":"2024-05-03T16:45:06.172905+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:43:17.828550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'4","reported_seq":287,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:47:25.979195+0000","last_change":"2024-05-03T16:43:51.823536+0000","last_active":"2024-05-03T16:47:25.979195+0000","last_peered":"2024-05-03T16:47:25.979195+0000","last_clean":"2024-05-03T16:47:25.979195+0000","last_became_active":"2024-05-03T16:43:51.823117+0000","last_became_peered":"2024-05-03T16:43:51.823117+0000","last_unstale":"2024-05-03T16:47:25.979195+0000","last_undegraded":"2024-05-03T16:47:25.979195+0000","last_fullsized":"2024-05-03T16:47:25.979195+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:50:19.990133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":238,"num_read_kb":238,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.102180+0000","last_change":"2024-05-03T16:43:55.945941+0000","last_active":"2024-05-03T16:45:06.102180+0000","last_peered":"2024-05-03T16:45:06.102180+0000","last_clean":"2024-05-03T16:45:06.102180+0000","last_became_active":"2024-05-03T16:43:55.945173+0000","last_became_peered":"2024-05-03T16:43:55.945173+0000","last_unstale":"2024-05-03T16:45:06.102180+0000","last_undegraded":"2024-05-03T16:45:06.102180+0000","last_fullsized":"2024-05-03T16:45:06.102180+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:39:22.185454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.097597+0000","last_change":"2024-05-03T16:44:11.090040+0000","last_active":"2024-05-03T16:45:06.097597+0000","last_peered":"2024-05-03T16:45:06.097597+0000","last_clean":"2024-05-03T16:45:06.097597+0000","last_became_active":"2024-05-03T16:44:11.089381+0000","last_became_peered":"2024-05-03T16:44:11.089381+0000","last_unstale":"2024-05-03T16:45:06.097597+0000","last_undegraded":"2024-05-03T16:45:06.097597+0000","last_fullsized":"2024-05-03T16:45:06.097597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:13:05.149205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.623587+0000","last_change":"2024-05-03T16:43:51.828726+0000","last_active":"2024-05-03T16:45:26.623587+0000","last_peered":"2024-05-03T16:45:26.623587+0000","last_clean":"2024-05-03T16:45:26.623587+0000","last_became_active":"2024-05-03T16:43:51.827302+0000","last_became_peered":"2024-05-03T16:43:51.827302+0000","last_unstale":"2024-05-03T16:45:26.623587+0000","last_undegraded":"2024-05-03T16:45:26.623587+0000","last_fullsized":"2024-05-03T16:45:26.623587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:24:03.296019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171205+0000","last_change":"2024-05-03T16:43:55.941142+0000","last_active":"2024-05-03T16:45:06.171205+0000","last_peered":"2024-05-03T16:45:06.171205+0000","last_clean":"2024-05-03T16:45:06.171205+0000","last_became_active":"2024-05-03T16:43:55.940762+0000","last_became_peered":"2024-05-03T16:43:55.940762+0000","last_unstale":"2024-05-03T16:45:06.171205+0000","last_undegraded":"2024-05-03T16:45:06.171205+0000","last_fullsized":"2024-05-03T16:45:06.171205+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:31:38.412076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.107392+0000","last_change":"2024-05-03T16:44:11.091481+0000","last_active":"2024-05-03T16:45:06.107392+0000","last_peered":"2024-05-03T16:45:06.107392+0000","last_clean":"2024-05-03T16:45:06.107392+0000","last_became_active":"2024-05-03T16:44:11.090597+0000","last_became_peered":"2024-05-03T16:44:11.090597+0000","last_unstale":"2024-05-03T16:45:06.107392+0000","last_undegraded":"2024-05-03T16:45:06.107392+0000","last_fullsized":"2024-05-03T16:45:06.107392+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:43:09.390062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.633054+0000","last_change":"2024-05-03T16:43:51.837548+0000","last_active":"2024-05-03T16:45:27.633054+0000","last_peered":"2024-05-03T16:45:27.633054+0000","last_clean":"2024-05-03T16:45:27.633054+0000","last_became_active":"2024-05-03T16:43:51.837021+0000","last_became_peered":"2024-05-03T16:43:51.837021+0000","last_unstale":"2024-05-03T16:45:27.633054+0000","last_undegraded":"2024-05-03T16:45:27.633054+0000","last_fullsized":"2024-05-03T16:45:27.633054+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:26:57.384438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.100233+0000","last_change":"2024-05-03T16:43:55.933759+0000","last_active":"2024-05-03T16:45:06.100233+0000","last_peered":"2024-05-03T16:45:06.100233+0000","last_clean":"2024-05-03T16:45:06.100233+0000","last_became_active":"2024-05-03T16:43:55.933026+0000","last_became_peered":"2024-05-03T16:43:55.933026+0000","last_unstale":"2024-05-03T16:45:06.100233+0000","last_undegraded":"2024-05-03T16:45:06.100233+0000","last_fullsized":"2024-05-03T16:45:06.100233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:28:46.898497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175952+0000","last_change":"2024-05-03T16:45:06.174763+0000","last_active":"2024-05-03T16:45:06.175952+0000","last_peered":"2024-05-03T16:45:06.175952+0000","last_clean":"2024-05-03T16:45:06.175952+0000","last_became_active":"2024-05-03T16:45:06.173268+0000","last_became_peered":"2024-05-03T16:45:06.173268+0000","last_unstale":"2024-05-03T16:45:06.175952+0000","last_undegraded":"2024-05-03T16:45:06.175952+0000","last_fullsized":"2024-05-03T16:45:06.175952+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:42:14.281298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.14","version":"91'33","reported_seq":324,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:47:25.991940+0000","last_change":"2024-05-03T16:43:51.821086+0000","last_active":"2024-05-03T16:47:25.991940+0000","last_peered":"2024-05-03T16:47:25.991940+0000","last_clean":"2024-05-03T16:47:25.991940+0000","last_became_active":"2024-05-03T16:43:51.820371+0000","last_became_peered":"2024-05-03T16:43:51.820371+0000","last_unstale":"2024-05-03T16:47:25.991940+0000","last_undegraded":"2024-05-03T16:47:25.991940+0000","last_fullsized":"2024-05-03T16:47:25.991940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:40:51.807045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54127,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":246,"num_read_kb":176,"num_write":35,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.109367+0000","last_change":"2024-05-03T16:43:55.952946+0000","last_active":"2024-05-03T16:45:06.109367+0000","last_peered":"2024-05-03T16:45:06.109367+0000","last_clean":"2024-05-03T16:45:06.109367+0000","last_became_active":"2024-05-03T16:43:55.952587+0000","last_became_peered":"2024-05-03T16:43:55.952587+0000","last_unstale":"2024-05-03T16:45:06.109367+0000","last_undegraded":"2024-05-03T16:45:06.109367+0000","last_fullsized":"2024-05-03T16:45:06.109367+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:40:24.944554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171388+0000","last_change":"2024-05-03T16:44:11.088771+0000","last_active":"2024-05-03T16:45:06.171388+0000","last_peered":"2024-05-03T16:45:06.171388+0000","last_clean":"2024-05-03T16:45:06.171388+0000","last_became_active":"2024-05-03T16:44:11.088206+0000","last_became_peered":"2024-05-03T16:44:11.088206+0000","last_unstale":"2024-05-03T16:45:06.171388+0000","last_undegraded":"2024-05-03T16:45:06.171388+0000","last_fullsized":"2024-05-03T16:45:06.171388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:20:34.876403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.629866+0000","last_change":"2024-05-03T16:44:06.034148+0000","last_active":"2024-05-03T16:45:27.629866+0000","last_peered":"2024-05-03T16:45:27.629866+0000","last_clean":"2024-05-03T16:45:27.629866+0000","last_became_active":"2024-05-03T16:44:06.019766+0000","last_became_peered":"2024-05-03T16:44:06.019766+0000","last_unstale":"2024-05-03T16:45:27.629866+0000","last_undegraded":"2024-05-03T16:45:27.629866+0000","last_fullsized":"2024-05-03T16:45:27.629866+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:05:37.507361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172698+0000","last_change":"2024-05-03T16:43:55.935799+0000","last_active":"2024-05-03T16:45:06.172698+0000","last_peered":"2024-05-03T16:45:06.172698+0000","last_clean":"2024-05-03T16:45:06.172698+0000","last_became_active":"2024-05-03T16:43:55.935500+0000","last_became_peered":"2024-05-03T16:43:55.935500+0000","last_unstale":"2024-05-03T16:45:06.172698+0000","last_undegraded":"2024-05-03T16:45:06.172698+0000","last_fullsized":"2024-05-03T16:45:06.172698+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:01:42.624823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.181536+0000","last_change":"2024-05-03T16:45:06.180000+0000","last_active":"2024-05-03T16:45:06.181536+0000","last_peered":"2024-05-03T16:45:06.181536+0000","last_clean":"2024-05-03T16:45:06.181536+0000","last_became_active":"2024-05-03T16:45:06.178226+0000","last_became_peered":"2024-05-03T16:45:06.178226+0000","last_unstale":"2024-05-03T16:45:06.181536+0000","last_undegraded":"2024-05-03T16:45:06.181536+0000","last_fullsized":"2024-05-03T16:45:06.181536+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:12:14.524002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.625564+0000","last_change":"2024-05-03T16:43:51.831435+0000","last_active":"2024-05-03T16:45:27.625564+0000","last_peered":"2024-05-03T16:45:27.625564+0000","last_clean":"2024-05-03T16:45:27.625564+0000","last_became_active":"2024-05-03T16:43:51.830857+0000","last_became_peered":"2024-05-03T16:43:51.830857+0000","last_unstale":"2024-05-03T16:45:27.625564+0000","last_undegraded":"2024-05-03T16:45:27.625564+0000","last_fullsized":"2024-05-03T16:45:27.625564+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:32:36.463798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171016+0000","last_change":"2024-05-03T16:43:55.946511+0000","last_active":"2024-05-03T16:45:06.171016+0000","last_peered":"2024-05-03T16:45:06.171016+0000","last_clean":"2024-05-03T16:45:06.171016+0000","last_became_active":"2024-05-03T16:43:55.946206+0000","last_became_peered":"2024-05-03T16:43:55.946206+0000","last_unstale":"2024-05-03T16:45:06.171016+0000","last_undegraded":"2024-05-03T16:45:06.171016+0000","last_fullsized":"2024-05-03T16:45:06.171016+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:08:04.276790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099457+0000","last_change":"2024-05-03T16:44:11.087824+0000","last_active":"2024-05-03T16:45:06.099457+0000","last_peered":"2024-05-03T16:45:06.099457+0000","last_clean":"2024-05-03T16:45:06.099457+0000","last_became_active":"2024-05-03T16:44:11.087408+0000","last_became_peered":"2024-05-03T16:44:11.087408+0000","last_unstale":"2024-05-03T16:45:06.099457+0000","last_undegraded":"2024-05-03T16:45:06.099457+0000","last_fullsized":"2024-05-03T16:45:06.099457+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:18:23.334214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"91'5","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:47:22.964048+0000","last_change":"2024-05-03T16:43:51.824633+0000","last_active":"2024-05-03T16:47:22.964048+0000","last_peered":"2024-05-03T16:47:22.964048+0000","last_clean":"2024-05-03T16:47:22.964048+0000","last_became_active":"2024-05-03T16:43:51.824137+0000","last_became_peered":"2024-05-03T16:43:51.824137+0000","last_unstale":"2024-05-03T16:47:22.964048+0000","last_undegraded":"2024-05-03T16:47:22.964048+0000","last_fullsized":"2024-05-03T16:47:22.964048+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:13:25.975252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169751+0000","last_change":"2024-05-03T16:43:55.948878+0000","last_active":"2024-05-03T16:45:06.169751+0000","last_peered":"2024-05-03T16:45:06.169751+0000","last_clean":"2024-05-03T16:45:06.169751+0000","last_became_active":"2024-05-03T16:43:55.947279+0000","last_became_peered":"2024-05-03T16:43:55.947279+0000","last_unstale":"2024-05-03T16:45:06.169751+0000","last_undegraded":"2024-05-03T16:45:06.169751+0000","last_fullsized":"2024-05-03T16:45:06.169751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:36:46.082725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175169+0000","last_change":"2024-05-03T16:44:11.096329+0000","last_active":"2024-05-03T16:45:06.175169+0000","last_peered":"2024-05-03T16:45:06.175169+0000","last_clean":"2024-05-03T16:45:06.175169+0000","last_became_active":"2024-05-03T16:44:11.091404+0000","last_became_peered":"2024-05-03T16:44:11.091404+0000","last_unstale":"2024-05-03T16:45:06.175169+0000","last_undegraded":"2024-05-03T16:45:06.175169+0000","last_fullsized":"2024-05-03T16:45:06.175169+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:09:12.688840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":63,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.629170+0000","last_change":"2024-05-03T16:43:51.837908+0000","last_active":"2024-05-03T16:45:27.629170+0000","last_peered":"2024-05-03T16:45:27.629170+0000","last_clean":"2024-05-03T16:45:27.629170+0000","last_became_active":"2024-05-03T16:43:51.837334+0000","last_became_peered":"2024-05-03T16:43:51.837334+0000","last_unstale":"2024-05-03T16:45:27.629170+0000","last_undegraded":"2024-05-03T16:45:27.629170+0000","last_fullsized":"2024-05-03T16:45:27.629170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:08:46.480524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171132+0000","last_change":"2024-05-03T16:43:55.933729+0000","last_active":"2024-05-03T16:45:06.171132+0000","last_peered":"2024-05-03T16:45:06.171132+0000","last_clean":"2024-05-03T16:45:06.171132+0000","last_became_active":"2024-05-03T16:43:55.933211+0000","last_became_peered":"2024-05-03T16:43:55.933211+0000","last_unstale":"2024-05-03T16:45:06.171132+0000","last_undegraded":"2024-05-03T16:45:06.171132+0000","last_fullsized":"2024-05-03T16:45:06.171132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:03:38.814029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170099+0000","last_change":"2024-05-03T16:44:11.077832+0000","last_active":"2024-05-03T16:45:06.170099+0000","last_peered":"2024-05-03T16:45:06.170099+0000","last_clean":"2024-05-03T16:45:06.170099+0000","last_became_active":"2024-05-03T16:44:11.076574+0000","last_became_peered":"2024-05-03T16:44:11.076574+0000","last_unstale":"2024-05-03T16:45:06.170099+0000","last_undegraded":"2024-05-03T16:45:06.170099+0000","last_fullsized":"2024-05-03T16:45:06.170099+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:59:35.354254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.629569+0000","last_change":"2024-05-03T16:43:51.818391+0000","last_active":"2024-05-03T16:45:27.629569+0000","last_peered":"2024-05-03T16:45:27.629569+0000","last_clean":"2024-05-03T16:45:27.629569+0000","last_became_active":"2024-05-03T16:43:51.817335+0000","last_became_peered":"2024-05-03T16:43:51.817335+0000","last_unstale":"2024-05-03T16:45:27.629569+0000","last_undegraded":"2024-05-03T16:45:27.629569+0000","last_fullsized":"2024-05-03T16:45:27.629569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:41:16.610501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104273+0000","last_change":"2024-05-03T16:43:55.948170+0000","last_active":"2024-05-03T16:45:06.104273+0000","last_peered":"2024-05-03T16:45:06.104273+0000","last_clean":"2024-05-03T16:45:06.104273+0000","last_became_active":"2024-05-03T16:43:55.947702+0000","last_became_peered":"2024-05-03T16:43:55.947702+0000","last_unstale":"2024-05-03T16:45:06.104273+0000","last_undegraded":"2024-05-03T16:45:06.104273+0000","last_fullsized":"2024-05-03T16:45:06.104273+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:23:27.614466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.109080+0000","last_change":"2024-05-03T16:44:11.110211+0000","last_active":"2024-05-03T16:45:06.109080+0000","last_peered":"2024-05-03T16:45:06.109080+0000","last_clean":"2024-05-03T16:45:06.109080+0000","last_became_active":"2024-05-03T16:44:11.109387+0000","last_became_peered":"2024-05-03T16:44:11.109387+0000","last_unstale":"2024-05-03T16:45:06.109080+0000","last_undegraded":"2024-05-03T16:45:06.109080+0000","last_fullsized":"2024-05-03T16:45:06.109080+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:00:50.609558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:25.605648+0000","last_change":"2024-05-03T16:43:51.837727+0000","last_active":"2024-05-03T16:45:25.605648+0000","last_peered":"2024-05-03T16:45:25.605648+0000","last_clean":"2024-05-03T16:45:25.605648+0000","last_became_active":"2024-05-03T16:43:51.837226+0000","last_became_peered":"2024-05-03T16:43:51.837226+0000","last_unstale":"2024-05-03T16:45:25.605648+0000","last_undegraded":"2024-05-03T16:45:25.605648+0000","last_fullsized":"2024-05-03T16:45:25.605648+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:52:48.913506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.106165+0000","last_change":"2024-05-03T16:43:55.934403+0000","last_active":"2024-05-03T16:45:06.106165+0000","last_peered":"2024-05-03T16:45:06.106165+0000","last_clean":"2024-05-03T16:45:06.106165+0000","last_became_active":"2024-05-03T16:43:55.933997+0000","last_became_peered":"2024-05-03T16:43:55.933997+0000","last_unstale":"2024-05-03T16:45:06.106165+0000","last_undegraded":"2024-05-03T16:45:06.106165+0000","last_fullsized":"2024-05-03T16:45:06.106165+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:44:36.005567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173076+0000","last_change":"2024-05-03T16:44:11.088757+0000","last_active":"2024-05-03T16:45:06.173076+0000","last_peered":"2024-05-03T16:45:06.173076+0000","last_clean":"2024-05-03T16:45:06.173076+0000","last_became_active":"2024-05-03T16:44:11.088208+0000","last_became_peered":"2024-05-03T16:44:11.088208+0000","last_unstale":"2024-05-03T16:45:06.173076+0000","last_undegraded":"2024-05-03T16:45:06.173076+0000","last_fullsized":"2024-05-03T16:45:06.173076+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:28:27.913357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"91'6","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:47:22.960986+0000","last_change":"2024-05-03T16:43:51.831736+0000","last_active":"2024-05-03T16:47:22.960986+0000","last_peered":"2024-05-03T16:47:22.960986+0000","last_clean":"2024-05-03T16:47:22.960986+0000","last_became_active":"2024-05-03T16:43:51.831282+0000","last_became_peered":"2024-05-03T16:43:51.831282+0000","last_unstale":"2024-05-03T16:47:22.960986+0000","last_undegraded":"2024-05-03T16:47:22.960986+0000","last_fullsized":"2024-05-03T16:47:22.960986+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:43:20.924935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104404+0000","last_change":"2024-05-03T16:43:55.939523+0000","last_active":"2024-05-03T16:45:06.104404+0000","last_peered":"2024-05-03T16:45:06.104404+0000","last_clean":"2024-05-03T16:45:06.104404+0000","last_became_active":"2024-05-03T16:43:55.939040+0000","last_became_peered":"2024-05-03T16:43:55.939040+0000","last_unstale":"2024-05-03T16:45:06.104404+0000","last_undegraded":"2024-05-03T16:45:06.104404+0000","last_fullsized":"2024-05-03T16:45:06.104404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:18:10.014846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175338+0000","last_change":"2024-05-03T16:44:11.110879+0000","last_active":"2024-05-03T16:45:06.175338+0000","last_peered":"2024-05-03T16:45:06.175338+0000","last_clean":"2024-05-03T16:45:06.175338+0000","last_became_active":"2024-05-03T16:44:11.109272+0000","last_became_peered":"2024-05-03T16:44:11.109272+0000","last_unstale":"2024-05-03T16:45:06.175338+0000","last_undegraded":"2024-05-03T16:45:06.175338+0000","last_fullsized":"2024-05-03T16:45:06.175338+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:56:06.145740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171964+0000","last_change":"2024-05-03T16:43:55.943555+0000","last_active":"2024-05-03T16:45:06.171964+0000","last_peered":"2024-05-03T16:45:06.171964+0000","last_clean":"2024-05-03T16:45:06.171964+0000","last_became_active":"2024-05-03T16:43:55.943153+0000","last_became_peered":"2024-05-03T16:43:55.943153+0000","last_unstale":"2024-05-03T16:45:06.171964+0000","last_undegraded":"2024-05-03T16:45:06.171964+0000","last_fullsized":"2024-05-03T16:45:06.171964+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:29:01.943626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:47:22.962763+0000","last_change":"2024-05-03T16:43:51.837491+0000","last_active":"2024-05-03T16:47:22.962763+0000","last_peered":"2024-05-03T16:47:22.962763+0000","last_clean":"2024-05-03T16:47:22.962763+0000","last_became_active":"2024-05-03T16:43:51.837008+0000","last_became_peered":"2024-05-03T16:43:51.837008+0000","last_unstale":"2024-05-03T16:47:22.962763+0000","last_undegraded":"2024-05-03T16:47:22.962763+0000","last_fullsized":"2024-05-03T16:47:22.962763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:59:22.075792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:39.549413+0000","last_change":"2024-05-03T16:44:11.091138+0000","last_active":"2024-05-03T16:45:39.549413+0000","last_peered":"2024-05-03T16:45:39.549413+0000","last_clean":"2024-05-03T16:45:39.549413+0000","last_became_active":"2024-05-03T16:44:11.090386+0000","last_became_peered":"2024-05-03T16:44:11.090386+0000","last_unstale":"2024-05-03T16:45:39.549413+0000","last_undegraded":"2024-05-03T16:45:39.549413+0000","last_fullsized":"2024-05-03T16:45:39.549413+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:36:31.201018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173423+0000","last_change":"2024-05-03T16:43:55.945735+0000","last_active":"2024-05-03T16:45:06.173423+0000","last_peered":"2024-05-03T16:45:06.173423+0000","last_clean":"2024-05-03T16:45:06.173423+0000","last_became_active":"2024-05-03T16:43:55.945399+0000","last_became_peered":"2024-05-03T16:43:55.945399+0000","last_unstale":"2024-05-03T16:45:06.173423+0000","last_undegraded":"2024-05-03T16:45:06.173423+0000","last_fullsized":"2024-05-03T16:45:06.173423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:28:59.508011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.629811+0000","last_change":"2024-05-03T16:43:51.826695+0000","last_active":"2024-05-03T16:45:27.629811+0000","last_peered":"2024-05-03T16:45:27.629811+0000","last_clean":"2024-05-03T16:45:27.629811+0000","last_became_active":"2024-05-03T16:43:51.825863+0000","last_became_peered":"2024-05-03T16:43:51.825863+0000","last_unstale":"2024-05-03T16:45:27.629811+0000","last_undegraded":"2024-05-03T16:45:27.629811+0000","last_fullsized":"2024-05-03T16:45:27.629811+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:39:15.068092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":119,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169937+0000","last_change":"2024-05-03T16:41:59.060997+0000","last_active":"2024-05-03T16:45:06.169937+0000","last_peered":"2024-05-03T16:45:06.169937+0000","last_clean":"2024-05-03T16:45:06.169937+0000","last_became_active":"2024-05-03T16:41:59.044854+0000","last_became_peered":"2024-05-03T16:41:59.044854+0000","last_unstale":"2024-05-03T16:45:06.169937+0000","last_undegraded":"2024-05-03T16:45:06.169937+0000","last_fullsized":"2024-05-03T16:45:06.169937+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:37:18.600432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:37:18.600432+0000","last_clean_scrub_stamp":"2024-05-03T16:37:18.600432+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:10:25.167355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171482+0000","last_change":"2024-05-03T16:44:11.110042+0000","last_active":"2024-05-03T16:45:06.171482+0000","last_peered":"2024-05-03T16:45:06.171482+0000","last_clean":"2024-05-03T16:45:06.171482+0000","last_became_active":"2024-05-03T16:44:11.109374+0000","last_became_peered":"2024-05-03T16:44:11.109374+0000","last_unstale":"2024-05-03T16:45:06.171482+0000","last_undegraded":"2024-05-03T16:45:06.171482+0000","last_fullsized":"2024-05-03T16:45:06.171482+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:04:21.562224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171622+0000","last_change":"2024-05-03T16:43:55.936662+0000","last_active":"2024-05-03T16:45:06.171622+0000","last_peered":"2024-05-03T16:45:06.171622+0000","last_clean":"2024-05-03T16:45:06.171622+0000","last_became_active":"2024-05-03T16:43:55.936332+0000","last_became_peered":"2024-05-03T16:43:55.936332+0000","last_unstale":"2024-05-03T16:45:06.171622+0000","last_undegraded":"2024-05-03T16:45:06.171622+0000","last_fullsized":"2024-05-03T16:45:06.171622+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:35:39.571574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.629426+0000","last_change":"2024-05-03T16:44:06.024989+0000","last_active":"2024-05-03T16:45:26.629426+0000","last_peered":"2024-05-03T16:45:26.629426+0000","last_clean":"2024-05-03T16:45:26.629426+0000","last_became_active":"2024-05-03T16:44:06.023623+0000","last_became_peered":"2024-05-03T16:44:06.023623+0000","last_unstale":"2024-05-03T16:45:26.629426+0000","last_undegraded":"2024-05-03T16:45:26.629426+0000","last_fullsized":"2024-05-03T16:45:26.629426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:24:25.516820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.103375+0000","last_change":"2024-05-03T16:44:11.088212+0000","last_active":"2024-05-03T16:45:06.103375+0000","last_peered":"2024-05-03T16:45:06.103375+0000","last_clean":"2024-05-03T16:45:06.103375+0000","last_became_active":"2024-05-03T16:44:11.087737+0000","last_became_peered":"2024-05-03T16:44:11.087737+0000","last_unstale":"2024-05-03T16:45:06.103375+0000","last_undegraded":"2024-05-03T16:45:06.103375+0000","last_fullsized":"2024-05-03T16:45:06.103375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:41:45.422664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.628680+0000","last_change":"2024-05-03T16:43:51.837762+0000","last_active":"2024-05-03T16:45:27.628680+0000","last_peered":"2024-05-03T16:45:27.628680+0000","last_clean":"2024-05-03T16:45:27.628680+0000","last_became_active":"2024-05-03T16:43:51.837310+0000","last_became_peered":"2024-05-03T16:43:51.837310+0000","last_unstale":"2024-05-03T16:45:27.628680+0000","last_undegraded":"2024-05-03T16:45:27.628680+0000","last_fullsized":"2024-05-03T16:45:27.628680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:34:51.983691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173544+0000","last_change":"2024-05-03T16:43:55.937607+0000","last_active":"2024-05-03T16:45:06.173544+0000","last_peered":"2024-05-03T16:45:06.173544+0000","last_clean":"2024-05-03T16:45:06.173544+0000","last_became_active":"2024-05-03T16:43:55.937166+0000","last_became_peered":"2024-05-03T16:43:55.937166+0000","last_unstale":"2024-05-03T16:45:06.173544+0000","last_undegraded":"2024-05-03T16:45:06.173544+0000","last_fullsized":"2024-05-03T16:45:06.173544+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:03:29.121718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172273+0000","last_change":"2024-05-03T16:44:11.109641+0000","last_active":"2024-05-03T16:45:06.172273+0000","last_peered":"2024-05-03T16:45:06.172273+0000","last_clean":"2024-05-03T16:45:06.172273+0000","last_became_active":"2024-05-03T16:44:11.109118+0000","last_became_peered":"2024-05-03T16:44:11.109118+0000","last_unstale":"2024-05-03T16:45:06.172273+0000","last_undegraded":"2024-05-03T16:45:06.172273+0000","last_fullsized":"2024-05-03T16:45:06.172273+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:23:37.879612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'15","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:46:02.663333+0000","last_change":"2024-05-03T16:43:51.816440+0000","last_active":"2024-05-03T16:46:02.663333+0000","last_peered":"2024-05-03T16:46:02.663333+0000","last_clean":"2024-05-03T16:46:02.663333+0000","last_became_active":"2024-05-03T16:43:51.815952+0000","last_became_peered":"2024-05-03T16:43:51.815952+0000","last_unstale":"2024-05-03T16:46:02.663333+0000","last_undegraded":"2024-05-03T16:46:02.663333+0000","last_fullsized":"2024-05-03T16:46:02.663333+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:10:51.461550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175550+0000","last_change":"2024-05-03T16:43:55.952685+0000","last_active":"2024-05-03T16:45:06.175550+0000","last_peered":"2024-05-03T16:45:06.175550+0000","last_clean":"2024-05-03T16:45:06.175550+0000","last_became_active":"2024-05-03T16:43:55.952199+0000","last_became_peered":"2024-05-03T16:43:55.952199+0000","last_unstale":"2024-05-03T16:45:06.175550+0000","last_undegraded":"2024-05-03T16:45:06.175550+0000","last_fullsized":"2024-05-03T16:45:06.175550+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:26:01.716190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.098539+0000","last_change":"2024-05-03T16:44:11.084880+0000","last_active":"2024-05-03T16:45:06.098539+0000","last_peered":"2024-05-03T16:45:06.098539+0000","last_clean":"2024-05-03T16:45:06.098539+0000","last_became_active":"2024-05-03T16:44:11.084334+0000","last_became_peered":"2024-05-03T16:44:11.084334+0000","last_unstale":"2024-05-03T16:45:06.098539+0000","last_undegraded":"2024-05-03T16:45:06.098539+0000","last_fullsized":"2024-05-03T16:45:06.098539+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:38:01.884575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.626312+0000","last_change":"2024-05-03T16:43:51.824420+0000","last_active":"2024-05-03T16:45:27.626312+0000","last_peered":"2024-05-03T16:45:27.626312+0000","last_clean":"2024-05-03T16:45:27.626312+0000","last_became_active":"2024-05-03T16:43:51.820522+0000","last_became_peered":"2024-05-03T16:43:51.820522+0000","last_unstale":"2024-05-03T16:45:27.626312+0000","last_undegraded":"2024-05-03T16:45:27.626312+0000","last_fullsized":"2024-05-03T16:45:27.626312+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:54:29.537068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171293+0000","last_change":"2024-05-03T16:43:55.937107+0000","last_active":"2024-05-03T16:45:06.171293+0000","last_peered":"2024-05-03T16:45:06.171293+0000","last_clean":"2024-05-03T16:45:06.171293+0000","last_became_active":"2024-05-03T16:43:55.936801+0000","last_became_peered":"2024-05-03T16:43:55.936801+0000","last_unstale":"2024-05-03T16:45:06.171293+0000","last_undegraded":"2024-05-03T16:45:06.171293+0000","last_fullsized":"2024-05-03T16:45:06.171293+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:02:45.520881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.115882+0000","last_change":"2024-05-03T16:45:06.114420+0000","last_active":"2024-05-03T16:45:06.115882+0000","last_peered":"2024-05-03T16:45:06.115882+0000","last_clean":"2024-05-03T16:45:06.115882+0000","last_became_active":"2024-05-03T16:45:06.113345+0000","last_became_peered":"2024-05-03T16:45:06.113345+0000","last_unstale":"2024-05-03T16:45:06.115882+0000","last_undegraded":"2024-05-03T16:45:06.115882+0000","last_fullsized":"2024-05-03T16:45:06.115882+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:44:04.899008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:23.579638+0000","last_change":"2024-05-03T16:43:51.836247+0000","last_active":"2024-05-03T16:45:23.579638+0000","last_peered":"2024-05-03T16:45:23.579638+0000","last_clean":"2024-05-03T16:45:23.579638+0000","last_became_active":"2024-05-03T16:43:51.835877+0000","last_became_peered":"2024-05-03T16:43:51.835877+0000","last_unstale":"2024-05-03T16:45:23.579638+0000","last_undegraded":"2024-05-03T16:45:23.579638+0000","last_fullsized":"2024-05-03T16:45:23.579638+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:58:29.774976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.109113+0000","last_change":"2024-05-03T16:43:55.947689+0000","last_active":"2024-05-03T16:45:06.109113+0000","last_peered":"2024-05-03T16:45:06.109113+0000","last_clean":"2024-05-03T16:45:06.109113+0000","last_became_active":"2024-05-03T16:43:55.947228+0000","last_became_peered":"2024-05-03T16:43:55.947228+0000","last_unstale":"2024-05-03T16:45:06.109113+0000","last_undegraded":"2024-05-03T16:45:06.109113+0000","last_fullsized":"2024-05-03T16:45:06.109113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:09:17.595952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.182759+0000","last_change":"2024-05-03T16:45:06.179884+0000","last_active":"2024-05-03T16:45:06.182759+0000","last_peered":"2024-05-03T16:45:06.182759+0000","last_clean":"2024-05-03T16:45:06.182759+0000","last_became_active":"2024-05-03T16:45:06.178568+0000","last_became_peered":"2024-05-03T16:45:06.178568+0000","last_unstale":"2024-05-03T16:45:06.182759+0000","last_undegraded":"2024-05-03T16:45:06.182759+0000","last_fullsized":"2024-05-03T16:45:06.182759+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:10:00.693492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.623942+0000","last_change":"2024-05-03T16:43:51.821131+0000","last_active":"2024-05-03T16:45:26.623942+0000","last_peered":"2024-05-03T16:45:26.623942+0000","last_clean":"2024-05-03T16:45:26.623942+0000","last_became_active":"2024-05-03T16:43:51.817423+0000","last_became_peered":"2024-05-03T16:43:51.817423+0000","last_unstale":"2024-05-03T16:45:26.623942+0000","last_undegraded":"2024-05-03T16:45:26.623942+0000","last_fullsized":"2024-05-03T16:45:26.623942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:00:34.387262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104080+0000","last_change":"2024-05-03T16:43:55.944671+0000","last_active":"2024-05-03T16:45:06.104080+0000","last_peered":"2024-05-03T16:45:06.104080+0000","last_clean":"2024-05-03T16:45:06.104080+0000","last_became_active":"2024-05-03T16:43:55.943854+0000","last_became_peered":"2024-05-03T16:43:55.943854+0000","last_unstale":"2024-05-03T16:45:06.104080+0000","last_undegraded":"2024-05-03T16:45:06.104080+0000","last_fullsized":"2024-05-03T16:45:06.104080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:57:10.809133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:47.362165+0000","last_change":"2024-05-03T16:44:11.092702+0000","last_active":"2024-05-03T16:45:47.362165+0000","last_peered":"2024-05-03T16:45:47.362165+0000","last_clean":"2024-05-03T16:45:47.362165+0000","last_became_active":"2024-05-03T16:44:11.091351+0000","last_became_peered":"2024-05-03T16:44:11.091351+0000","last_unstale":"2024-05-03T16:45:47.362165+0000","last_undegraded":"2024-05-03T16:45:47.362165+0000","last_fullsized":"2024-05-03T16:45:47.362165+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:06:58.227501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"91'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.590347+0000","last_change":"2024-05-03T16:43:51.822538+0000","last_active":"2024-05-03T16:45:27.590347+0000","last_peered":"2024-05-03T16:45:27.590347+0000","last_clean":"2024-05-03T16:45:27.590347+0000","last_became_active":"2024-05-03T16:43:51.821210+0000","last_became_peered":"2024-05-03T16:43:51.821210+0000","last_unstale":"2024-05-03T16:45:27.590347+0000","last_undegraded":"2024-05-03T16:45:27.590347+0000","last_fullsized":"2024-05-03T16:45:27.590347+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:29:00.377196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.174305+0000","last_change":"2024-05-03T16:43:55.943752+0000","last_active":"2024-05-03T16:45:06.174305+0000","last_peered":"2024-05-03T16:45:06.174305+0000","last_clean":"2024-05-03T16:45:06.174305+0000","last_became_active":"2024-05-03T16:43:55.943406+0000","last_became_peered":"2024-05-03T16:43:55.943406+0000","last_unstale":"2024-05-03T16:45:06.174305+0000","last_undegraded":"2024-05-03T16:45:06.174305+0000","last_fullsized":"2024-05-03T16:45:06.174305+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:47:25.753453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.107762+0000","last_change":"2024-05-03T16:44:11.111510+0000","last_active":"2024-05-03T16:45:06.107762+0000","last_peered":"2024-05-03T16:45:06.107762+0000","last_clean":"2024-05-03T16:45:06.107762+0000","last_became_active":"2024-05-03T16:44:11.110913+0000","last_became_peered":"2024-05-03T16:44:11.110913+0000","last_unstale":"2024-05-03T16:45:06.107762+0000","last_undegraded":"2024-05-03T16:45:06.107762+0000","last_fullsized":"2024-05-03T16:45:06.107762+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:04:43.435364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.629358+0000","last_change":"2024-05-03T16:43:51.819283+0000","last_active":"2024-05-03T16:45:27.629358+0000","last_peered":"2024-05-03T16:45:27.629358+0000","last_clean":"2024-05-03T16:45:27.629358+0000","last_became_active":"2024-05-03T16:43:51.818775+0000","last_became_peered":"2024-05-03T16:43:51.818775+0000","last_unstale":"2024-05-03T16:45:27.629358+0000","last_undegraded":"2024-05-03T16:45:27.629358+0000","last_fullsized":"2024-05-03T16:45:27.629358+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:01:42.363340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170757+0000","last_change":"2024-05-03T16:43:55.946633+0000","last_active":"2024-05-03T16:45:06.170757+0000","last_peered":"2024-05-03T16:45:06.170757+0000","last_clean":"2024-05-03T16:45:06.170757+0000","last_became_active":"2024-05-03T16:43:55.946325+0000","last_became_peered":"2024-05-03T16:43:55.946325+0000","last_unstale":"2024-05-03T16:45:06.170757+0000","last_undegraded":"2024-05-03T16:45:06.170757+0000","last_fullsized":"2024-05-03T16:45:06.170757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:10:54.280667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099767+0000","last_change":"2024-05-03T16:44:11.089589+0000","last_active":"2024-05-03T16:45:06.099767+0000","last_peered":"2024-05-03T16:45:06.099767+0000","last_clean":"2024-05-03T16:45:06.099767+0000","last_became_active":"2024-05-03T16:44:11.088901+0000","last_became_peered":"2024-05-03T16:44:11.088901+0000","last_unstale":"2024-05-03T16:45:06.099767+0000","last_undegraded":"2024-05-03T16:45:06.099767+0000","last_fullsized":"2024-05-03T16:45:06.099767+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:03:07.587439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'5","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:47:25.981559+0000","last_change":"2024-05-03T16:43:51.840062+0000","last_active":"2024-05-03T16:47:25.981559+0000","last_peered":"2024-05-03T16:47:25.981559+0000","last_clean":"2024-05-03T16:47:25.981559+0000","last_became_active":"2024-05-03T16:43:51.839544+0000","last_became_peered":"2024-05-03T16:43:51.839544+0000","last_unstale":"2024-05-03T16:47:25.981559+0000","last_undegraded":"2024-05-03T16:47:25.981559+0000","last_fullsized":"2024-05-03T16:47:25.981559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:37:21.719418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171788+0000","last_change":"2024-05-03T16:43:55.945655+0000","last_active":"2024-05-03T16:45:06.171788+0000","last_peered":"2024-05-03T16:45:06.171788+0000","last_clean":"2024-05-03T16:45:06.171788+0000","last_became_active":"2024-05-03T16:43:55.945263+0000","last_became_peered":"2024-05-03T16:43:55.945263+0000","last_unstale":"2024-05-03T16:45:06.171788+0000","last_undegraded":"2024-05-03T16:45:06.171788+0000","last_fullsized":"2024-05-03T16:45:06.171788+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:33:19.927686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169957+0000","last_change":"2024-05-03T16:44:11.090589+0000","last_active":"2024-05-03T16:45:06.169957+0000","last_peered":"2024-05-03T16:45:06.169957+0000","last_clean":"2024-05-03T16:45:06.169957+0000","last_became_active":"2024-05-03T16:44:11.087981+0000","last_became_peered":"2024-05-03T16:44:11.087981+0000","last_unstale":"2024-05-03T16:45:06.169957+0000","last_undegraded":"2024-05-03T16:45:06.169957+0000","last_fullsized":"2024-05-03T16:45:06.169957+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:43:29.953670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.629118+0000","last_change":"2024-05-03T16:43:51.829334+0000","last_active":"2024-05-03T16:45:27.629118+0000","last_peered":"2024-05-03T16:45:27.629118+0000","last_clean":"2024-05-03T16:45:27.629118+0000","last_became_active":"2024-05-03T16:43:51.828816+0000","last_became_peered":"2024-05-03T16:43:51.828816+0000","last_unstale":"2024-05-03T16:45:27.629118+0000","last_undegraded":"2024-05-03T16:45:27.629118+0000","last_fullsized":"2024-05-03T16:45:27.629118+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:54:31.996256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170567+0000","last_change":"2024-05-03T16:43:55.942732+0000","last_active":"2024-05-03T16:45:06.170567+0000","last_peered":"2024-05-03T16:45:06.170567+0000","last_clean":"2024-05-03T16:45:06.170567+0000","last_became_active":"2024-05-03T16:43:55.941445+0000","last_became_peered":"2024-05-03T16:43:55.941445+0000","last_unstale":"2024-05-03T16:45:06.170567+0000","last_undegraded":"2024-05-03T16:45:06.170567+0000","last_fullsized":"2024-05-03T16:45:06.170567+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:04:58.351184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169556+0000","last_change":"2024-05-03T16:44:11.085542+0000","last_active":"2024-05-03T16:45:06.169556+0000","last_peered":"2024-05-03T16:45:06.169556+0000","last_clean":"2024-05-03T16:45:06.169556+0000","last_became_active":"2024-05-03T16:44:11.082930+0000","last_became_peered":"2024-05-03T16:44:11.082930+0000","last_unstale":"2024-05-03T16:45:06.169556+0000","last_undegraded":"2024-05-03T16:45:06.169556+0000","last_fullsized":"2024-05-03T16:45:06.169556+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T16:44:37.617445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.625804+0000","last_change":"2024-05-03T16:43:51.820087+0000","last_active":"2024-05-03T16:45:26.625804+0000","last_peered":"2024-05-03T16:45:26.625804+0000","last_clean":"2024-05-03T16:45:26.625804+0000","last_became_active":"2024-05-03T16:43:51.819325+0000","last_became_peered":"2024-05-03T16:43:51.819325+0000","last_unstale":"2024-05-03T16:45:26.625804+0000","last_undegraded":"2024-05-03T16:45:26.625804+0000","last_fullsized":"2024-05-03T16:45:26.625804+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:56:38.593149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171882+0000","last_change":"2024-05-03T16:43:55.952515+0000","last_active":"2024-05-03T16:45:06.171882+0000","last_peered":"2024-05-03T16:45:06.171882+0000","last_clean":"2024-05-03T16:45:06.171882+0000","last_became_active":"2024-05-03T16:43:55.951685+0000","last_became_peered":"2024-05-03T16:43:55.951685+0000","last_unstale":"2024-05-03T16:45:06.171882+0000","last_undegraded":"2024-05-03T16:45:06.171882+0000","last_fullsized":"2024-05-03T16:45:06.171882+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:14:03.935407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104956+0000","last_change":"2024-05-03T16:43:55.944993+0000","last_active":"2024-05-03T16:45:06.104956+0000","last_peered":"2024-05-03T16:45:06.104956+0000","last_clean":"2024-05-03T16:45:06.104956+0000","last_became_active":"2024-05-03T16:43:55.944364+0000","last_became_peered":"2024-05-03T16:43:55.944364+0000","last_unstale":"2024-05-03T16:45:06.104956+0000","last_undegraded":"2024-05-03T16:45:06.104956+0000","last_fullsized":"2024-05-03T16:45:06.104956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:35:15.711248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099184+0000","last_change":"2024-05-03T16:43:55.947596+0000","last_active":"2024-05-03T16:45:06.099184+0000","last_peered":"2024-05-03T16:45:06.099184+0000","last_clean":"2024-05-03T16:45:06.099184+0000","last_became_active":"2024-05-03T16:43:55.946217+0000","last_became_peered":"2024-05-03T16:43:55.946217+0000","last_unstale":"2024-05-03T16:45:06.099184+0000","last_undegraded":"2024-05-03T16:45:06.099184+0000","last_fullsized":"2024-05-03T16:45:06.099184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:09:07.005119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.098706+0000","last_change":"2024-05-03T16:43:55.940952+0000","last_active":"2024-05-03T16:45:06.098706+0000","last_peered":"2024-05-03T16:45:06.098706+0000","last_clean":"2024-05-03T16:45:06.098706+0000","last_became_active":"2024-05-03T16:43:55.940110+0000","last_became_peered":"2024-05-03T16:43:55.940110+0000","last_unstale":"2024-05-03T16:45:06.098706+0000","last_undegraded":"2024-05-03T16:45:06.098706+0000","last_fullsized":"2024-05-03T16:45:06.098706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:50:27.229267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170630+0000","last_change":"2024-05-03T16:43:55.936616+0000","last_active":"2024-05-03T16:45:06.170630+0000","last_peered":"2024-05-03T16:45:06.170630+0000","last_clean":"2024-05-03T16:45:06.170630+0000","last_became_active":"2024-05-03T16:43:55.936289+0000","last_became_peered":"2024-05-03T16:43:55.936289+0000","last_unstale":"2024-05-03T16:45:06.170630+0000","last_undegraded":"2024-05-03T16:45:06.170630+0000","last_fullsized":"2024-05-03T16:45:06.170630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:32:41.424346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173825+0000","last_change":"2024-05-03T16:43:55.932302+0000","last_active":"2024-05-03T16:45:06.173825+0000","last_peered":"2024-05-03T16:45:06.173825+0000","last_clean":"2024-05-03T16:45:06.173825+0000","last_became_active":"2024-05-03T16:43:55.931819+0000","last_became_peered":"2024-05-03T16:43:55.931819+0000","last_unstale":"2024-05-03T16:45:06.173825+0000","last_undegraded":"2024-05-03T16:45:06.173825+0000","last_fullsized":"2024-05-03T16:45:06.173825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:25:02.644191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104532+0000","last_change":"2024-05-03T16:43:55.942873+0000","last_active":"2024-05-03T16:45:06.104532+0000","last_peered":"2024-05-03T16:45:06.104532+0000","last_clean":"2024-05-03T16:45:06.104532+0000","last_became_active":"2024-05-03T16:43:55.942546+0000","last_became_peered":"2024-05-03T16:43:55.942546+0000","last_unstale":"2024-05-03T16:45:06.104532+0000","last_undegraded":"2024-05-03T16:45:06.104532+0000","last_fullsized":"2024-05-03T16:45:06.104532+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:24:07.111976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099888+0000","last_change":"2024-05-03T16:43:55.939764+0000","last_active":"2024-05-03T16:45:06.099888+0000","last_peered":"2024-05-03T16:45:06.099888+0000","last_clean":"2024-05-03T16:45:06.099888+0000","last_became_active":"2024-05-03T16:43:55.939362+0000","last_became_peered":"2024-05-03T16:43:55.939362+0000","last_unstale":"2024-05-03T16:45:06.099888+0000","last_undegraded":"2024-05-03T16:45:06.099888+0000","last_fullsized":"2024-05-03T16:45:06.099888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:06:27.624159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175991+0000","last_change":"2024-05-03T16:43:55.935974+0000","last_active":"2024-05-03T16:45:06.175991+0000","last_peered":"2024-05-03T16:45:06.175991+0000","last_clean":"2024-05-03T16:45:06.175991+0000","last_became_active":"2024-05-03T16:43:55.935582+0000","last_became_peered":"2024-05-03T16:43:55.935582+0000","last_unstale":"2024-05-03T16:45:06.175991+0000","last_undegraded":"2024-05-03T16:45:06.175991+0000","last_fullsized":"2024-05-03T16:45:06.175991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:48:18.420037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170153+0000","last_change":"2024-05-03T16:43:55.938992+0000","last_active":"2024-05-03T16:45:06.170153+0000","last_peered":"2024-05-03T16:45:06.170153+0000","last_clean":"2024-05-03T16:45:06.170153+0000","last_became_active":"2024-05-03T16:43:55.938614+0000","last_became_peered":"2024-05-03T16:43:55.938614+0000","last_unstale":"2024-05-03T16:45:06.170153+0000","last_undegraded":"2024-05-03T16:45:06.170153+0000","last_fullsized":"2024-05-03T16:45:06.170153+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:18:44.830231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173472+0000","last_change":"2024-05-03T16:43:55.949381+0000","last_active":"2024-05-03T16:45:06.173472+0000","last_peered":"2024-05-03T16:45:06.173472+0000","last_clean":"2024-05-03T16:45:06.173472+0000","last_became_active":"2024-05-03T16:43:55.948536+0000","last_became_peered":"2024-05-03T16:43:55.948536+0000","last_unstale":"2024-05-03T16:45:06.173472+0000","last_undegraded":"2024-05-03T16:45:06.173472+0000","last_fullsized":"2024-05-03T16:45:06.173472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:27:17.081023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.100234+0000","last_change":"2024-05-03T16:43:55.936682+0000","last_active":"2024-05-03T16:45:06.100234+0000","last_peered":"2024-05-03T16:45:06.100234+0000","last_clean":"2024-05-03T16:45:06.100234+0000","last_became_active":"2024-05-03T16:43:55.936338+0000","last_became_peered":"2024-05-03T16:43:55.936338+0000","last_unstale":"2024-05-03T16:45:06.100234+0000","last_undegraded":"2024-05-03T16:45:06.100234+0000","last_fullsized":"2024-05-03T16:45:06.100234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:15:21.824271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.174318+0000","last_change":"2024-05-03T16:43:55.938357+0000","last_active":"2024-05-03T16:45:06.174318+0000","last_peered":"2024-05-03T16:45:06.174318+0000","last_clean":"2024-05-03T16:45:06.174318+0000","last_became_active":"2024-05-03T16:43:55.938027+0000","last_became_peered":"2024-05-03T16:43:55.938027+0000","last_unstale":"2024-05-03T16:45:06.174318+0000","last_undegraded":"2024-05-03T16:45:06.174318+0000","last_fullsized":"2024-05-03T16:45:06.174318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:03:03.537274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.105331+0000","last_change":"2024-05-03T16:43:55.944296+0000","last_active":"2024-05-03T16:45:06.105331+0000","last_peered":"2024-05-03T16:45:06.105331+0000","last_clean":"2024-05-03T16:45:06.105331+0000","last_became_active":"2024-05-03T16:43:55.943844+0000","last_became_peered":"2024-05-03T16:43:55.943844+0000","last_unstale":"2024-05-03T16:45:06.105331+0000","last_undegraded":"2024-05-03T16:45:06.105331+0000","last_fullsized":"2024-05-03T16:45:06.105331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:50:25.594951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60940,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1224,"num_read_kb":682,"num_write":246,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":616,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":182820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645374,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":525657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841604,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28716,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716436,"statfs":{"total":95995035648,"available":95965630464,"internally_reserved":0,"allocated":1740800,"data_stored":1166532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005133,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32232,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712920,"statfs":{"total":95995035648,"available":95962030080,"internally_reserved":0,"allocated":1081344,"data_stored":529615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201362,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":525225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430299,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28648,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716504,"statfs":{"total":95995035648,"available":95965700096,"internally_reserved":0,"allocated":1671168,"data_stored":1122394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593825,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":521414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574980,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1122304,"data_stored":577193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738507,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":522479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411453,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32268,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712884,"statfs":{"total":95995035648,"available":95961993216,"internally_reserved":0,"allocated":1118208,"data_stored":575710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149813,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1064960,"data_stored":520731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953583,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1069056,"data_stored":525769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790057,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32816,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712336,"statfs":{"total":95995035648,"available":95961432064,"internally_reserved":0,"allocated":1679360,"data_stored":1117585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":56892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":55409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":55863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-03T16:47:30.782 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-03T16:47:30.894 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:30 smithi081 ceph-mon[28640]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T16:47:30.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:30 smithi134 ceph-mon[31708]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T16:47:31.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:30 smithi146 ceph-mon[32357]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T16:47:31.273 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:47:31.913 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:31 smithi081 ceph-mon[28640]: pgmap v484: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:47:31.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:31 smithi134 ceph-mon[31708]: pgmap v484: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:47:32.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:31 smithi146 ceph-mon[32357]: pgmap v484: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:47:33.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.728+0000 7ffb73c00700 1 -- 172.21.15.81:0/468199447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb6c109ad0 msgr2=0x7ffb6c109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:33.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.728+0000 7ffb73c00700 1 --2- 172.21.15.81:0/468199447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb6c109ad0 0x7ffb6c109f50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009990 tx=0x7ffb58009ca0 comp rx=0 tx=0).stop 2024-05-03T16:47:33.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.728+0000 7ffb73c00700 1 -- 172.21.15.81:0/468199447 shutdown_connections 2024-05-03T16:47:33.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.728+0000 7ffb73c00700 1 --2- 172.21.15.81:0/468199447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb6c10fb60 0x7ffb6c10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:33.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.728+0000 7ffb73c00700 1 --2- 172.21.15.81:0/468199447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb6c10a490 0x7ffb6c1169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:33.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.728+0000 7ffb73c00700 1 --2- 172.21.15.81:0/468199447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb6c109ad0 0x7ffb6c109f50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:33.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.728+0000 7ffb73c00700 1 -- 172.21.15.81:0/468199447 >> 172.21.15.81:0/468199447 conn(0x7ffb6c076c70 msgr2=0x7ffb6c1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:33.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.728+0000 7ffb73c00700 1 -- 172.21.15.81:0/468199447 shutdown_connections 2024-05-03T16:47:33.731 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:33 smithi081 ceph-mon[28640]: pgmap v485: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T16:47:33.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.728+0000 7ffb73c00700 1 -- 172.21.15.81:0/468199447 wait complete. 2024-05-03T16:47:33.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.729+0000 7ffb73c00700 1 Processor -- start 2024-05-03T16:47:33.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.729+0000 7ffb73c00700 1 -- start start 2024-05-03T16:47:33.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.730+0000 7ffb73c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb6c109ad0 0x7ffb6c1a0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:33.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.730+0000 7ffb73c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb6c10a490 0x7ffb6c1a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:33.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.730+0000 7ffb73c00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb6c10fb60 0x7ffb6c1a4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.730+0000 7ffb73c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c119b70 con 0x7ffb6c10a490 2024-05-03T16:47:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.730+0000 7ffb73c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c1199f0 con 0x7ffb6c109ad0 2024-05-03T16:47:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.730+0000 7ffb73c00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c119cf0 con 0x7ffb6c10fb60 2024-05-03T16:47:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.730+0000 7ffb6be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb6c10a490 0x7ffb6c1a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.730+0000 7ffb6be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb6c10a490 0x7ffb6c1a05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40954/0 (socket says 172.21.15.81:40954) 2024-05-03T16:47:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.730+0000 7ffb6be00700 1 -- 172.21.15.81:0/1005751316 learned_addr learned my addr 172.21.15.81:0/1005751316 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.730+0000 7ffb71200700 1 --2- 172.21.15.81:0/1005751316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb6c109ad0 0x7ffb6c1a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.730+0000 7ffb71c00700 1 --2- 172.21.15.81:0/1005751316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb6c10fb60 0x7ffb6c1a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.731+0000 7ffb6be00700 1 -- 172.21.15.81:0/1005751316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb6c10fb60 msgr2=0x7ffb6c1a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.731+0000 7ffb6be00700 1 --2- 172.21.15.81:0/1005751316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb6c10fb60 0x7ffb6c1a4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.731+0000 7ffb6be00700 1 -- 172.21.15.81:0/1005751316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb6c109ad0 msgr2=0x7ffb6c1a0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.731+0000 7ffb6be00700 1 --2- 172.21.15.81:0/1005751316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb6c109ad0 0x7ffb6c1a0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.731+0000 7ffb6be00700 1 -- 172.21.15.81:0/1005751316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6c1a5070 con 0x7ffb6c10a490 2024-05-03T16:47:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.731+0000 7ffb6be00700 1 --2- 172.21.15.81:0/1005751316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb6c10a490 0x7ffb6c1a05a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ffb580057c0 tx=0x7ffb58009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:33.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.731+0000 7ffb69600700 1 -- 172.21.15.81:0/1005751316 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58027070 con 0x7ffb6c10a490 2024-05-03T16:47:33.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.731+0000 7ffb69600700 1 -- 172.21.15.81:0/1005751316 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb5800fda0 con 0x7ffb6c10a490 2024-05-03T16:47:33.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.731+0000 7ffb73c00700 1 -- 172.21.15.81:0/1005751316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6c1a5300 con 0x7ffb6c10a490 2024-05-03T16:47:33.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.731+0000 7ffb69600700 1 -- 172.21.15.81:0/1005751316 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58022ca0 con 0x7ffb6c10a490 2024-05-03T16:47:33.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.732+0000 7ffb73c00700 1 -- 172.21.15.81:0/1005751316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb6c1acbe0 con 0x7ffb6c10a490 2024-05-03T16:47:33.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.733+0000 7ffb73c00700 1 -- 172.21.15.81:0/1005751316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb6c06a190 con 0x7ffb6c10a490 2024-05-03T16:47:33.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.735+0000 7ffb69600700 1 -- 172.21.15.81:0/1005751316 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ffb5802a070 con 0x7ffb6c10a490 2024-05-03T16:47:33.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.736+0000 7ffb69600700 1 --2- 172.21.15.81:0/1005751316 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ffb540b2990 0x7ffb540b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:33.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.736+0000 7ffb69600700 1 -- 172.21.15.81:0/1005751316 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7ffb580e35a0 con 0x7ffb6c10a490 2024-05-03T16:47:33.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.736+0000 7ffb71200700 1 --2- 172.21.15.81:0/1005751316 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ffb540b2990 0x7ffb540b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:33.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.737+0000 7ffb71200700 1 --2- 172.21.15.81:0/1005751316 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ffb540b2990 0x7ffb540b4e50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffb60005fd0 tx=0x7ffb60005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:33.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.740+0000 7ffb69600700 1 -- 172.21.15.81:0/1005751316 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ffb58013070 con 0x7ffb6c10a490 2024-05-03T16:47:33.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.953+0000 7ffb73c00700 1 -- 172.21.15.81:0/1005751316 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb6c0638e0 con 0x7ffb540b2990 2024-05-03T16:47:33.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:33 smithi134 ceph-mon[31708]: pgmap v485: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T16:47:33.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.982+0000 7ffb69600700 1 -- 172.21.15.81:0/1005751316 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340418 (secure 0 0 0) 0x7ffb6c0638e0 con 0x7ffb540b2990 2024-05-03T16:47:33.991 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:47:33.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.990+0000 7ffb73c00700 1 -- 172.21.15.81:0/1005751316 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ffb540b2990 msgr2=0x7ffb540b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:33.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.990+0000 7ffb73c00700 1 --2- 172.21.15.81:0/1005751316 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ffb540b2990 0x7ffb540b4e50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffb60005fd0 tx=0x7ffb60005db0 comp rx=0 tx=0).stop 2024-05-03T16:47:33.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.990+0000 7ffb73c00700 1 -- 172.21.15.81:0/1005751316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb6c10a490 msgr2=0x7ffb6c1a05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:33.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.990+0000 7ffb73c00700 1 --2- 172.21.15.81:0/1005751316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb6c10a490 0x7ffb6c1a05a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ffb580057c0 tx=0x7ffb58009f90 comp rx=0 tx=0).stop 2024-05-03T16:47:33.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.990+0000 7ffb73c00700 1 -- 172.21.15.81:0/1005751316 shutdown_connections 2024-05-03T16:47:33.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.990+0000 7ffb73c00700 1 --2- 172.21.15.81:0/1005751316 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ffb540b2990 0x7ffb540b4e50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:33.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.990+0000 7ffb73c00700 1 --2- 172.21.15.81:0/1005751316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb6c10fb60 0x7ffb6c1a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:33.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.990+0000 7ffb73c00700 1 --2- 172.21.15.81:0/1005751316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb6c109ad0 0x7ffb6c1a0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:33.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.990+0000 7ffb73c00700 1 --2- 172.21.15.81:0/1005751316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb6c10a490 0x7ffb6c1a05a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:33.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.990+0000 7ffb73c00700 1 -- 172.21.15.81:0/1005751316 >> 172.21.15.81:0/1005751316 conn(0x7ffb6c076c70 msgr2=0x7ffb6c077290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:33.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.990+0000 7ffb73c00700 1 -- 172.21.15.81:0/1005751316 shutdown_connections 2024-05-03T16:47:33.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:33.991+0000 7ffb73c00700 1 -- 172.21.15.81:0/1005751316 wait complete. 2024-05-03T16:47:33.995 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-03T16:47:34.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:33 smithi146 ceph-mon[32357]: pgmap v485: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T16:47:34.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:34 smithi081 ceph-mon[28640]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T16:47:34.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:34 smithi134 ceph-mon[31708]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T16:47:34.969 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":485,"stamp":"2024-05-03T16:47:32.375389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651542,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1340,"num_read_kb":766,"num_write":371,"num_write_kb":2285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952456,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359448,"kb_used_data":14456,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124582376,"statfs":{"total":1151940427776,"available":1151572353024,"internally_reserved":0,"allocated":14802944,"data_stored":8230304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":64,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006101"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.105518+0000","last_change":"2024-05-03T16:43:55.937413+0000","last_active":"2024-05-03T16:45:06.105518+0000","last_peered":"2024-05-03T16:45:06.105518+0000","last_clean":"2024-05-03T16:45:06.105518+0000","last_became_active":"2024-05-03T16:43:55.935792+0000","last_became_peered":"2024-05-03T16:43:55.935792+0000","last_unstale":"2024-05-03T16:45:06.105518+0000","last_undegraded":"2024-05-03T16:45:06.105518+0000","last_fullsized":"2024-05-03T16:45:06.105518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:42:51.277432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170992+0000","last_change":"2024-05-03T16:43:55.950299+0000","last_active":"2024-05-03T16:45:06.170992+0000","last_peered":"2024-05-03T16:45:06.170992+0000","last_clean":"2024-05-03T16:45:06.170992+0000","last_became_active":"2024-05-03T16:43:55.948163+0000","last_became_peered":"2024-05-03T16:43:55.948163+0000","last_unstale":"2024-05-03T16:45:06.170992+0000","last_undegraded":"2024-05-03T16:45:06.170992+0000","last_fullsized":"2024-05-03T16:45:06.170992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:39:33.225914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169889+0000","last_change":"2024-05-03T16:43:55.942136+0000","last_active":"2024-05-03T16:45:06.169889+0000","last_peered":"2024-05-03T16:45:06.169889+0000","last_clean":"2024-05-03T16:45:06.169889+0000","last_became_active":"2024-05-03T16:43:55.941402+0000","last_became_peered":"2024-05-03T16:43:55.941402+0000","last_unstale":"2024-05-03T16:45:06.169889+0000","last_undegraded":"2024-05-03T16:45:06.169889+0000","last_fullsized":"2024-05-03T16:45:06.169889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:50:19.328978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.108202+0000","last_change":"2024-05-03T16:43:55.940573+0000","last_active":"2024-05-03T16:45:06.108202+0000","last_peered":"2024-05-03T16:45:06.108202+0000","last_clean":"2024-05-03T16:45:06.108202+0000","last_became_active":"2024-05-03T16:43:55.939406+0000","last_became_peered":"2024-05-03T16:43:55.939406+0000","last_unstale":"2024-05-03T16:45:06.108202+0000","last_undegraded":"2024-05-03T16:45:06.108202+0000","last_fullsized":"2024-05-03T16:45:06.108202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:29:35.290602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.108797+0000","last_change":"2024-05-03T16:43:55.937068+0000","last_active":"2024-05-03T16:45:06.108797+0000","last_peered":"2024-05-03T16:45:06.108797+0000","last_clean":"2024-05-03T16:45:06.108797+0000","last_became_active":"2024-05-03T16:43:55.934858+0000","last_became_peered":"2024-05-03T16:43:55.934858+0000","last_unstale":"2024-05-03T16:45:06.108797+0000","last_undegraded":"2024-05-03T16:45:06.108797+0000","last_fullsized":"2024-05-03T16:45:06.108797+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:50:41.839587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.105135+0000","last_change":"2024-05-03T16:43:55.936367+0000","last_active":"2024-05-03T16:45:06.105135+0000","last_peered":"2024-05-03T16:45:06.105135+0000","last_clean":"2024-05-03T16:45:06.105135+0000","last_became_active":"2024-05-03T16:43:55.936045+0000","last_became_peered":"2024-05-03T16:43:55.936045+0000","last_unstale":"2024-05-03T16:45:06.105135+0000","last_undegraded":"2024-05-03T16:45:06.105135+0000","last_fullsized":"2024-05-03T16:45:06.105135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:48:34.718036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170015+0000","last_change":"2024-05-03T16:43:55.947918+0000","last_active":"2024-05-03T16:45:06.170015+0000","last_peered":"2024-05-03T16:45:06.170015+0000","last_clean":"2024-05-03T16:45:06.170015+0000","last_became_active":"2024-05-03T16:43:55.947541+0000","last_became_peered":"2024-05-03T16:43:55.947541+0000","last_unstale":"2024-05-03T16:45:06.170015+0000","last_undegraded":"2024-05-03T16:45:06.170015+0000","last_fullsized":"2024-05-03T16:45:06.170015+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:11:53.101483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172865+0000","last_change":"2024-05-03T16:43:55.947104+0000","last_active":"2024-05-03T16:45:06.172865+0000","last_peered":"2024-05-03T16:45:06.172865+0000","last_clean":"2024-05-03T16:45:06.172865+0000","last_became_active":"2024-05-03T16:43:55.946733+0000","last_became_peered":"2024-05-03T16:43:55.946733+0000","last_unstale":"2024-05-03T16:45:06.172865+0000","last_undegraded":"2024-05-03T16:45:06.172865+0000","last_fullsized":"2024-05-03T16:45:06.172865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:00:49.865951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.102034+0000","last_change":"2024-05-03T16:43:55.935238+0000","last_active":"2024-05-03T16:45:06.102034+0000","last_peered":"2024-05-03T16:45:06.102034+0000","last_clean":"2024-05-03T16:45:06.102034+0000","last_became_active":"2024-05-03T16:43:55.934821+0000","last_became_peered":"2024-05-03T16:43:55.934821+0000","last_unstale":"2024-05-03T16:45:06.102034+0000","last_undegraded":"2024-05-03T16:45:06.102034+0000","last_fullsized":"2024-05-03T16:45:06.102034+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:53:00.895000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.106834+0000","last_change":"2024-05-03T16:43:55.940084+0000","last_active":"2024-05-03T16:45:06.106834+0000","last_peered":"2024-05-03T16:45:06.106834+0000","last_clean":"2024-05-03T16:45:06.106834+0000","last_became_active":"2024-05-03T16:43:55.939788+0000","last_became_peered":"2024-05-03T16:43:55.939788+0000","last_unstale":"2024-05-03T16:45:06.106834+0000","last_undegraded":"2024-05-03T16:45:06.106834+0000","last_fullsized":"2024-05-03T16:45:06.106834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:05:04.407587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171461+0000","last_change":"2024-05-03T16:43:55.941343+0000","last_active":"2024-05-03T16:45:06.171461+0000","last_peered":"2024-05-03T16:45:06.171461+0000","last_clean":"2024-05-03T16:45:06.171461+0000","last_became_active":"2024-05-03T16:43:55.940187+0000","last_became_peered":"2024-05-03T16:43:55.940187+0000","last_unstale":"2024-05-03T16:45:06.171461+0000","last_undegraded":"2024-05-03T16:45:06.171461+0000","last_fullsized":"2024-05-03T16:45:06.171461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:56:32.974369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.098416+0000","last_change":"2024-05-03T16:44:06.018850+0000","last_active":"2024-05-03T16:45:06.098416+0000","last_peered":"2024-05-03T16:45:06.098416+0000","last_clean":"2024-05-03T16:45:06.098416+0000","last_became_active":"2024-05-03T16:44:06.018311+0000","last_became_peered":"2024-05-03T16:44:06.018311+0000","last_unstale":"2024-05-03T16:45:06.098416+0000","last_undegraded":"2024-05-03T16:45:06.098416+0000","last_fullsized":"2024-05-03T16:45:06.098416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:02:09.949030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.174063+0000","last_change":"2024-05-03T16:43:55.938218+0000","last_active":"2024-05-03T16:45:06.174063+0000","last_peered":"2024-05-03T16:45:06.174063+0000","last_clean":"2024-05-03T16:45:06.174063+0000","last_became_active":"2024-05-03T16:43:55.937559+0000","last_became_peered":"2024-05-03T16:43:55.937559+0000","last_unstale":"2024-05-03T16:45:06.174063+0000","last_undegraded":"2024-05-03T16:45:06.174063+0000","last_fullsized":"2024-05-03T16:45:06.174063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:59:03.766052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171602+0000","last_change":"2024-05-03T16:43:55.950325+0000","last_active":"2024-05-03T16:45:06.171602+0000","last_peered":"2024-05-03T16:45:06.171602+0000","last_clean":"2024-05-03T16:45:06.171602+0000","last_became_active":"2024-05-03T16:43:55.948615+0000","last_became_peered":"2024-05-03T16:43:55.948615+0000","last_unstale":"2024-05-03T16:45:06.171602+0000","last_undegraded":"2024-05-03T16:45:06.171602+0000","last_fullsized":"2024-05-03T16:45:06.171602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:53:06.143381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169587+0000","last_change":"2024-05-03T16:44:06.021139+0000","last_active":"2024-05-03T16:45:06.169587+0000","last_peered":"2024-05-03T16:45:06.169587+0000","last_clean":"2024-05-03T16:45:06.169587+0000","last_became_active":"2024-05-03T16:44:06.020348+0000","last_became_peered":"2024-05-03T16:44:06.020348+0000","last_unstale":"2024-05-03T16:45:06.169587+0000","last_undegraded":"2024-05-03T16:45:06.169587+0000","last_fullsized":"2024-05-03T16:45:06.169587+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:59:45.974113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099039+0000","last_change":"2024-05-03T16:43:55.934973+0000","last_active":"2024-05-03T16:45:06.099039+0000","last_peered":"2024-05-03T16:45:06.099039+0000","last_clean":"2024-05-03T16:45:06.099039+0000","last_became_active":"2024-05-03T16:43:55.934650+0000","last_became_peered":"2024-05-03T16:43:55.934650+0000","last_unstale":"2024-05-03T16:45:06.099039+0000","last_undegraded":"2024-05-03T16:45:06.099039+0000","last_fullsized":"2024-05-03T16:45:06.099039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:17:05.164194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.106204+0000","last_change":"2024-05-03T16:43:55.937828+0000","last_active":"2024-05-03T16:45:06.106204+0000","last_peered":"2024-05-03T16:45:06.106204+0000","last_clean":"2024-05-03T16:45:06.106204+0000","last_became_active":"2024-05-03T16:43:55.936380+0000","last_became_peered":"2024-05-03T16:43:55.936380+0000","last_unstale":"2024-05-03T16:45:06.106204+0000","last_undegraded":"2024-05-03T16:45:06.106204+0000","last_fullsized":"2024-05-03T16:45:06.106204+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:23:17.199501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099163+0000","last_change":"2024-05-03T16:43:55.945162+0000","last_active":"2024-05-03T16:45:06.099163+0000","last_peered":"2024-05-03T16:45:06.099163+0000","last_clean":"2024-05-03T16:45:06.099163+0000","last_became_active":"2024-05-03T16:43:55.944210+0000","last_became_peered":"2024-05-03T16:43:55.944210+0000","last_unstale":"2024-05-03T16:45:06.099163+0000","last_undegraded":"2024-05-03T16:45:06.099163+0000","last_fullsized":"2024-05-03T16:45:06.099163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:41:57.674653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.101269+0000","last_change":"2024-05-03T16:43:55.939350+0000","last_active":"2024-05-03T16:45:06.101269+0000","last_peered":"2024-05-03T16:45:06.101269+0000","last_clean":"2024-05-03T16:45:06.101269+0000","last_became_active":"2024-05-03T16:43:55.936920+0000","last_became_peered":"2024-05-03T16:43:55.936920+0000","last_unstale":"2024-05-03T16:45:06.101269+0000","last_undegraded":"2024-05-03T16:45:06.101269+0000","last_fullsized":"2024-05-03T16:45:06.101269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:06:00.716153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099386+0000","last_change":"2024-05-03T16:44:11.090719+0000","last_active":"2024-05-03T16:45:06.099386+0000","last_peered":"2024-05-03T16:45:06.099386+0000","last_clean":"2024-05-03T16:45:06.099386+0000","last_became_active":"2024-05-03T16:44:11.090155+0000","last_became_peered":"2024-05-03T16:44:11.090155+0000","last_unstale":"2024-05-03T16:45:06.099386+0000","last_undegraded":"2024-05-03T16:45:06.099386+0000","last_fullsized":"2024-05-03T16:45:06.099386+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:05:01.406303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'13","reported_seq":191,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:47:25.967379+0000","last_change":"2024-05-03T16:44:06.029215+0000","last_active":"2024-05-03T16:47:25.967379+0000","last_peered":"2024-05-03T16:47:25.967379+0000","last_clean":"2024-05-03T16:47:25.967379+0000","last_became_active":"2024-05-03T16:44:06.013972+0000","last_became_peered":"2024-05-03T16:44:06.013972+0000","last_unstale":"2024-05-03T16:47:25.967379+0000","last_undegraded":"2024-05-03T16:47:25.967379+0000","last_fullsized":"2024-05-03T16:47:25.967379+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:01:58.464781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.100049+0000","last_change":"2024-05-03T16:44:06.023393+0000","last_active":"2024-05-03T16:45:06.100049+0000","last_peered":"2024-05-03T16:45:06.100049+0000","last_clean":"2024-05-03T16:45:06.100049+0000","last_became_active":"2024-05-03T16:44:06.022614+0000","last_became_peered":"2024-05-03T16:44:06.022614+0000","last_unstale":"2024-05-03T16:45:06.100049+0000","last_undegraded":"2024-05-03T16:45:06.100049+0000","last_fullsized":"2024-05-03T16:45:06.100049+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:21:04.946792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.105882+0000","last_change":"2024-05-03T16:44:11.094113+0000","last_active":"2024-05-03T16:45:06.105882+0000","last_peered":"2024-05-03T16:45:06.105882+0000","last_clean":"2024-05-03T16:45:06.105882+0000","last_became_active":"2024-05-03T16:44:11.092499+0000","last_became_peered":"2024-05-03T16:44:11.092499+0000","last_unstale":"2024-05-03T16:45:06.105882+0000","last_undegraded":"2024-05-03T16:45:06.105882+0000","last_fullsized":"2024-05-03T16:45:06.105882+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:00:38.261341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:24.587168+0000","last_change":"2024-05-03T16:43:51.837525+0000","last_active":"2024-05-03T16:45:24.587168+0000","last_peered":"2024-05-03T16:45:24.587168+0000","last_clean":"2024-05-03T16:45:24.587168+0000","last_became_active":"2024-05-03T16:43:51.837056+0000","last_became_peered":"2024-05-03T16:43:51.837056+0000","last_unstale":"2024-05-03T16:45:24.587168+0000","last_undegraded":"2024-05-03T16:45:24.587168+0000","last_fullsized":"2024-05-03T16:45:24.587168+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:34:07.077471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170361+0000","last_change":"2024-05-03T16:43:55.933576+0000","last_active":"2024-05-03T16:45:06.170361+0000","last_peered":"2024-05-03T16:45:06.170361+0000","last_clean":"2024-05-03T16:45:06.170361+0000","last_became_active":"2024-05-03T16:43:55.932711+0000","last_became_peered":"2024-05-03T16:43:55.932711+0000","last_unstale":"2024-05-03T16:45:06.170361+0000","last_undegraded":"2024-05-03T16:45:06.170361+0000","last_fullsized":"2024-05-03T16:45:06.170361+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:35:44.769103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.107104+0000","last_change":"2024-05-03T16:44:11.093379+0000","last_active":"2024-05-03T16:45:06.107104+0000","last_peered":"2024-05-03T16:45:06.107104+0000","last_clean":"2024-05-03T16:45:06.107104+0000","last_became_active":"2024-05-03T16:44:11.091280+0000","last_became_peered":"2024-05-03T16:44:11.091280+0000","last_unstale":"2024-05-03T16:45:06.107104+0000","last_undegraded":"2024-05-03T16:45:06.107104+0000","last_fullsized":"2024-05-03T16:45:06.107104+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:20:11.987590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":58,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.625487+0000","last_change":"2024-05-03T16:43:51.820233+0000","last_active":"2024-05-03T16:45:27.625487+0000","last_peered":"2024-05-03T16:45:27.625487+0000","last_clean":"2024-05-03T16:45:27.625487+0000","last_became_active":"2024-05-03T16:43:51.818823+0000","last_became_peered":"2024-05-03T16:43:51.818823+0000","last_unstale":"2024-05-03T16:45:27.625487+0000","last_undegraded":"2024-05-03T16:45:27.625487+0000","last_fullsized":"2024-05-03T16:45:27.625487+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:48:06.135496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099578+0000","last_change":"2024-05-03T16:43:55.946298+0000","last_active":"2024-05-03T16:45:06.099578+0000","last_peered":"2024-05-03T16:45:06.099578+0000","last_clean":"2024-05-03T16:45:06.099578+0000","last_became_active":"2024-05-03T16:43:55.944228+0000","last_became_peered":"2024-05-03T16:43:55.944228+0000","last_unstale":"2024-05-03T16:45:06.099578+0000","last_undegraded":"2024-05-03T16:45:06.099578+0000","last_fullsized":"2024-05-03T16:45:06.099578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:42:50.437264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.106250+0000","last_change":"2024-05-03T16:44:11.086723+0000","last_active":"2024-05-03T16:45:06.106250+0000","last_peered":"2024-05-03T16:45:06.106250+0000","last_clean":"2024-05-03T16:45:06.106250+0000","last_became_active":"2024-05-03T16:44:11.086189+0000","last_became_peered":"2024-05-03T16:44:11.086189+0000","last_unstale":"2024-05-03T16:45:06.106250+0000","last_undegraded":"2024-05-03T16:45:06.106250+0000","last_fullsized":"2024-05-03T16:45:06.106250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:23:41.292942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.632106+0000","last_change":"2024-05-03T16:43:51.817737+0000","last_active":"2024-05-03T16:45:27.632106+0000","last_peered":"2024-05-03T16:45:27.632106+0000","last_clean":"2024-05-03T16:45:27.632106+0000","last_became_active":"2024-05-03T16:43:51.817191+0000","last_became_peered":"2024-05-03T16:43:51.817191+0000","last_unstale":"2024-05-03T16:45:27.632106+0000","last_undegraded":"2024-05-03T16:45:27.632106+0000","last_fullsized":"2024-05-03T16:45:27.632106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:21:16.875189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.098652+0000","last_change":"2024-05-03T16:44:06.180066+0000","last_active":"2024-05-03T16:45:06.098652+0000","last_peered":"2024-05-03T16:45:06.098652+0000","last_clean":"2024-05-03T16:45:06.098652+0000","last_became_active":"2024-05-03T16:44:06.178981+0000","last_became_peered":"2024-05-03T16:44:06.178981+0000","last_unstale":"2024-05-03T16:45:06.098652+0000","last_undegraded":"2024-05-03T16:45:06.098652+0000","last_fullsized":"2024-05-03T16:45:06.098652+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:18:10.683947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.100676+0000","last_change":"2024-05-03T16:44:11.092472+0000","last_active":"2024-05-03T16:45:06.100676+0000","last_peered":"2024-05-03T16:45:06.100676+0000","last_clean":"2024-05-03T16:45:06.100676+0000","last_became_active":"2024-05-03T16:44:11.091225+0000","last_became_peered":"2024-05-03T16:44:11.091225+0000","last_unstale":"2024-05-03T16:45:06.100676+0000","last_undegraded":"2024-05-03T16:45:06.100676+0000","last_fullsized":"2024-05-03T16:45:06.100676+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:24:09.194801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'5","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:47:28.990184+0000","last_change":"2024-05-03T16:44:06.180557+0000","last_active":"2024-05-03T16:47:28.990184+0000","last_peered":"2024-05-03T16:47:28.990184+0000","last_clean":"2024-05-03T16:47:28.990184+0000","last_became_active":"2024-05-03T16:44:06.179612+0000","last_became_peered":"2024-05-03T16:44:06.179612+0000","last_unstale":"2024-05-03T16:47:28.990184+0000","last_undegraded":"2024-05-03T16:47:28.990184+0000","last_fullsized":"2024-05-03T16:47:28.990184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:39:33.469080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.109456+0000","last_change":"2024-05-03T16:43:55.942416+0000","last_active":"2024-05-03T16:45:06.109456+0000","last_peered":"2024-05-03T16:45:06.109456+0000","last_clean":"2024-05-03T16:45:06.109456+0000","last_became_active":"2024-05-03T16:43:55.942041+0000","last_became_peered":"2024-05-03T16:43:55.942041+0000","last_unstale":"2024-05-03T16:45:06.109456+0000","last_undegraded":"2024-05-03T16:45:06.109456+0000","last_fullsized":"2024-05-03T16:45:06.109456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:40:29.384354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.100115+0000","last_change":"2024-05-03T16:44:11.096209+0000","last_active":"2024-05-03T16:45:06.100115+0000","last_peered":"2024-05-03T16:45:06.100115+0000","last_clean":"2024-05-03T16:45:06.100115+0000","last_became_active":"2024-05-03T16:44:11.095724+0000","last_became_peered":"2024-05-03T16:44:11.095724+0000","last_unstale":"2024-05-03T16:45:06.100115+0000","last_undegraded":"2024-05-03T16:45:06.100115+0000","last_fullsized":"2024-05-03T16:45:06.100115+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:41:30.883988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":58,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:25.606655+0000","last_change":"2024-05-03T16:44:06.021453+0000","last_active":"2024-05-03T16:45:25.606655+0000","last_peered":"2024-05-03T16:45:25.606655+0000","last_clean":"2024-05-03T16:45:25.606655+0000","last_became_active":"2024-05-03T16:44:06.020443+0000","last_became_peered":"2024-05-03T16:44:06.020443+0000","last_unstale":"2024-05-03T16:45:25.606655+0000","last_undegraded":"2024-05-03T16:45:25.606655+0000","last_fullsized":"2024-05-03T16:45:25.606655+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:55:43.435774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171494+0000","last_change":"2024-05-03T16:43:55.938655+0000","last_active":"2024-05-03T16:45:06.171494+0000","last_peered":"2024-05-03T16:45:06.171494+0000","last_clean":"2024-05-03T16:45:06.171494+0000","last_became_active":"2024-05-03T16:43:55.938269+0000","last_became_peered":"2024-05-03T16:43:55.938269+0000","last_unstale":"2024-05-03T16:45:06.171494+0000","last_undegraded":"2024-05-03T16:45:06.171494+0000","last_fullsized":"2024-05-03T16:45:06.171494+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:51:42.550932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104803+0000","last_change":"2024-05-03T16:44:11.096724+0000","last_active":"2024-05-03T16:45:06.104803+0000","last_peered":"2024-05-03T16:45:06.104803+0000","last_clean":"2024-05-03T16:45:06.104803+0000","last_became_active":"2024-05-03T16:44:11.095877+0000","last_became_peered":"2024-05-03T16:44:11.095877+0000","last_unstale":"2024-05-03T16:45:06.104803+0000","last_undegraded":"2024-05-03T16:45:06.104803+0000","last_fullsized":"2024-05-03T16:45:06.104803+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:08:46.696046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.626029+0000","last_change":"2024-05-03T16:43:51.818919+0000","last_active":"2024-05-03T16:45:26.626029+0000","last_peered":"2024-05-03T16:45:26.626029+0000","last_clean":"2024-05-03T16:45:26.626029+0000","last_became_active":"2024-05-03T16:43:51.817574+0000","last_became_peered":"2024-05-03T16:43:51.817574+0000","last_unstale":"2024-05-03T16:45:26.626029+0000","last_undegraded":"2024-05-03T16:45:26.626029+0000","last_fullsized":"2024-05-03T16:45:26.626029+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:18:17.335988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172600+0000","last_change":"2024-05-03T16:43:55.935647+0000","last_active":"2024-05-03T16:45:06.172600+0000","last_peered":"2024-05-03T16:45:06.172600+0000","last_clean":"2024-05-03T16:45:06.172600+0000","last_became_active":"2024-05-03T16:43:55.935266+0000","last_became_peered":"2024-05-03T16:43:55.935266+0000","last_unstale":"2024-05-03T16:45:06.172600+0000","last_undegraded":"2024-05-03T16:45:06.172600+0000","last_fullsized":"2024-05-03T16:45:06.172600+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:51:48.743197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170973+0000","last_change":"2024-05-03T16:44:11.085588+0000","last_active":"2024-05-03T16:45:06.170973+0000","last_peered":"2024-05-03T16:45:06.170973+0000","last_clean":"2024-05-03T16:45:06.170973+0000","last_became_active":"2024-05-03T16:44:11.084993+0000","last_became_peered":"2024-05-03T16:44:11.084993+0000","last_unstale":"2024-05-03T16:45:06.170973+0000","last_undegraded":"2024-05-03T16:45:06.170973+0000","last_fullsized":"2024-05-03T16:45:06.170973+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:50:42.349365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.633449+0000","last_change":"2024-05-03T16:43:51.828689+0000","last_active":"2024-05-03T16:45:27.633449+0000","last_peered":"2024-05-03T16:45:27.633449+0000","last_clean":"2024-05-03T16:45:27.633449+0000","last_became_active":"2024-05-03T16:43:51.828212+0000","last_became_peered":"2024-05-03T16:43:51.828212+0000","last_unstale":"2024-05-03T16:45:27.633449+0000","last_undegraded":"2024-05-03T16:45:27.633449+0000","last_fullsized":"2024-05-03T16:45:27.633449+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:06:18.947792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.097884+0000","last_change":"2024-05-03T16:43:55.945043+0000","last_active":"2024-05-03T16:45:06.097884+0000","last_peered":"2024-05-03T16:45:06.097884+0000","last_clean":"2024-05-03T16:45:06.097884+0000","last_became_active":"2024-05-03T16:43:55.944702+0000","last_became_peered":"2024-05-03T16:43:55.944702+0000","last_unstale":"2024-05-03T16:45:06.097884+0000","last_undegraded":"2024-05-03T16:45:06.097884+0000","last_fullsized":"2024-05-03T16:45:06.097884+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:28:51.434232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172905+0000","last_change":"2024-05-03T16:44:11.080122+0000","last_active":"2024-05-03T16:45:06.172905+0000","last_peered":"2024-05-03T16:45:06.172905+0000","last_clean":"2024-05-03T16:45:06.172905+0000","last_became_active":"2024-05-03T16:44:11.078792+0000","last_became_peered":"2024-05-03T16:44:11.078792+0000","last_unstale":"2024-05-03T16:45:06.172905+0000","last_undegraded":"2024-05-03T16:45:06.172905+0000","last_fullsized":"2024-05-03T16:45:06.172905+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:43:17.828550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'4","reported_seq":297,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:47:30.994806+0000","last_change":"2024-05-03T16:43:51.823536+0000","last_active":"2024-05-03T16:47:30.994806+0000","last_peered":"2024-05-03T16:47:30.994806+0000","last_clean":"2024-05-03T16:47:30.994806+0000","last_became_active":"2024-05-03T16:43:51.823117+0000","last_became_peered":"2024-05-03T16:43:51.823117+0000","last_unstale":"2024-05-03T16:47:30.994806+0000","last_undegraded":"2024-05-03T16:47:30.994806+0000","last_fullsized":"2024-05-03T16:47:30.994806+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:50:19.990133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":248,"num_read_kb":248,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.102180+0000","last_change":"2024-05-03T16:43:55.945941+0000","last_active":"2024-05-03T16:45:06.102180+0000","last_peered":"2024-05-03T16:45:06.102180+0000","last_clean":"2024-05-03T16:45:06.102180+0000","last_became_active":"2024-05-03T16:43:55.945173+0000","last_became_peered":"2024-05-03T16:43:55.945173+0000","last_unstale":"2024-05-03T16:45:06.102180+0000","last_undegraded":"2024-05-03T16:45:06.102180+0000","last_fullsized":"2024-05-03T16:45:06.102180+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:39:22.185454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.097597+0000","last_change":"2024-05-03T16:44:11.090040+0000","last_active":"2024-05-03T16:45:06.097597+0000","last_peered":"2024-05-03T16:45:06.097597+0000","last_clean":"2024-05-03T16:45:06.097597+0000","last_became_active":"2024-05-03T16:44:11.089381+0000","last_became_peered":"2024-05-03T16:44:11.089381+0000","last_unstale":"2024-05-03T16:45:06.097597+0000","last_undegraded":"2024-05-03T16:45:06.097597+0000","last_fullsized":"2024-05-03T16:45:06.097597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:13:05.149205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.623587+0000","last_change":"2024-05-03T16:43:51.828726+0000","last_active":"2024-05-03T16:45:26.623587+0000","last_peered":"2024-05-03T16:45:26.623587+0000","last_clean":"2024-05-03T16:45:26.623587+0000","last_became_active":"2024-05-03T16:43:51.827302+0000","last_became_peered":"2024-05-03T16:43:51.827302+0000","last_unstale":"2024-05-03T16:45:26.623587+0000","last_undegraded":"2024-05-03T16:45:26.623587+0000","last_fullsized":"2024-05-03T16:45:26.623587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:24:03.296019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171205+0000","last_change":"2024-05-03T16:43:55.941142+0000","last_active":"2024-05-03T16:45:06.171205+0000","last_peered":"2024-05-03T16:45:06.171205+0000","last_clean":"2024-05-03T16:45:06.171205+0000","last_became_active":"2024-05-03T16:43:55.940762+0000","last_became_peered":"2024-05-03T16:43:55.940762+0000","last_unstale":"2024-05-03T16:45:06.171205+0000","last_undegraded":"2024-05-03T16:45:06.171205+0000","last_fullsized":"2024-05-03T16:45:06.171205+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:31:38.412076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.107392+0000","last_change":"2024-05-03T16:44:11.091481+0000","last_active":"2024-05-03T16:45:06.107392+0000","last_peered":"2024-05-03T16:45:06.107392+0000","last_clean":"2024-05-03T16:45:06.107392+0000","last_became_active":"2024-05-03T16:44:11.090597+0000","last_became_peered":"2024-05-03T16:44:11.090597+0000","last_unstale":"2024-05-03T16:45:06.107392+0000","last_undegraded":"2024-05-03T16:45:06.107392+0000","last_fullsized":"2024-05-03T16:45:06.107392+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:43:09.390062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.633054+0000","last_change":"2024-05-03T16:43:51.837548+0000","last_active":"2024-05-03T16:45:27.633054+0000","last_peered":"2024-05-03T16:45:27.633054+0000","last_clean":"2024-05-03T16:45:27.633054+0000","last_became_active":"2024-05-03T16:43:51.837021+0000","last_became_peered":"2024-05-03T16:43:51.837021+0000","last_unstale":"2024-05-03T16:45:27.633054+0000","last_undegraded":"2024-05-03T16:45:27.633054+0000","last_fullsized":"2024-05-03T16:45:27.633054+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:26:57.384438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.100233+0000","last_change":"2024-05-03T16:43:55.933759+0000","last_active":"2024-05-03T16:45:06.100233+0000","last_peered":"2024-05-03T16:45:06.100233+0000","last_clean":"2024-05-03T16:45:06.100233+0000","last_became_active":"2024-05-03T16:43:55.933026+0000","last_became_peered":"2024-05-03T16:43:55.933026+0000","last_unstale":"2024-05-03T16:45:06.100233+0000","last_undegraded":"2024-05-03T16:45:06.100233+0000","last_fullsized":"2024-05-03T16:45:06.100233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:28:46.898497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175952+0000","last_change":"2024-05-03T16:45:06.174763+0000","last_active":"2024-05-03T16:45:06.175952+0000","last_peered":"2024-05-03T16:45:06.175952+0000","last_clean":"2024-05-03T16:45:06.175952+0000","last_became_active":"2024-05-03T16:45:06.173268+0000","last_became_peered":"2024-05-03T16:45:06.173268+0000","last_unstale":"2024-05-03T16:45:06.175952+0000","last_undegraded":"2024-05-03T16:45:06.175952+0000","last_fullsized":"2024-05-03T16:45:06.175952+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:42:14.281298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.14","version":"91'33","reported_seq":334,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:47:31.006548+0000","last_change":"2024-05-03T16:43:51.821086+0000","last_active":"2024-05-03T16:47:31.006548+0000","last_peered":"2024-05-03T16:47:31.006548+0000","last_clean":"2024-05-03T16:47:31.006548+0000","last_became_active":"2024-05-03T16:43:51.820371+0000","last_became_peered":"2024-05-03T16:43:51.820371+0000","last_unstale":"2024-05-03T16:47:31.006548+0000","last_undegraded":"2024-05-03T16:47:31.006548+0000","last_fullsized":"2024-05-03T16:47:31.006548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:40:51.807045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54127,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":256,"num_read_kb":181,"num_write":35,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.109367+0000","last_change":"2024-05-03T16:43:55.952946+0000","last_active":"2024-05-03T16:45:06.109367+0000","last_peered":"2024-05-03T16:45:06.109367+0000","last_clean":"2024-05-03T16:45:06.109367+0000","last_became_active":"2024-05-03T16:43:55.952587+0000","last_became_peered":"2024-05-03T16:43:55.952587+0000","last_unstale":"2024-05-03T16:45:06.109367+0000","last_undegraded":"2024-05-03T16:45:06.109367+0000","last_fullsized":"2024-05-03T16:45:06.109367+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:40:24.944554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171388+0000","last_change":"2024-05-03T16:44:11.088771+0000","last_active":"2024-05-03T16:45:06.171388+0000","last_peered":"2024-05-03T16:45:06.171388+0000","last_clean":"2024-05-03T16:45:06.171388+0000","last_became_active":"2024-05-03T16:44:11.088206+0000","last_became_peered":"2024-05-03T16:44:11.088206+0000","last_unstale":"2024-05-03T16:45:06.171388+0000","last_undegraded":"2024-05-03T16:45:06.171388+0000","last_fullsized":"2024-05-03T16:45:06.171388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:20:34.876403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.629866+0000","last_change":"2024-05-03T16:44:06.034148+0000","last_active":"2024-05-03T16:45:27.629866+0000","last_peered":"2024-05-03T16:45:27.629866+0000","last_clean":"2024-05-03T16:45:27.629866+0000","last_became_active":"2024-05-03T16:44:06.019766+0000","last_became_peered":"2024-05-03T16:44:06.019766+0000","last_unstale":"2024-05-03T16:45:27.629866+0000","last_undegraded":"2024-05-03T16:45:27.629866+0000","last_fullsized":"2024-05-03T16:45:27.629866+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:05:37.507361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172698+0000","last_change":"2024-05-03T16:43:55.935799+0000","last_active":"2024-05-03T16:45:06.172698+0000","last_peered":"2024-05-03T16:45:06.172698+0000","last_clean":"2024-05-03T16:45:06.172698+0000","last_became_active":"2024-05-03T16:43:55.935500+0000","last_became_peered":"2024-05-03T16:43:55.935500+0000","last_unstale":"2024-05-03T16:45:06.172698+0000","last_undegraded":"2024-05-03T16:45:06.172698+0000","last_fullsized":"2024-05-03T16:45:06.172698+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:01:42.624823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.181536+0000","last_change":"2024-05-03T16:45:06.180000+0000","last_active":"2024-05-03T16:45:06.181536+0000","last_peered":"2024-05-03T16:45:06.181536+0000","last_clean":"2024-05-03T16:45:06.181536+0000","last_became_active":"2024-05-03T16:45:06.178226+0000","last_became_peered":"2024-05-03T16:45:06.178226+0000","last_unstale":"2024-05-03T16:45:06.181536+0000","last_undegraded":"2024-05-03T16:45:06.181536+0000","last_fullsized":"2024-05-03T16:45:06.181536+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:12:14.524002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.625564+0000","last_change":"2024-05-03T16:43:51.831435+0000","last_active":"2024-05-03T16:45:27.625564+0000","last_peered":"2024-05-03T16:45:27.625564+0000","last_clean":"2024-05-03T16:45:27.625564+0000","last_became_active":"2024-05-03T16:43:51.830857+0000","last_became_peered":"2024-05-03T16:43:51.830857+0000","last_unstale":"2024-05-03T16:45:27.625564+0000","last_undegraded":"2024-05-03T16:45:27.625564+0000","last_fullsized":"2024-05-03T16:45:27.625564+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:32:36.463798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171016+0000","last_change":"2024-05-03T16:43:55.946511+0000","last_active":"2024-05-03T16:45:06.171016+0000","last_peered":"2024-05-03T16:45:06.171016+0000","last_clean":"2024-05-03T16:45:06.171016+0000","last_became_active":"2024-05-03T16:43:55.946206+0000","last_became_peered":"2024-05-03T16:43:55.946206+0000","last_unstale":"2024-05-03T16:45:06.171016+0000","last_undegraded":"2024-05-03T16:45:06.171016+0000","last_fullsized":"2024-05-03T16:45:06.171016+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:08:04.276790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099457+0000","last_change":"2024-05-03T16:44:11.087824+0000","last_active":"2024-05-03T16:45:06.099457+0000","last_peered":"2024-05-03T16:45:06.099457+0000","last_clean":"2024-05-03T16:45:06.099457+0000","last_became_active":"2024-05-03T16:44:11.087408+0000","last_became_peered":"2024-05-03T16:44:11.087408+0000","last_unstale":"2024-05-03T16:45:06.099457+0000","last_undegraded":"2024-05-03T16:45:06.099457+0000","last_fullsized":"2024-05-03T16:45:06.099457+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:18:23.334214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"91'5","reported_seq":174,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:47:27.979536+0000","last_change":"2024-05-03T16:43:51.824633+0000","last_active":"2024-05-03T16:47:27.979536+0000","last_peered":"2024-05-03T16:47:27.979536+0000","last_clean":"2024-05-03T16:47:27.979536+0000","last_became_active":"2024-05-03T16:43:51.824137+0000","last_became_peered":"2024-05-03T16:43:51.824137+0000","last_unstale":"2024-05-03T16:47:27.979536+0000","last_undegraded":"2024-05-03T16:47:27.979536+0000","last_fullsized":"2024-05-03T16:47:27.979536+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:13:25.975252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169751+0000","last_change":"2024-05-03T16:43:55.948878+0000","last_active":"2024-05-03T16:45:06.169751+0000","last_peered":"2024-05-03T16:45:06.169751+0000","last_clean":"2024-05-03T16:45:06.169751+0000","last_became_active":"2024-05-03T16:43:55.947279+0000","last_became_peered":"2024-05-03T16:43:55.947279+0000","last_unstale":"2024-05-03T16:45:06.169751+0000","last_undegraded":"2024-05-03T16:45:06.169751+0000","last_fullsized":"2024-05-03T16:45:06.169751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:36:46.082725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175169+0000","last_change":"2024-05-03T16:44:11.096329+0000","last_active":"2024-05-03T16:45:06.175169+0000","last_peered":"2024-05-03T16:45:06.175169+0000","last_clean":"2024-05-03T16:45:06.175169+0000","last_became_active":"2024-05-03T16:44:11.091404+0000","last_became_peered":"2024-05-03T16:44:11.091404+0000","last_unstale":"2024-05-03T16:45:06.175169+0000","last_undegraded":"2024-05-03T16:45:06.175169+0000","last_fullsized":"2024-05-03T16:45:06.175169+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:09:12.688840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":63,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.629170+0000","last_change":"2024-05-03T16:43:51.837908+0000","last_active":"2024-05-03T16:45:27.629170+0000","last_peered":"2024-05-03T16:45:27.629170+0000","last_clean":"2024-05-03T16:45:27.629170+0000","last_became_active":"2024-05-03T16:43:51.837334+0000","last_became_peered":"2024-05-03T16:43:51.837334+0000","last_unstale":"2024-05-03T16:45:27.629170+0000","last_undegraded":"2024-05-03T16:45:27.629170+0000","last_fullsized":"2024-05-03T16:45:27.629170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:08:46.480524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171132+0000","last_change":"2024-05-03T16:43:55.933729+0000","last_active":"2024-05-03T16:45:06.171132+0000","last_peered":"2024-05-03T16:45:06.171132+0000","last_clean":"2024-05-03T16:45:06.171132+0000","last_became_active":"2024-05-03T16:43:55.933211+0000","last_became_peered":"2024-05-03T16:43:55.933211+0000","last_unstale":"2024-05-03T16:45:06.171132+0000","last_undegraded":"2024-05-03T16:45:06.171132+0000","last_fullsized":"2024-05-03T16:45:06.171132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:03:38.814029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170099+0000","last_change":"2024-05-03T16:44:11.077832+0000","last_active":"2024-05-03T16:45:06.170099+0000","last_peered":"2024-05-03T16:45:06.170099+0000","last_clean":"2024-05-03T16:45:06.170099+0000","last_became_active":"2024-05-03T16:44:11.076574+0000","last_became_peered":"2024-05-03T16:44:11.076574+0000","last_unstale":"2024-05-03T16:45:06.170099+0000","last_undegraded":"2024-05-03T16:45:06.170099+0000","last_fullsized":"2024-05-03T16:45:06.170099+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:59:35.354254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.629569+0000","last_change":"2024-05-03T16:43:51.818391+0000","last_active":"2024-05-03T16:45:27.629569+0000","last_peered":"2024-05-03T16:45:27.629569+0000","last_clean":"2024-05-03T16:45:27.629569+0000","last_became_active":"2024-05-03T16:43:51.817335+0000","last_became_peered":"2024-05-03T16:43:51.817335+0000","last_unstale":"2024-05-03T16:45:27.629569+0000","last_undegraded":"2024-05-03T16:45:27.629569+0000","last_fullsized":"2024-05-03T16:45:27.629569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:41:16.610501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104273+0000","last_change":"2024-05-03T16:43:55.948170+0000","last_active":"2024-05-03T16:45:06.104273+0000","last_peered":"2024-05-03T16:45:06.104273+0000","last_clean":"2024-05-03T16:45:06.104273+0000","last_became_active":"2024-05-03T16:43:55.947702+0000","last_became_peered":"2024-05-03T16:43:55.947702+0000","last_unstale":"2024-05-03T16:45:06.104273+0000","last_undegraded":"2024-05-03T16:45:06.104273+0000","last_fullsized":"2024-05-03T16:45:06.104273+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:23:27.614466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.109080+0000","last_change":"2024-05-03T16:44:11.110211+0000","last_active":"2024-05-03T16:45:06.109080+0000","last_peered":"2024-05-03T16:45:06.109080+0000","last_clean":"2024-05-03T16:45:06.109080+0000","last_became_active":"2024-05-03T16:44:11.109387+0000","last_became_peered":"2024-05-03T16:44:11.109387+0000","last_unstale":"2024-05-03T16:45:06.109080+0000","last_undegraded":"2024-05-03T16:45:06.109080+0000","last_fullsized":"2024-05-03T16:45:06.109080+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:00:50.609558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:25.605648+0000","last_change":"2024-05-03T16:43:51.837727+0000","last_active":"2024-05-03T16:45:25.605648+0000","last_peered":"2024-05-03T16:45:25.605648+0000","last_clean":"2024-05-03T16:45:25.605648+0000","last_became_active":"2024-05-03T16:43:51.837226+0000","last_became_peered":"2024-05-03T16:43:51.837226+0000","last_unstale":"2024-05-03T16:45:25.605648+0000","last_undegraded":"2024-05-03T16:45:25.605648+0000","last_fullsized":"2024-05-03T16:45:25.605648+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:52:48.913506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.106165+0000","last_change":"2024-05-03T16:43:55.934403+0000","last_active":"2024-05-03T16:45:06.106165+0000","last_peered":"2024-05-03T16:45:06.106165+0000","last_clean":"2024-05-03T16:45:06.106165+0000","last_became_active":"2024-05-03T16:43:55.933997+0000","last_became_peered":"2024-05-03T16:43:55.933997+0000","last_unstale":"2024-05-03T16:45:06.106165+0000","last_undegraded":"2024-05-03T16:45:06.106165+0000","last_fullsized":"2024-05-03T16:45:06.106165+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:44:36.005567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173076+0000","last_change":"2024-05-03T16:44:11.088757+0000","last_active":"2024-05-03T16:45:06.173076+0000","last_peered":"2024-05-03T16:45:06.173076+0000","last_clean":"2024-05-03T16:45:06.173076+0000","last_became_active":"2024-05-03T16:44:11.088208+0000","last_became_peered":"2024-05-03T16:44:11.088208+0000","last_unstale":"2024-05-03T16:45:06.173076+0000","last_undegraded":"2024-05-03T16:45:06.173076+0000","last_fullsized":"2024-05-03T16:45:06.173076+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:28:27.913357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"91'6","reported_seq":175,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:47:27.974557+0000","last_change":"2024-05-03T16:43:51.831736+0000","last_active":"2024-05-03T16:47:27.974557+0000","last_peered":"2024-05-03T16:47:27.974557+0000","last_clean":"2024-05-03T16:47:27.974557+0000","last_became_active":"2024-05-03T16:43:51.831282+0000","last_became_peered":"2024-05-03T16:43:51.831282+0000","last_unstale":"2024-05-03T16:47:27.974557+0000","last_undegraded":"2024-05-03T16:47:27.974557+0000","last_fullsized":"2024-05-03T16:47:27.974557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:43:20.924935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104404+0000","last_change":"2024-05-03T16:43:55.939523+0000","last_active":"2024-05-03T16:45:06.104404+0000","last_peered":"2024-05-03T16:45:06.104404+0000","last_clean":"2024-05-03T16:45:06.104404+0000","last_became_active":"2024-05-03T16:43:55.939040+0000","last_became_peered":"2024-05-03T16:43:55.939040+0000","last_unstale":"2024-05-03T16:45:06.104404+0000","last_undegraded":"2024-05-03T16:45:06.104404+0000","last_fullsized":"2024-05-03T16:45:06.104404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:18:10.014846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175338+0000","last_change":"2024-05-03T16:44:11.110879+0000","last_active":"2024-05-03T16:45:06.175338+0000","last_peered":"2024-05-03T16:45:06.175338+0000","last_clean":"2024-05-03T16:45:06.175338+0000","last_became_active":"2024-05-03T16:44:11.109272+0000","last_became_peered":"2024-05-03T16:44:11.109272+0000","last_unstale":"2024-05-03T16:45:06.175338+0000","last_undegraded":"2024-05-03T16:45:06.175338+0000","last_fullsized":"2024-05-03T16:45:06.175338+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:56:06.145740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171964+0000","last_change":"2024-05-03T16:43:55.943555+0000","last_active":"2024-05-03T16:45:06.171964+0000","last_peered":"2024-05-03T16:45:06.171964+0000","last_clean":"2024-05-03T16:45:06.171964+0000","last_became_active":"2024-05-03T16:43:55.943153+0000","last_became_peered":"2024-05-03T16:43:55.943153+0000","last_unstale":"2024-05-03T16:45:06.171964+0000","last_undegraded":"2024-05-03T16:45:06.171964+0000","last_fullsized":"2024-05-03T16:45:06.171964+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:29:01.943626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:47:27.977987+0000","last_change":"2024-05-03T16:43:51.837491+0000","last_active":"2024-05-03T16:47:27.977987+0000","last_peered":"2024-05-03T16:47:27.977987+0000","last_clean":"2024-05-03T16:47:27.977987+0000","last_became_active":"2024-05-03T16:43:51.837008+0000","last_became_peered":"2024-05-03T16:43:51.837008+0000","last_unstale":"2024-05-03T16:47:27.977987+0000","last_undegraded":"2024-05-03T16:47:27.977987+0000","last_fullsized":"2024-05-03T16:47:27.977987+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:59:22.075792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":123,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:39.549413+0000","last_change":"2024-05-03T16:44:11.091138+0000","last_active":"2024-05-03T16:45:39.549413+0000","last_peered":"2024-05-03T16:45:39.549413+0000","last_clean":"2024-05-03T16:45:39.549413+0000","last_became_active":"2024-05-03T16:44:11.090386+0000","last_became_peered":"2024-05-03T16:44:11.090386+0000","last_unstale":"2024-05-03T16:45:39.549413+0000","last_undegraded":"2024-05-03T16:45:39.549413+0000","last_fullsized":"2024-05-03T16:45:39.549413+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:36:31.201018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173423+0000","last_change":"2024-05-03T16:43:55.945735+0000","last_active":"2024-05-03T16:45:06.173423+0000","last_peered":"2024-05-03T16:45:06.173423+0000","last_clean":"2024-05-03T16:45:06.173423+0000","last_became_active":"2024-05-03T16:43:55.945399+0000","last_became_peered":"2024-05-03T16:43:55.945399+0000","last_unstale":"2024-05-03T16:45:06.173423+0000","last_undegraded":"2024-05-03T16:45:06.173423+0000","last_fullsized":"2024-05-03T16:45:06.173423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T17:28:59.508011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.629811+0000","last_change":"2024-05-03T16:43:51.826695+0000","last_active":"2024-05-03T16:45:27.629811+0000","last_peered":"2024-05-03T16:45:27.629811+0000","last_clean":"2024-05-03T16:45:27.629811+0000","last_became_active":"2024-05-03T16:43:51.825863+0000","last_became_peered":"2024-05-03T16:43:51.825863+0000","last_unstale":"2024-05-03T16:45:27.629811+0000","last_undegraded":"2024-05-03T16:45:27.629811+0000","last_fullsized":"2024-05-03T16:45:27.629811+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:39:15.068092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":119,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169937+0000","last_change":"2024-05-03T16:41:59.060997+0000","last_active":"2024-05-03T16:45:06.169937+0000","last_peered":"2024-05-03T16:45:06.169937+0000","last_clean":"2024-05-03T16:45:06.169937+0000","last_became_active":"2024-05-03T16:41:59.044854+0000","last_became_peered":"2024-05-03T16:41:59.044854+0000","last_unstale":"2024-05-03T16:45:06.169937+0000","last_undegraded":"2024-05-03T16:45:06.169937+0000","last_fullsized":"2024-05-03T16:45:06.169937+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:37:18.600432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:37:18.600432+0000","last_clean_scrub_stamp":"2024-05-03T16:37:18.600432+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:10:25.167355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171482+0000","last_change":"2024-05-03T16:44:11.110042+0000","last_active":"2024-05-03T16:45:06.171482+0000","last_peered":"2024-05-03T16:45:06.171482+0000","last_clean":"2024-05-03T16:45:06.171482+0000","last_became_active":"2024-05-03T16:44:11.109374+0000","last_became_peered":"2024-05-03T16:44:11.109374+0000","last_unstale":"2024-05-03T16:45:06.171482+0000","last_undegraded":"2024-05-03T16:45:06.171482+0000","last_fullsized":"2024-05-03T16:45:06.171482+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:04:21.562224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171622+0000","last_change":"2024-05-03T16:43:55.936662+0000","last_active":"2024-05-03T16:45:06.171622+0000","last_peered":"2024-05-03T16:45:06.171622+0000","last_clean":"2024-05-03T16:45:06.171622+0000","last_became_active":"2024-05-03T16:43:55.936332+0000","last_became_peered":"2024-05-03T16:43:55.936332+0000","last_unstale":"2024-05-03T16:45:06.171622+0000","last_undegraded":"2024-05-03T16:45:06.171622+0000","last_fullsized":"2024-05-03T16:45:06.171622+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:35:39.571574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.629426+0000","last_change":"2024-05-03T16:44:06.024989+0000","last_active":"2024-05-03T16:45:26.629426+0000","last_peered":"2024-05-03T16:45:26.629426+0000","last_clean":"2024-05-03T16:45:26.629426+0000","last_became_active":"2024-05-03T16:44:06.023623+0000","last_became_peered":"2024-05-03T16:44:06.023623+0000","last_unstale":"2024-05-03T16:45:26.629426+0000","last_undegraded":"2024-05-03T16:45:26.629426+0000","last_fullsized":"2024-05-03T16:45:26.629426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:24:25.516820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.103375+0000","last_change":"2024-05-03T16:44:11.088212+0000","last_active":"2024-05-03T16:45:06.103375+0000","last_peered":"2024-05-03T16:45:06.103375+0000","last_clean":"2024-05-03T16:45:06.103375+0000","last_became_active":"2024-05-03T16:44:11.087737+0000","last_became_peered":"2024-05-03T16:44:11.087737+0000","last_unstale":"2024-05-03T16:45:06.103375+0000","last_undegraded":"2024-05-03T16:45:06.103375+0000","last_fullsized":"2024-05-03T16:45:06.103375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:41:45.422664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.628680+0000","last_change":"2024-05-03T16:43:51.837762+0000","last_active":"2024-05-03T16:45:27.628680+0000","last_peered":"2024-05-03T16:45:27.628680+0000","last_clean":"2024-05-03T16:45:27.628680+0000","last_became_active":"2024-05-03T16:43:51.837310+0000","last_became_peered":"2024-05-03T16:43:51.837310+0000","last_unstale":"2024-05-03T16:45:27.628680+0000","last_undegraded":"2024-05-03T16:45:27.628680+0000","last_fullsized":"2024-05-03T16:45:27.628680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:34:51.983691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173544+0000","last_change":"2024-05-03T16:43:55.937607+0000","last_active":"2024-05-03T16:45:06.173544+0000","last_peered":"2024-05-03T16:45:06.173544+0000","last_clean":"2024-05-03T16:45:06.173544+0000","last_became_active":"2024-05-03T16:43:55.937166+0000","last_became_peered":"2024-05-03T16:43:55.937166+0000","last_unstale":"2024-05-03T16:45:06.173544+0000","last_undegraded":"2024-05-03T16:45:06.173544+0000","last_fullsized":"2024-05-03T16:45:06.173544+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:03:29.121718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.172273+0000","last_change":"2024-05-03T16:44:11.109641+0000","last_active":"2024-05-03T16:45:06.172273+0000","last_peered":"2024-05-03T16:45:06.172273+0000","last_clean":"2024-05-03T16:45:06.172273+0000","last_became_active":"2024-05-03T16:44:11.109118+0000","last_became_peered":"2024-05-03T16:44:11.109118+0000","last_unstale":"2024-05-03T16:45:06.172273+0000","last_undegraded":"2024-05-03T16:45:06.172273+0000","last_fullsized":"2024-05-03T16:45:06.172273+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:23:37.879612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'15","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:46:02.663333+0000","last_change":"2024-05-03T16:43:51.816440+0000","last_active":"2024-05-03T16:46:02.663333+0000","last_peered":"2024-05-03T16:46:02.663333+0000","last_clean":"2024-05-03T16:46:02.663333+0000","last_became_active":"2024-05-03T16:43:51.815952+0000","last_became_peered":"2024-05-03T16:43:51.815952+0000","last_unstale":"2024-05-03T16:46:02.663333+0000","last_undegraded":"2024-05-03T16:46:02.663333+0000","last_fullsized":"2024-05-03T16:46:02.663333+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:10:51.461550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175550+0000","last_change":"2024-05-03T16:43:55.952685+0000","last_active":"2024-05-03T16:45:06.175550+0000","last_peered":"2024-05-03T16:45:06.175550+0000","last_clean":"2024-05-03T16:45:06.175550+0000","last_became_active":"2024-05-03T16:43:55.952199+0000","last_became_peered":"2024-05-03T16:43:55.952199+0000","last_unstale":"2024-05-03T16:45:06.175550+0000","last_undegraded":"2024-05-03T16:45:06.175550+0000","last_fullsized":"2024-05-03T16:45:06.175550+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:26:01.716190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.098539+0000","last_change":"2024-05-03T16:44:11.084880+0000","last_active":"2024-05-03T16:45:06.098539+0000","last_peered":"2024-05-03T16:45:06.098539+0000","last_clean":"2024-05-03T16:45:06.098539+0000","last_became_active":"2024-05-03T16:44:11.084334+0000","last_became_peered":"2024-05-03T16:44:11.084334+0000","last_unstale":"2024-05-03T16:45:06.098539+0000","last_undegraded":"2024-05-03T16:45:06.098539+0000","last_fullsized":"2024-05-03T16:45:06.098539+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:38:01.884575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.626312+0000","last_change":"2024-05-03T16:43:51.824420+0000","last_active":"2024-05-03T16:45:27.626312+0000","last_peered":"2024-05-03T16:45:27.626312+0000","last_clean":"2024-05-03T16:45:27.626312+0000","last_became_active":"2024-05-03T16:43:51.820522+0000","last_became_peered":"2024-05-03T16:43:51.820522+0000","last_unstale":"2024-05-03T16:45:27.626312+0000","last_undegraded":"2024-05-03T16:45:27.626312+0000","last_fullsized":"2024-05-03T16:45:27.626312+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:54:29.537068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171293+0000","last_change":"2024-05-03T16:43:55.937107+0000","last_active":"2024-05-03T16:45:06.171293+0000","last_peered":"2024-05-03T16:45:06.171293+0000","last_clean":"2024-05-03T16:45:06.171293+0000","last_became_active":"2024-05-03T16:43:55.936801+0000","last_became_peered":"2024-05-03T16:43:55.936801+0000","last_unstale":"2024-05-03T16:45:06.171293+0000","last_undegraded":"2024-05-03T16:45:06.171293+0000","last_fullsized":"2024-05-03T16:45:06.171293+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:02:45.520881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.115882+0000","last_change":"2024-05-03T16:45:06.114420+0000","last_active":"2024-05-03T16:45:06.115882+0000","last_peered":"2024-05-03T16:45:06.115882+0000","last_clean":"2024-05-03T16:45:06.115882+0000","last_became_active":"2024-05-03T16:45:06.113345+0000","last_became_peered":"2024-05-03T16:45:06.113345+0000","last_unstale":"2024-05-03T16:45:06.115882+0000","last_undegraded":"2024-05-03T16:45:06.115882+0000","last_fullsized":"2024-05-03T16:45:06.115882+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:44:04.899008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:23.579638+0000","last_change":"2024-05-03T16:43:51.836247+0000","last_active":"2024-05-03T16:45:23.579638+0000","last_peered":"2024-05-03T16:45:23.579638+0000","last_clean":"2024-05-03T16:45:23.579638+0000","last_became_active":"2024-05-03T16:43:51.835877+0000","last_became_peered":"2024-05-03T16:43:51.835877+0000","last_unstale":"2024-05-03T16:45:23.579638+0000","last_undegraded":"2024-05-03T16:45:23.579638+0000","last_fullsized":"2024-05-03T16:45:23.579638+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:58:29.774976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.109113+0000","last_change":"2024-05-03T16:43:55.947689+0000","last_active":"2024-05-03T16:45:06.109113+0000","last_peered":"2024-05-03T16:45:06.109113+0000","last_clean":"2024-05-03T16:45:06.109113+0000","last_became_active":"2024-05-03T16:43:55.947228+0000","last_became_peered":"2024-05-03T16:43:55.947228+0000","last_unstale":"2024-05-03T16:45:06.109113+0000","last_undegraded":"2024-05-03T16:45:06.109113+0000","last_fullsized":"2024-05-03T16:45:06.109113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:09:17.595952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.182759+0000","last_change":"2024-05-03T16:45:06.179884+0000","last_active":"2024-05-03T16:45:06.182759+0000","last_peered":"2024-05-03T16:45:06.182759+0000","last_clean":"2024-05-03T16:45:06.182759+0000","last_became_active":"2024-05-03T16:45:06.178568+0000","last_became_peered":"2024-05-03T16:45:06.178568+0000","last_unstale":"2024-05-03T16:45:06.182759+0000","last_undegraded":"2024-05-03T16:45:06.182759+0000","last_fullsized":"2024-05-03T16:45:06.182759+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:10:00.693492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.623942+0000","last_change":"2024-05-03T16:43:51.821131+0000","last_active":"2024-05-03T16:45:26.623942+0000","last_peered":"2024-05-03T16:45:26.623942+0000","last_clean":"2024-05-03T16:45:26.623942+0000","last_became_active":"2024-05-03T16:43:51.817423+0000","last_became_peered":"2024-05-03T16:43:51.817423+0000","last_unstale":"2024-05-03T16:45:26.623942+0000","last_undegraded":"2024-05-03T16:45:26.623942+0000","last_fullsized":"2024-05-03T16:45:26.623942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:00:34.387262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104080+0000","last_change":"2024-05-03T16:43:55.944671+0000","last_active":"2024-05-03T16:45:06.104080+0000","last_peered":"2024-05-03T16:45:06.104080+0000","last_clean":"2024-05-03T16:45:06.104080+0000","last_became_active":"2024-05-03T16:43:55.943854+0000","last_became_peered":"2024-05-03T16:43:55.943854+0000","last_unstale":"2024-05-03T16:45:06.104080+0000","last_undegraded":"2024-05-03T16:45:06.104080+0000","last_fullsized":"2024-05-03T16:45:06.104080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:57:10.809133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:47.362165+0000","last_change":"2024-05-03T16:44:11.092702+0000","last_active":"2024-05-03T16:45:47.362165+0000","last_peered":"2024-05-03T16:45:47.362165+0000","last_clean":"2024-05-03T16:45:47.362165+0000","last_became_active":"2024-05-03T16:44:11.091351+0000","last_became_peered":"2024-05-03T16:44:11.091351+0000","last_unstale":"2024-05-03T16:45:47.362165+0000","last_undegraded":"2024-05-03T16:45:47.362165+0000","last_fullsized":"2024-05-03T16:45:47.362165+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:06:58.227501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"91'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.590347+0000","last_change":"2024-05-03T16:43:51.822538+0000","last_active":"2024-05-03T16:45:27.590347+0000","last_peered":"2024-05-03T16:45:27.590347+0000","last_clean":"2024-05-03T16:45:27.590347+0000","last_became_active":"2024-05-03T16:43:51.821210+0000","last_became_peered":"2024-05-03T16:43:51.821210+0000","last_unstale":"2024-05-03T16:45:27.590347+0000","last_undegraded":"2024-05-03T16:45:27.590347+0000","last_fullsized":"2024-05-03T16:45:27.590347+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:29:00.377196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.174305+0000","last_change":"2024-05-03T16:43:55.943752+0000","last_active":"2024-05-03T16:45:06.174305+0000","last_peered":"2024-05-03T16:45:06.174305+0000","last_clean":"2024-05-03T16:45:06.174305+0000","last_became_active":"2024-05-03T16:43:55.943406+0000","last_became_peered":"2024-05-03T16:43:55.943406+0000","last_unstale":"2024-05-03T16:45:06.174305+0000","last_undegraded":"2024-05-03T16:45:06.174305+0000","last_fullsized":"2024-05-03T16:45:06.174305+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:47:25.753453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.107762+0000","last_change":"2024-05-03T16:44:11.111510+0000","last_active":"2024-05-03T16:45:06.107762+0000","last_peered":"2024-05-03T16:45:06.107762+0000","last_clean":"2024-05-03T16:45:06.107762+0000","last_became_active":"2024-05-03T16:44:11.110913+0000","last_became_peered":"2024-05-03T16:44:11.110913+0000","last_unstale":"2024-05-03T16:45:06.107762+0000","last_undegraded":"2024-05-03T16:45:06.107762+0000","last_fullsized":"2024-05-03T16:45:06.107762+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:04:43.435364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.629358+0000","last_change":"2024-05-03T16:43:51.819283+0000","last_active":"2024-05-03T16:45:27.629358+0000","last_peered":"2024-05-03T16:45:27.629358+0000","last_clean":"2024-05-03T16:45:27.629358+0000","last_became_active":"2024-05-03T16:43:51.818775+0000","last_became_peered":"2024-05-03T16:43:51.818775+0000","last_unstale":"2024-05-03T16:45:27.629358+0000","last_undegraded":"2024-05-03T16:45:27.629358+0000","last_fullsized":"2024-05-03T16:45:27.629358+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:01:42.363340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170757+0000","last_change":"2024-05-03T16:43:55.946633+0000","last_active":"2024-05-03T16:45:06.170757+0000","last_peered":"2024-05-03T16:45:06.170757+0000","last_clean":"2024-05-03T16:45:06.170757+0000","last_became_active":"2024-05-03T16:43:55.946325+0000","last_became_peered":"2024-05-03T16:43:55.946325+0000","last_unstale":"2024-05-03T16:45:06.170757+0000","last_undegraded":"2024-05-03T16:45:06.170757+0000","last_fullsized":"2024-05-03T16:45:06.170757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:10:54.280667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099767+0000","last_change":"2024-05-03T16:44:11.089589+0000","last_active":"2024-05-03T16:45:06.099767+0000","last_peered":"2024-05-03T16:45:06.099767+0000","last_clean":"2024-05-03T16:45:06.099767+0000","last_became_active":"2024-05-03T16:44:11.088901+0000","last_became_peered":"2024-05-03T16:44:11.088901+0000","last_unstale":"2024-05-03T16:45:06.099767+0000","last_undegraded":"2024-05-03T16:45:06.099767+0000","last_fullsized":"2024-05-03T16:45:06.099767+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:03:07.587439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'5","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:47:25.981559+0000","last_change":"2024-05-03T16:43:51.840062+0000","last_active":"2024-05-03T16:47:25.981559+0000","last_peered":"2024-05-03T16:47:25.981559+0000","last_clean":"2024-05-03T16:47:25.981559+0000","last_became_active":"2024-05-03T16:43:51.839544+0000","last_became_peered":"2024-05-03T16:43:51.839544+0000","last_unstale":"2024-05-03T16:47:25.981559+0000","last_undegraded":"2024-05-03T16:47:25.981559+0000","last_fullsized":"2024-05-03T16:47:25.981559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:37:21.719418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171788+0000","last_change":"2024-05-03T16:43:55.945655+0000","last_active":"2024-05-03T16:45:06.171788+0000","last_peered":"2024-05-03T16:45:06.171788+0000","last_clean":"2024-05-03T16:45:06.171788+0000","last_became_active":"2024-05-03T16:43:55.945263+0000","last_became_peered":"2024-05-03T16:43:55.945263+0000","last_unstale":"2024-05-03T16:45:06.171788+0000","last_undegraded":"2024-05-03T16:45:06.171788+0000","last_fullsized":"2024-05-03T16:45:06.171788+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:33:19.927686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169957+0000","last_change":"2024-05-03T16:44:11.090589+0000","last_active":"2024-05-03T16:45:06.169957+0000","last_peered":"2024-05-03T16:45:06.169957+0000","last_clean":"2024-05-03T16:45:06.169957+0000","last_became_active":"2024-05-03T16:44:11.087981+0000","last_became_peered":"2024-05-03T16:44:11.087981+0000","last_unstale":"2024-05-03T16:45:06.169957+0000","last_undegraded":"2024-05-03T16:45:06.169957+0000","last_fullsized":"2024-05-03T16:45:06.169957+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:43:29.953670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:27.629118+0000","last_change":"2024-05-03T16:43:51.829334+0000","last_active":"2024-05-03T16:45:27.629118+0000","last_peered":"2024-05-03T16:45:27.629118+0000","last_clean":"2024-05-03T16:45:27.629118+0000","last_became_active":"2024-05-03T16:43:51.828816+0000","last_became_peered":"2024-05-03T16:43:51.828816+0000","last_unstale":"2024-05-03T16:45:27.629118+0000","last_undegraded":"2024-05-03T16:45:27.629118+0000","last_fullsized":"2024-05-03T16:45:27.629118+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:54:31.996256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170567+0000","last_change":"2024-05-03T16:43:55.942732+0000","last_active":"2024-05-03T16:45:06.170567+0000","last_peered":"2024-05-03T16:45:06.170567+0000","last_clean":"2024-05-03T16:45:06.170567+0000","last_became_active":"2024-05-03T16:43:55.941445+0000","last_became_peered":"2024-05-03T16:43:55.941445+0000","last_unstale":"2024-05-03T16:45:06.170567+0000","last_undegraded":"2024-05-03T16:45:06.170567+0000","last_fullsized":"2024-05-03T16:45:06.170567+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:04:58.351184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.169556+0000","last_change":"2024-05-03T16:44:11.085542+0000","last_active":"2024-05-03T16:45:06.169556+0000","last_peered":"2024-05-03T16:45:06.169556+0000","last_clean":"2024-05-03T16:45:06.169556+0000","last_became_active":"2024-05-03T16:44:11.082930+0000","last_became_peered":"2024-05-03T16:44:11.082930+0000","last_unstale":"2024-05-03T16:45:06.169556+0000","last_undegraded":"2024-05-03T16:45:06.169556+0000","last_fullsized":"2024-05-03T16:45:06.169556+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:44:10.040608+0000","last_clean_scrub_stamp":"2024-05-03T16:44:10.040608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T16:44:37.617445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:26.625804+0000","last_change":"2024-05-03T16:43:51.820087+0000","last_active":"2024-05-03T16:45:26.625804+0000","last_peered":"2024-05-03T16:45:26.625804+0000","last_clean":"2024-05-03T16:45:26.625804+0000","last_became_active":"2024-05-03T16:43:51.819325+0000","last_became_peered":"2024-05-03T16:43:51.819325+0000","last_unstale":"2024-05-03T16:45:26.625804+0000","last_undegraded":"2024-05-03T16:45:26.625804+0000","last_fullsized":"2024-05-03T16:45:26.625804+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:50.768039+0000","last_clean_scrub_stamp":"2024-05-03T16:43:50.768039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:56:38.593149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.171882+0000","last_change":"2024-05-03T16:43:55.952515+0000","last_active":"2024-05-03T16:45:06.171882+0000","last_peered":"2024-05-03T16:45:06.171882+0000","last_clean":"2024-05-03T16:45:06.171882+0000","last_became_active":"2024-05-03T16:43:55.951685+0000","last_became_peered":"2024-05-03T16:43:55.951685+0000","last_unstale":"2024-05-03T16:45:06.171882+0000","last_undegraded":"2024-05-03T16:45:06.171882+0000","last_fullsized":"2024-05-03T16:45:06.171882+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T18:14:03.935407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104956+0000","last_change":"2024-05-03T16:43:55.944993+0000","last_active":"2024-05-03T16:45:06.104956+0000","last_peered":"2024-05-03T16:45:06.104956+0000","last_clean":"2024-05-03T16:45:06.104956+0000","last_became_active":"2024-05-03T16:43:55.944364+0000","last_became_peered":"2024-05-03T16:43:55.944364+0000","last_unstale":"2024-05-03T16:45:06.104956+0000","last_undegraded":"2024-05-03T16:45:06.104956+0000","last_fullsized":"2024-05-03T16:45:06.104956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:35:15.711248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099184+0000","last_change":"2024-05-03T16:43:55.947596+0000","last_active":"2024-05-03T16:45:06.099184+0000","last_peered":"2024-05-03T16:45:06.099184+0000","last_clean":"2024-05-03T16:45:06.099184+0000","last_became_active":"2024-05-03T16:43:55.946217+0000","last_became_peered":"2024-05-03T16:43:55.946217+0000","last_unstale":"2024-05-03T16:45:06.099184+0000","last_undegraded":"2024-05-03T16:45:06.099184+0000","last_fullsized":"2024-05-03T16:45:06.099184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:09:07.005119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.098706+0000","last_change":"2024-05-03T16:43:55.940952+0000","last_active":"2024-05-03T16:45:06.098706+0000","last_peered":"2024-05-03T16:45:06.098706+0000","last_clean":"2024-05-03T16:45:06.098706+0000","last_became_active":"2024-05-03T16:43:55.940110+0000","last_became_peered":"2024-05-03T16:43:55.940110+0000","last_unstale":"2024-05-03T16:45:06.098706+0000","last_undegraded":"2024-05-03T16:45:06.098706+0000","last_fullsized":"2024-05-03T16:45:06.098706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:50:27.229267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170630+0000","last_change":"2024-05-03T16:43:55.936616+0000","last_active":"2024-05-03T16:45:06.170630+0000","last_peered":"2024-05-03T16:45:06.170630+0000","last_clean":"2024-05-03T16:45:06.170630+0000","last_became_active":"2024-05-03T16:43:55.936289+0000","last_became_peered":"2024-05-03T16:43:55.936289+0000","last_unstale":"2024-05-03T16:45:06.170630+0000","last_undegraded":"2024-05-03T16:45:06.170630+0000","last_fullsized":"2024-05-03T16:45:06.170630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:32:41.424346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173825+0000","last_change":"2024-05-03T16:43:55.932302+0000","last_active":"2024-05-03T16:45:06.173825+0000","last_peered":"2024-05-03T16:45:06.173825+0000","last_clean":"2024-05-03T16:45:06.173825+0000","last_became_active":"2024-05-03T16:43:55.931819+0000","last_became_peered":"2024-05-03T16:43:55.931819+0000","last_unstale":"2024-05-03T16:45:06.173825+0000","last_undegraded":"2024-05-03T16:45:06.173825+0000","last_fullsized":"2024-05-03T16:45:06.173825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T21:25:02.644191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.104532+0000","last_change":"2024-05-03T16:43:55.942873+0000","last_active":"2024-05-03T16:45:06.104532+0000","last_peered":"2024-05-03T16:45:06.104532+0000","last_clean":"2024-05-03T16:45:06.104532+0000","last_became_active":"2024-05-03T16:43:55.942546+0000","last_became_peered":"2024-05-03T16:43:55.942546+0000","last_unstale":"2024-05-03T16:45:06.104532+0000","last_undegraded":"2024-05-03T16:45:06.104532+0000","last_fullsized":"2024-05-03T16:45:06.104532+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:24:07.111976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.099888+0000","last_change":"2024-05-03T16:43:55.939764+0000","last_active":"2024-05-03T16:45:06.099888+0000","last_peered":"2024-05-03T16:45:06.099888+0000","last_clean":"2024-05-03T16:45:06.099888+0000","last_became_active":"2024-05-03T16:43:55.939362+0000","last_became_peered":"2024-05-03T16:43:55.939362+0000","last_unstale":"2024-05-03T16:45:06.099888+0000","last_undegraded":"2024-05-03T16:45:06.099888+0000","last_fullsized":"2024-05-03T16:45:06.099888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:06:27.624159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.175991+0000","last_change":"2024-05-03T16:43:55.935974+0000","last_active":"2024-05-03T16:45:06.175991+0000","last_peered":"2024-05-03T16:45:06.175991+0000","last_clean":"2024-05-03T16:45:06.175991+0000","last_became_active":"2024-05-03T16:43:55.935582+0000","last_became_peered":"2024-05-03T16:43:55.935582+0000","last_unstale":"2024-05-03T16:45:06.175991+0000","last_undegraded":"2024-05-03T16:45:06.175991+0000","last_fullsized":"2024-05-03T16:45:06.175991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T20:48:18.420037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.170153+0000","last_change":"2024-05-03T16:43:55.938992+0000","last_active":"2024-05-03T16:45:06.170153+0000","last_peered":"2024-05-03T16:45:06.170153+0000","last_clean":"2024-05-03T16:45:06.170153+0000","last_became_active":"2024-05-03T16:43:55.938614+0000","last_became_peered":"2024-05-03T16:43:55.938614+0000","last_unstale":"2024-05-03T16:45:06.170153+0000","last_undegraded":"2024-05-03T16:45:06.170153+0000","last_fullsized":"2024-05-03T16:45:06.170153+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:18:44.830231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.173472+0000","last_change":"2024-05-03T16:43:55.949381+0000","last_active":"2024-05-03T16:45:06.173472+0000","last_peered":"2024-05-03T16:45:06.173472+0000","last_clean":"2024-05-03T16:45:06.173472+0000","last_became_active":"2024-05-03T16:43:55.948536+0000","last_became_peered":"2024-05-03T16:43:55.948536+0000","last_unstale":"2024-05-03T16:45:06.173472+0000","last_undegraded":"2024-05-03T16:45:06.173472+0000","last_fullsized":"2024-05-03T16:45:06.173472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:27:17.081023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.100234+0000","last_change":"2024-05-03T16:43:55.936682+0000","last_active":"2024-05-03T16:45:06.100234+0000","last_peered":"2024-05-03T16:45:06.100234+0000","last_clean":"2024-05-03T16:45:06.100234+0000","last_became_active":"2024-05-03T16:43:55.936338+0000","last_became_peered":"2024-05-03T16:43:55.936338+0000","last_unstale":"2024-05-03T16:45:06.100234+0000","last_undegraded":"2024-05-03T16:45:06.100234+0000","last_fullsized":"2024-05-03T16:45:06.100234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T19:15:21.824271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.174318+0000","last_change":"2024-05-03T16:43:55.938357+0000","last_active":"2024-05-03T16:45:06.174318+0000","last_peered":"2024-05-03T16:45:06.174318+0000","last_clean":"2024-05-03T16:45:06.174318+0000","last_became_active":"2024-05-03T16:43:55.938027+0000","last_became_peered":"2024-05-03T16:43:55.938027+0000","last_unstale":"2024-05-03T16:45:06.174318+0000","last_undegraded":"2024-05-03T16:45:06.174318+0000","last_fullsized":"2024-05-03T16:45:06.174318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:03:03.537274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-03T16:45:06.105331+0000","last_change":"2024-05-03T16:43:55.944296+0000","last_active":"2024-05-03T16:45:06.105331+0000","last_peered":"2024-05-03T16:45:06.105331+0000","last_clean":"2024-05-03T16:45:06.105331+0000","last_became_active":"2024-05-03T16:43:55.943844+0000","last_became_peered":"2024-05-03T16:43:55.943844+0000","last_unstale":"2024-05-03T16:45:06.105331+0000","last_undegraded":"2024-05-03T16:45:06.105331+0000","last_fullsized":"2024-05-03T16:45:06.105331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T16:43:54.869250+0000","last_clean_scrub_stamp":"2024-05-03T16:43:54.869250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:50:25.594951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60940,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1264,"num_read_kb":702,"num_write":246,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":616,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":182820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645375,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":525657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841605,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28716,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716436,"statfs":{"total":95995035648,"available":95965630464,"internally_reserved":0,"allocated":1740800,"data_stored":1166532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005133,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32232,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712920,"statfs":{"total":95995035648,"available":95962030080,"internally_reserved":0,"allocated":1081344,"data_stored":529615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201363,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":525225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430300,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28648,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716504,"statfs":{"total":95995035648,"available":95965700096,"internally_reserved":0,"allocated":1671168,"data_stored":1122394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593826,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":521414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574980,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1122304,"data_stored":577193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738508,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":522479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411453,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32268,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712884,"statfs":{"total":95995035648,"available":95961993216,"internally_reserved":0,"allocated":1118208,"data_stored":575710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149813,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1064960,"data_stored":520731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953584,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1069056,"data_stored":525769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790058,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32816,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712336,"statfs":{"total":95995035648,"available":95961432064,"internally_reserved":0,"allocated":1679360,"data_stored":1117585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":56892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":55409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":55863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-03T16:47:34.974 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-03T16:47:34.974 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-03T16:47:34.974 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-03T16:47:34.975 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph health --format=json 2024-05-03T16:47:35.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:34 smithi146 ceph-mon[32357]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T16:47:35.426 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:47:35.936 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:35 smithi081 ceph-mon[28640]: pgmap v486: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:47:35.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:35 smithi134 ceph-mon[31708]: pgmap v486: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:47:36.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:35 smithi146 ceph-mon[32357]: pgmap v486: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:47:37.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.762+0000 7f660b200700 1 -- 172.21.15.81:0/630841559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f660c10a3a0 msgr2=0x7f660c116840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:37.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.762+0000 7f660b200700 1 --2- 172.21.15.81:0/630841559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f660c10a3a0 0x7f660c116840 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f660400b0a0 tx=0x7f660400b3b0 comp rx=0 tx=0).stop 2024-05-03T16:47:37.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.763+0000 7f660b200700 1 -- 172.21.15.81:0/630841559 shutdown_connections 2024-05-03T16:47:37.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.763+0000 7f660b200700 1 --2- 172.21.15.81:0/630841559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f660c10a3a0 0x7f660c116840 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:37.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.763+0000 7f660b200700 1 --2- 172.21.15.81:0/630841559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f660c10e8b0 0x7f660c10ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:37.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.763+0000 7f660b200700 1 --2- 172.21.15.81:0/630841559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f660c1099e0 0x7f660c109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:37.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.763+0000 7f660b200700 1 -- 172.21.15.81:0/630841559 >> 172.21.15.81:0/630841559 conn(0x7f660c079230 msgr2=0x7f660c1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:37.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.763+0000 7f660b200700 1 -- 172.21.15.81:0/630841559 shutdown_connections 2024-05-03T16:47:37.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.763+0000 7f660b200700 1 -- 172.21.15.81:0/630841559 wait complete. 2024-05-03T16:47:37.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.764+0000 7f660b200700 1 Processor -- start 2024-05-03T16:47:37.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.764+0000 7f660b200700 1 -- start start 2024-05-03T16:47:37.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.764+0000 7f660b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f660c1099e0 0x7f660c19ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:37.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.764+0000 7f660b200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f660c10a3a0 0x7f660c1a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.764+0000 7f660b200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f660c10e8b0 0x7f660c1a4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.764+0000 7f660b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f660c119a90 con 0x7f660c1099e0 2024-05-03T16:47:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.764+0000 7f660b200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f660c119910 con 0x7f660c10a3a0 2024-05-03T16:47:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.764+0000 7f660b200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f660c119c10 con 0x7f660c10e8b0 2024-05-03T16:47:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.765+0000 7f6609e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f660c1099e0 0x7f660c19ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.765+0000 7f6609e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f660c1099e0 0x7f660c19ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49448/0 (socket says 172.21.15.81:49448) 2024-05-03T16:47:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.765+0000 7f6609e00700 1 -- 172.21.15.81:0/2524143903 learned_addr learned my addr 172.21.15.81:0/2524143903 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.765+0000 7f6609400700 1 --2- 172.21.15.81:0/2524143903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f660c10a3a0 0x7f660c1a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.765+0000 7f660a800700 1 --2- 172.21.15.81:0/2524143903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f660c10e8b0 0x7f660c1a4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.765+0000 7f6609e00700 1 -- 172.21.15.81:0/2524143903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f660c10e8b0 msgr2=0x7f660c1a4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.765+0000 7f6609e00700 1 --2- 172.21.15.81:0/2524143903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f660c10e8b0 0x7f660c1a4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.765+0000 7f6609e00700 1 -- 172.21.15.81:0/2524143903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f660c10a3a0 msgr2=0x7f660c1a04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.765+0000 7f6609e00700 1 --2- 172.21.15.81:0/2524143903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f660c10a3a0 0x7f660c1a04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:37.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.765+0000 7f6609e00700 1 -- 172.21.15.81:0/2524143903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660c1a4f90 con 0x7f660c1099e0 2024-05-03T16:47:37.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.766+0000 7f6609e00700 1 --2- 172.21.15.81:0/2524143903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f660c1099e0 0x7f660c19ff80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00d950 tx=0x7f65fc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:37.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.766+0000 7f6602a00700 1 -- 172.21.15.81:0/2524143903 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc016070 con 0x7f660c1099e0 2024-05-03T16:47:37.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.766+0000 7f6602a00700 1 -- 172.21.15.81:0/2524143903 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65fc009dd0 con 0x7f660c1099e0 2024-05-03T16:47:37.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.766+0000 7f6602a00700 1 -- 172.21.15.81:0/2524143903 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc00f3c0 con 0x7f660c1099e0 2024-05-03T16:47:37.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.766+0000 7f660b200700 1 -- 172.21.15.81:0/2524143903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f660c1a5280 con 0x7f660c1099e0 2024-05-03T16:47:37.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.766+0000 7f660b200700 1 -- 172.21.15.81:0/2524143903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f660c1acb00 con 0x7f660c1099e0 2024-05-03T16:47:37.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.767+0000 7f660b200700 1 -- 172.21.15.81:0/2524143903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f660c06a190 con 0x7f660c1099e0 2024-05-03T16:47:37.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.769+0000 7f6602a00700 1 -- 172.21.15.81:0/2524143903 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f65fc019070 con 0x7f660c1099e0 2024-05-03T16:47:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.771+0000 7f6602a00700 1 --2- 172.21.15.81:0/2524143903 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f65f00b2990 0x7f65f00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.771+0000 7f6602a00700 1 -- 172.21.15.81:0/2524143903 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f65fc0e2260 con 0x7f660c1099e0 2024-05-03T16:47:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.771+0000 7f6609400700 1 --2- 172.21.15.81:0/2524143903 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f65f00b2990 0x7f65f00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:37.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.772+0000 7f6609400700 1 --2- 172.21.15.81:0/2524143903 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f65f00b2990 0x7f65f00b4e50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f660c1095b0 tx=0x7f65f800b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:37.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:37.774+0000 7f6602a00700 1 -- 172.21.15.81:0/2524143903 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f65fc0a9a70 con 0x7f660c1099e0 2024-05-03T16:47:37.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:37 smithi134 ceph-mon[31708]: pgmap v487: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:47:37.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:37 smithi081 ceph-mon[28640]: pgmap v487: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:47:38.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:38.058+0000 7f660b200700 1 -- 172.21.15.81:0/2524143903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f660c02e510 con 0x7f660c1099e0 2024-05-03T16:47:38.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:38.059+0000 7f6602a00700 1 -- 172.21.15.81:0/2524143903 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f65fc0a9370 con 0x7f660c1099e0 2024-05-03T16:47:38.061 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:47:38.061 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-03T16:47:38.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:37 smithi146 ceph-mon[32357]: pgmap v487: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:47:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:38.062+0000 7f660b200700 1 -- 172.21.15.81:0/2524143903 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f65f00b2990 msgr2=0x7f65f00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:38.062+0000 7f660b200700 1 --2- 172.21.15.81:0/2524143903 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f65f00b2990 0x7f65f00b4e50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f660c1095b0 tx=0x7f65f800b3c0 comp rx=0 tx=0).stop 2024-05-03T16:47:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:38.062+0000 7f660b200700 1 -- 172.21.15.81:0/2524143903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f660c1099e0 msgr2=0x7f660c19ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:38.062+0000 7f660b200700 1 --2- 172.21.15.81:0/2524143903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f660c1099e0 0x7f660c19ff80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00d950 tx=0x7f65fc00dc60 comp rx=0 tx=0).stop 2024-05-03T16:47:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:38.063+0000 7f660b200700 1 -- 172.21.15.81:0/2524143903 shutdown_connections 2024-05-03T16:47:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:38.063+0000 7f660b200700 1 --2- 172.21.15.81:0/2524143903 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f65f00b2990 0x7f65f00b4e50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:38.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:38.063+0000 7f660b200700 1 --2- 172.21.15.81:0/2524143903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f660c10e8b0 0x7f660c1a4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:38.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:38.063+0000 7f660b200700 1 --2- 172.21.15.81:0/2524143903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f660c1099e0 0x7f660c19ff80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:38.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:38.063+0000 7f660b200700 1 --2- 172.21.15.81:0/2524143903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f660c10a3a0 0x7f660c1a04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:38.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:38.063+0000 7f660b200700 1 -- 172.21.15.81:0/2524143903 >> 172.21.15.81:0/2524143903 conn(0x7f660c079230 msgr2=0x7f660c0798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:38.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:38.063+0000 7f660b200700 1 -- 172.21.15.81:0/2524143903 shutdown_connections 2024-05-03T16:47:38.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:38.063+0000 7f660b200700 1 -- 172.21.15.81:0/2524143903 wait complete. 2024-05-03T16:47:38.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:38 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2524143903' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-03T16:47:38.984 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:38 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2524143903' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-03T16:47:39.053 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-03T16:47:39.054 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T16:47:39.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:38 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2524143903' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-03T16:47:39.494 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:47:39.868 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:39 smithi081 ceph-mon[28640]: pgmap v488: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:39.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:39 smithi134 ceph-mon[31708]: pgmap v488: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:40.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:39 smithi146 ceph-mon[32357]: pgmap v488: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:41.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:41 smithi081 ceph-mon[28640]: pgmap v489: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:41.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:41 smithi134 ceph-mon[31708]: pgmap v489: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:42.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:41 smithi146 ceph-mon[32357]: pgmap v489: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:42.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.073+0000 7f8868400700 1 -- 172.21.15.81:0/707605745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8860103ef0 msgr2=0x7f88601103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:42.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.073+0000 7f8868400700 1 --2- 172.21.15.81:0/707605745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8860103ef0 0x7f88601103d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f885800b0a0 tx=0x7f885800b3b0 comp rx=0 tx=0).stop 2024-05-03T16:47:42.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.073+0000 7f8868400700 1 -- 172.21.15.81:0/707605745 shutdown_connections 2024-05-03T16:47:42.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.073+0000 7f8868400700 1 --2- 172.21.15.81:0/707605745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8860108460 0x7f8860108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:42.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.073+0000 7f8868400700 1 --2- 172.21.15.81:0/707605745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8860103ef0 0x7f88601103d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:42.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.073+0000 7f8868400700 1 --2- 172.21.15.81:0/707605745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8860103550 0x7f88601039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:42.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.073+0000 7f8868400700 1 -- 172.21.15.81:0/707605745 >> 172.21.15.81:0/707605745 conn(0x7f886007a600 msgr2=0x7f886007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:42.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.074+0000 7f8868400700 1 -- 172.21.15.81:0/707605745 shutdown_connections 2024-05-03T16:47:42.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.074+0000 7f8868400700 1 -- 172.21.15.81:0/707605745 wait complete. 2024-05-03T16:47:42.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.075+0000 7f8868400700 1 Processor -- start 2024-05-03T16:47:42.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.075+0000 7f8868400700 1 -- start start 2024-05-03T16:47:42.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.075+0000 7f8868400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8860103550 0x7f88600757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:42.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.075+0000 7f8868400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8860103ef0 0x7f8860075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:42.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.075+0000 7f8868400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8860108460 0x7f8860076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:42.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.075+0000 7f8868400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f88601135e0 con 0x7f8860103550 2024-05-03T16:47:42.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.075+0000 7f8868400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8860113460 con 0x7f8860103ef0 2024-05-03T16:47:42.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.075+0000 7f8868400700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8860113760 con 0x7f8860108460 2024-05-03T16:47:42.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.076+0000 7f8865a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8860103550 0x7f88600757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:42.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.076+0000 7f8865a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8860103550 0x7f88600757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49462/0 (socket says 172.21.15.81:49462) 2024-05-03T16:47:42.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.076+0000 7f8865a00700 1 -- 172.21.15.81:0/294921722 learned_addr learned my addr 172.21.15.81:0/294921722 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:42.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.076+0000 7f8865000700 1 --2- 172.21.15.81:0/294921722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8860103ef0 0x7f8860075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:42.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.076+0000 7f8866400700 1 --2- 172.21.15.81:0/294921722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8860108460 0x7f8860076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:42.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.076+0000 7f8865a00700 1 -- 172.21.15.81:0/294921722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8860108460 msgr2=0x7f8860076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:42.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.076+0000 7f8865a00700 1 --2- 172.21.15.81:0/294921722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8860108460 0x7f8860076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:42.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.076+0000 7f8865a00700 1 -- 172.21.15.81:0/294921722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8860103ef0 msgr2=0x7f8860075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:42.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.076+0000 7f8865a00700 1 --2- 172.21.15.81:0/294921722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8860103ef0 0x7f8860075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:42.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.076+0000 7f8865a00700 1 -- 172.21.15.81:0/294921722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88601a7ef0 con 0x7f8860103550 2024-05-03T16:47:42.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.077+0000 7f8865a00700 1 --2- 172.21.15.81:0/294921722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8860103550 0x7f88600757a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f885400d980 tx=0x7f885400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:42.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.077+0000 7f885e000700 1 -- 172.21.15.81:0/294921722 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8854017070 con 0x7f8860103550 2024-05-03T16:47:42.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.077+0000 7f8868400700 1 -- 172.21.15.81:0/294921722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88601a8180 con 0x7f8860103550 2024-05-03T16:47:42.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.077+0000 7f885e000700 1 -- 172.21.15.81:0/294921722 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8854010460 con 0x7f8860103550 2024-05-03T16:47:42.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.077+0000 7f885e000700 1 -- 172.21.15.81:0/294921722 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885400de60 con 0x7f8860103550 2024-05-03T16:47:42.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.077+0000 7f8868400700 1 -- 172.21.15.81:0/294921722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88601a86c0 con 0x7f8860103550 2024-05-03T16:47:42.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.078+0000 7f8868400700 1 -- 172.21.15.81:0/294921722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f886010ba90 con 0x7f8860103550 2024-05-03T16:47:42.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.081+0000 7f885e000700 1 -- 172.21.15.81:0/294921722 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f88540108c0 con 0x7f8860103550 2024-05-03T16:47:42.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.082+0000 7f885e000700 1 --2- 172.21.15.81:0/294921722 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f88480b2990 0x7f88480b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:42.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.082+0000 7f885e000700 1 -- 172.21.15.81:0/294921722 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f88540e2240 con 0x7f8860103550 2024-05-03T16:47:42.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.082+0000 7f8865000700 1 --2- 172.21.15.81:0/294921722 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f88480b2990 0x7f88480b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:42.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.083+0000 7f8865000700 1 --2- 172.21.15.81:0/294921722 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f88480b2990 0x7f88480b4e50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f884c005ea0 tx=0x7f884c005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:42.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.085+0000 7f885e000700 1 -- 172.21.15.81:0/294921722 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f88540a9a70 con 0x7f8860103550 2024-05-03T16:47:42.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.367+0000 7f8868400700 1 -- 172.21.15.81:0/294921722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f886006a190 con 0x7f8860103550 2024-05-03T16:47:42.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.369+0000 7f885e000700 1 -- 172.21.15.81:0/294921722 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f88540a9370 con 0x7f8860103550 2024-05-03T16:47:42.371 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:47:42.371 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/886382058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":886382058},{"type":"v1","addr":"172.21.15.81:6835","nonce":886382058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3285208793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3285208793},{"type":"v1","addr":"172.21.15.81:6837","nonce":3285208793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T16:43:58.734681+0000","modified":"2024-05-03T16:45:31.547191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34466,"mds_1":34439,"mds_2":34418,"mds_3":34400,"mds_4":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3710454674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3710454674},{"type":"v1","addr":"172.21.15.81:6839","nonce":3710454674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1174252889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1174252889},{"type":"v1","addr":"172.21.15.81:6841","nonce":1174252889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1900581381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1900581381},{"type":"v1","addr":"172.21.15.146:6833","nonce":1900581381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/3514751933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3514751933},{"type":"v1","addr":"172.21.15.146:6835","nonce":3514751933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6837/971814714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":971814714},{"type":"v1","addr":"172.21.15.146:6837","nonce":971814714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":32,"addr":"172.21.15.146:6839/3770312555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":3770312555},{"type":"v1","addr":"172.21.15.146:6839","nonce":3770312555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34400":{"gid":34400,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.134:6833/749392804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":749392804},{"type":"v1","addr":"172.21.15.134:6833","nonce":749392804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34418":{"gid":34418,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.134:6835/3681203129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3681203129},{"type":"v1","addr":"172.21.15.134:6835","nonce":3681203129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34439":{"gid":34439,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.134:6837/2915415754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2915415754},{"type":"v1","addr":"172.21.15.134:6837","nonce":2915415754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34466":{"gid":34466,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2061491127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2061491127},{"type":"v1","addr":"172.21.15.134:6839","nonce":2061491127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34466,"qdb_cluster":[24481,34400,34466,34439,34418]},"id":1}]} 2024-05-03T16:47:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.372+0000 7f8868400700 1 -- 172.21.15.81:0/294921722 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f88480b2990 msgr2=0x7f88480b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.372+0000 7f8868400700 1 --2- 172.21.15.81:0/294921722 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f88480b2990 0x7f88480b4e50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f884c005ea0 tx=0x7f884c005e30 comp rx=0 tx=0).stop 2024-05-03T16:47:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.373+0000 7f8868400700 1 -- 172.21.15.81:0/294921722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8860103550 msgr2=0x7f88600757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.373+0000 7f8868400700 1 --2- 172.21.15.81:0/294921722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8860103550 0x7f88600757a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f885400d980 tx=0x7f885400dd40 comp rx=0 tx=0).stop 2024-05-03T16:47:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.373+0000 7f8868400700 1 -- 172.21.15.81:0/294921722 shutdown_connections 2024-05-03T16:47:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.373+0000 7f8868400700 1 --2- 172.21.15.81:0/294921722 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f88480b2990 0x7f88480b4e50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.373+0000 7f8868400700 1 --2- 172.21.15.81:0/294921722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8860108460 0x7f8860076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.373+0000 7f8868400700 1 --2- 172.21.15.81:0/294921722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8860103550 0x7f88600757a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.373+0000 7f8868400700 1 --2- 172.21.15.81:0/294921722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8860103ef0 0x7f8860075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.373+0000 7f8868400700 1 -- 172.21.15.81:0/294921722 >> 172.21.15.81:0/294921722 conn(0x7f886007a600 msgr2=0x7f88601015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.373+0000 7f8868400700 1 -- 172.21.15.81:0/294921722 shutdown_connections 2024-05-03T16:47:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:42.373+0000 7f8868400700 1 -- 172.21.15.81:0/294921722 wait complete. 2024-05-03T16:47:42.376 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 29 2024-05-03T16:47:42.934 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:42 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/294921722' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:47:42.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:42 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/294921722' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:47:43.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:42 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/294921722' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:47:43.355 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T16:47:43.822 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:47:43.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:43 smithi134 ceph-mon[31708]: pgmap v490: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:47:43.974 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:43 smithi081 ceph-mon[28640]: pgmap v490: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:47:44.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:43 smithi146 ceph-mon[32357]: pgmap v490: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:47:45.868 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:45 smithi081 ceph-mon[28640]: pgmap v491: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:45.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:45 smithi134 ceph-mon[31708]: pgmap v491: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:46.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:45 smithi146 ceph-mon[32357]: pgmap v491: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.149+0000 7ff1f9200700 1 -- 172.21.15.81:0/3959213127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1f406bad0 msgr2=0x7ff1f410fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.149+0000 7ff1f9200700 1 --2- 172.21.15.81:0/3959213127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1f406bad0 0x7ff1f410fa10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009990 tx=0x7ff1e0009ca0 comp rx=0 tx=0).stop 2024-05-03T16:47:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.149+0000 7ff1f9200700 1 -- 172.21.15.81:0/3959213127 shutdown_connections 2024-05-03T16:47:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.149+0000 7ff1f9200700 1 --2- 172.21.15.81:0/3959213127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1f406b1b0 0x7ff1f406b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.149+0000 7ff1f9200700 1 --2- 172.21.15.81:0/3959213127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1f410ff50 0x7ff1f4112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.149+0000 7ff1f9200700 1 --2- 172.21.15.81:0/3959213127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1f406bad0 0x7ff1f410fa10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.149+0000 7ff1f9200700 1 -- 172.21.15.81:0/3959213127 >> 172.21.15.81:0/3959213127 conn(0x7ff1f4079350 msgr2=0x7ff1f4079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.149+0000 7ff1f9200700 1 -- 172.21.15.81:0/3959213127 shutdown_connections 2024-05-03T16:47:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.149+0000 7ff1f9200700 1 -- 172.21.15.81:0/3959213127 wait complete. 2024-05-03T16:47:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.150+0000 7ff1f9200700 1 Processor -- start 2024-05-03T16:47:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.151+0000 7ff1f9200700 1 -- start start 2024-05-03T16:47:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.151+0000 7ff1f9200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1f406b1b0 0x7ff1f419be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.151+0000 7ff1f9200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1f406bad0 0x7ff1f419c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.151+0000 7ff1f9200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1f410ff50 0x7ff1f41a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.151+0000 7ff1f9200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f4115850 con 0x7ff1f406b1b0 2024-05-03T16:47:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.151+0000 7ff1f9200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f41156d0 con 0x7ff1f406bad0 2024-05-03T16:47:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.151+0000 7ff1f9200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f41159d0 con 0x7ff1f410ff50 2024-05-03T16:47:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.151+0000 7ff1f1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1f406b1b0 0x7ff1f419be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.151+0000 7ff1f1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1f406b1b0 0x7ff1f419be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59232/0 (socket says 172.21.15.81:59232) 2024-05-03T16:47:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.151+0000 7ff1f1e00700 1 -- 172.21.15.81:0/3305073037 learned_addr learned my addr 172.21.15.81:0/3305073037 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.152+0000 7ff1f1400700 1 --2- 172.21.15.81:0/3305073037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1f406bad0 0x7ff1f419c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.152+0000 7ff1f2800700 1 --2- 172.21.15.81:0/3305073037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1f410ff50 0x7ff1f41a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.152+0000 7ff1f1e00700 1 -- 172.21.15.81:0/3305073037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1f410ff50 msgr2=0x7ff1f41a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.152+0000 7ff1f1e00700 1 --2- 172.21.15.81:0/3305073037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1f410ff50 0x7ff1f41a0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.152+0000 7ff1f1e00700 1 -- 172.21.15.81:0/3305073037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1f406bad0 msgr2=0x7ff1f419c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.152+0000 7ff1f1e00700 1 --2- 172.21.15.81:0/3305073037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1f406bad0 0x7ff1f419c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.152+0000 7ff1f1e00700 1 -- 172.21.15.81:0/3305073037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f41a0ea0 con 0x7ff1f406b1b0 2024-05-03T16:47:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.152+0000 7ff1f1400700 1 --2- 172.21.15.81:0/3305073037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1f406bad0 0x7ff1f419c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:47:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.152+0000 7ff1f1e00700 1 --2- 172.21.15.81:0/3305073037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1f406b1b0 0x7ff1f419be90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400b530 tx=0x7ff1e400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.153+0000 7ff1eaa00700 1 -- 172.21.15.81:0/3305073037 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4015020 con 0x7ff1f406b1b0 2024-05-03T16:47:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.153+0000 7ff1eaa00700 1 -- 172.21.15.81:0/3305073037 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1e4011cc0 con 0x7ff1f406b1b0 2024-05-03T16:47:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.153+0000 7ff1f9200700 1 -- 172.21.15.81:0/3305073037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f41a1190 con 0x7ff1f406b1b0 2024-05-03T16:47:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.153+0000 7ff1eaa00700 1 -- 172.21.15.81:0/3305073037 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4010d30 con 0x7ff1f406b1b0 2024-05-03T16:47:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.153+0000 7ff1f9200700 1 -- 172.21.15.81:0/3305073037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f41a8a10 con 0x7ff1f406b1b0 2024-05-03T16:47:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.154+0000 7ff1f9200700 1 -- 172.21.15.81:0/3305073037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1f406a190 con 0x7ff1f406b1b0 2024-05-03T16:47:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.156+0000 7ff1eaa00700 1 -- 172.21.15.81:0/3305073037 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff1e4018020 con 0x7ff1f406b1b0 2024-05-03T16:47:46.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.158+0000 7ff1eaa00700 1 --2- 172.21.15.81:0/3305073037 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff1d80b2990 0x7ff1d80b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:46.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.158+0000 7ff1eaa00700 1 -- 172.21.15.81:0/3305073037 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7ff1e40e1e60 con 0x7ff1f406b1b0 2024-05-03T16:47:46.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.158+0000 7ff1f1400700 1 --2- 172.21.15.81:0/3305073037 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff1d80b2990 0x7ff1d80b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.159+0000 7ff1f1400700 1 --2- 172.21.15.81:0/3305073037 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff1d80b2990 0x7ff1d80b4e50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0003760 tx=0x7ff1e0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:46.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.162+0000 7ff1eaa00700 1 -- 172.21.15.81:0/3305073037 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff1e401f020 con 0x7ff1f406b1b0 2024-05-03T16:47:46.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.444+0000 7ff1f9200700 1 -- 172.21.15.81:0/3305073037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1f419d1f0 con 0x7ff1f406b1b0 2024-05-03T16:47:46.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.446+0000 7ff1eaa00700 1 -- 172.21.15.81:0/3305073037 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7ff1e40a9720 con 0x7ff1f406b1b0 2024-05-03T16:47:46.447 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:47:46.448 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/886382058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":886382058},{"type":"v1","addr":"172.21.15.81:6835","nonce":886382058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3285208793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3285208793},{"type":"v1","addr":"172.21.15.81:6837","nonce":3285208793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T16:43:58.734681+0000","modified":"2024-05-03T16:45:31.547191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34466,"mds_1":34439,"mds_2":34418,"mds_3":34400,"mds_4":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3710454674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3710454674},{"type":"v1","addr":"172.21.15.81:6839","nonce":3710454674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1174252889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1174252889},{"type":"v1","addr":"172.21.15.81:6841","nonce":1174252889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1900581381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1900581381},{"type":"v1","addr":"172.21.15.146:6833","nonce":1900581381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/3514751933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3514751933},{"type":"v1","addr":"172.21.15.146:6835","nonce":3514751933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6837/971814714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":971814714},{"type":"v1","addr":"172.21.15.146:6837","nonce":971814714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":32,"addr":"172.21.15.146:6839/3770312555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":3770312555},{"type":"v1","addr":"172.21.15.146:6839","nonce":3770312555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34400":{"gid":34400,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.134:6833/749392804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":749392804},{"type":"v1","addr":"172.21.15.134:6833","nonce":749392804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34418":{"gid":34418,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.134:6835/3681203129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3681203129},{"type":"v1","addr":"172.21.15.134:6835","nonce":3681203129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34439":{"gid":34439,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.134:6837/2915415754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2915415754},{"type":"v1","addr":"172.21.15.134:6837","nonce":2915415754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34466":{"gid":34466,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2061491127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2061491127},{"type":"v1","addr":"172.21.15.134:6839","nonce":2061491127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34466,"qdb_cluster":[24481,34400,34466,34439,34418]},"id":1}]} 2024-05-03T16:47:46.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.449+0000 7ff1f9200700 1 -- 172.21.15.81:0/3305073037 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff1d80b2990 msgr2=0x7ff1d80b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:46.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.449+0000 7ff1f9200700 1 --2- 172.21.15.81:0/3305073037 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff1d80b2990 0x7ff1d80b4e50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0003760 tx=0x7ff1e0005fb0 comp rx=0 tx=0).stop 2024-05-03T16:47:46.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.449+0000 7ff1f9200700 1 -- 172.21.15.81:0/3305073037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1f406b1b0 msgr2=0x7ff1f419be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:46.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.449+0000 7ff1f9200700 1 --2- 172.21.15.81:0/3305073037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1f406b1b0 0x7ff1f419be90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400b530 tx=0x7ff1e400b8f0 comp rx=0 tx=0).stop 2024-05-03T16:47:46.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.449+0000 7ff1f9200700 1 -- 172.21.15.81:0/3305073037 shutdown_connections 2024-05-03T16:47:46.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.449+0000 7ff1f9200700 1 --2- 172.21.15.81:0/3305073037 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff1d80b2990 0x7ff1d80b4e50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:46.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.449+0000 7ff1f9200700 1 --2- 172.21.15.81:0/3305073037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1f410ff50 0x7ff1f41a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:46.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.449+0000 7ff1f9200700 1 --2- 172.21.15.81:0/3305073037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1f406b1b0 0x7ff1f419be90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:46.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.449+0000 7ff1f9200700 1 --2- 172.21.15.81:0/3305073037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1f406bad0 0x7ff1f419c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:46.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.449+0000 7ff1f9200700 1 -- 172.21.15.81:0/3305073037 >> 172.21.15.81:0/3305073037 conn(0x7ff1f4079350 msgr2=0x7ff1f41115a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:46.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.449+0000 7ff1f9200700 1 -- 172.21.15.81:0/3305073037 shutdown_connections 2024-05-03T16:47:46.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:46.449+0000 7ff1f9200700 1 -- 172.21.15.81:0/3305073037 wait complete. 2024-05-03T16:47:46.452 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 29 2024-05-03T16:47:46.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:46 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3305073037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:47:46.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:46 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3305073037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:47:47.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:46 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3305073037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:47:47.316 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T16:47:47.746 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:47:47.940 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:47 smithi081 ceph-mon[28640]: pgmap v492: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:47:47.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:47 smithi134 ceph-mon[31708]: pgmap v492: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:47:48.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:47 smithi146 ceph-mon[32357]: pgmap v492: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:47:49.846 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:49 smithi081 ceph-mon[28640]: pgmap v493: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:49.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:49 smithi134 ceph-mon[31708]: pgmap v493: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:50.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:49 smithi146 ceph-mon[32357]: pgmap v493: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:50.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.165+0000 7efddf200700 1 -- 172.21.15.81:0/3021730631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdd8109500 msgr2=0x7efdd81098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:50.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.165+0000 7efddf200700 1 --2- 172.21.15.81:0/3021730631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdd8109500 0x7efdd81098e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009990 tx=0x7efdc8009ca0 comp rx=0 tx=0).stop 2024-05-03T16:47:50.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.165+0000 7efddf200700 1 -- 172.21.15.81:0/3021730631 shutdown_connections 2024-05-03T16:47:50.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.165+0000 7efddf200700 1 --2- 172.21.15.81:0/3021730631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdd806c3d0 0x7efdd8110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:50.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.165+0000 7efddf200700 1 --2- 172.21.15.81:0/3021730631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdd8109500 0x7efdd81098e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:50.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.165+0000 7efddf200700 1 --2- 172.21.15.81:0/3021730631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdd806ba10 0x7efdd806be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:50.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.165+0000 7efddf200700 1 -- 172.21.15.81:0/3021730631 >> 172.21.15.81:0/3021730631 conn(0x7efdd8079310 msgr2=0x7efdd8079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:50.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.165+0000 7efddf200700 1 -- 172.21.15.81:0/3021730631 shutdown_connections 2024-05-03T16:47:50.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.165+0000 7efddf200700 1 -- 172.21.15.81:0/3021730631 wait complete. 2024-05-03T16:47:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.166+0000 7efddf200700 1 Processor -- start 2024-05-03T16:47:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.166+0000 7efddf200700 1 -- start start 2024-05-03T16:47:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.167+0000 7efddf200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdd806ba10 0x7efdd81a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.167+0000 7efddf200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdd806c3d0 0x7efdd81a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.167+0000 7efddf200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdd8109500 0x7efdd819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.167+0000 7efddf200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efdd81134c0 con 0x7efdd8109500 2024-05-03T16:47:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.167+0000 7efddf200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efdd8113340 con 0x7efdd806c3d0 2024-05-03T16:47:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.167+0000 7efddf200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efdd8113640 con 0x7efdd806ba10 2024-05-03T16:47:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.167+0000 7efddd200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdd8109500 0x7efdd819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.167+0000 7efddd200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdd8109500 0x7efdd819b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59250/0 (socket says 172.21.15.81:59250) 2024-05-03T16:47:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.167+0000 7efddd200700 1 -- 172.21.15.81:0/1480209436 learned_addr learned my addr 172.21.15.81:0/1480209436 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.167+0000 7efdd7e00700 1 --2- 172.21.15.81:0/1480209436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdd806ba10 0x7efdd81a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.167+0000 7efdd7400700 1 --2- 172.21.15.81:0/1480209436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdd806c3d0 0x7efdd81a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.168+0000 7efddd200700 1 -- 172.21.15.81:0/1480209436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdd806ba10 msgr2=0x7efdd81a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.168+0000 7efddd200700 1 --2- 172.21.15.81:0/1480209436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdd806ba10 0x7efdd81a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.168+0000 7efddd200700 1 -- 172.21.15.81:0/1480209436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdd806c3d0 msgr2=0x7efdd81a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.168+0000 7efddd200700 1 --2- 172.21.15.81:0/1480209436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdd806c3d0 0x7efdd81a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.168+0000 7efddd200700 1 -- 172.21.15.81:0/1480209436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd819c150 con 0x7efdd8109500 2024-05-03T16:47:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.168+0000 7efddd200700 1 --2- 172.21.15.81:0/1480209436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdd8109500 0x7efdd819b9f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efdd0007d70 tx=0x7efdd000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.168+0000 7efdd4c00700 1 -- 172.21.15.81:0/1480209436 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0016020 con 0x7efdd8109500 2024-05-03T16:47:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.169+0000 7efdd4c00700 1 -- 172.21.15.81:0/1480209436 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efdd000ad40 con 0x7efdd8109500 2024-05-03T16:47:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.169+0000 7efddf200700 1 -- 172.21.15.81:0/1480209436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd819c440 con 0x7efdd8109500 2024-05-03T16:47:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.169+0000 7efdd4c00700 1 -- 172.21.15.81:0/1480209436 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd00115e0 con 0x7efdd8109500 2024-05-03T16:47:50.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.169+0000 7efddf200700 1 -- 172.21.15.81:0/1480209436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd81a8700 con 0x7efdd8109500 2024-05-03T16:47:50.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.170+0000 7efddf200700 1 -- 172.21.15.81:0/1480209436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd806a190 con 0x7efdd8109500 2024-05-03T16:47:50.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.172+0000 7efdd4c00700 1 -- 172.21.15.81:0/1480209436 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7efdd0019020 con 0x7efdd8109500 2024-05-03T16:47:50.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.174+0000 7efdd4c00700 1 --2- 172.21.15.81:0/1480209436 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7efdbc0b2990 0x7efdbc0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:50.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.174+0000 7efdd4c00700 1 -- 172.21.15.81:0/1480209436 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7efdd00e2550 con 0x7efdd8109500 2024-05-03T16:47:50.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.174+0000 7efdd7e00700 1 --2- 172.21.15.81:0/1480209436 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7efdbc0b2990 0x7efdbc0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:50.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.175+0000 7efdd7e00700 1 --2- 172.21.15.81:0/1480209436 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7efdbc0b2990 0x7efdbc0b4e50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efdd819cb30 tx=0x7efdc8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.178+0000 7efdd4c00700 1 -- 172.21.15.81:0/1480209436 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7efdd0020020 con 0x7efdd8109500 2024-05-03T16:47:50.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.411+0000 7efddf200700 1 -- 172.21.15.81:0/1480209436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efdd81a8990 con 0x7efdd8109500 2024-05-03T16:47:50.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.418+0000 7efdd4c00700 1 -- 172.21.15.81:0/1480209436 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24767 (secure 0 0 0) 0x7efdd0083e20 con 0x7efdd8109500 2024-05-03T16:47:50.420 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:47:50.420 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":91,"fsid":"8988869e-096a-11ef-bc97-c7b262605968","created":"2024-05-03T16:32:56.440204+0000","modified":"2024-05-03T16:45:06.079032+0000","last_up_change":"2024-05-03T16:42:31.768974+0000","last_in_change":"2024-05-03T16:42:06.989688+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T16:37:18.271939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T16:43:50.469793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T16:43:54.708564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T16:44:09.064474+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"957b05dc-dfb9-4561-8800-b7ec0aba679d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6803","nonce":1639968055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6805","nonce":1639968055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6809","nonce":1639968055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6807","nonce":1639968055}]},"public_addr":"172.21.15.81:6803/1639968055","cluster_addr":"172.21.15.81:6805/1639968055","heartbeat_back_addr":"172.21.15.81:6809/1639968055","heartbeat_front_addr":"172.21.15.81:6807/1639968055","state":["exists","up"]},{"osd":1,"uuid":"3bb199cd-b4d0-4c67-b98f-2106336dd57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6801","nonce":1928503491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6803","nonce":1928503491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6807","nonce":1928503491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6805","nonce":1928503491}]},"public_addr":"172.21.15.134:6801/1928503491","cluster_addr":"172.21.15.134:6803/1928503491","heartbeat_back_addr":"172.21.15.134:6807/1928503491","heartbeat_front_addr":"172.21.15.134:6805/1928503491","state":["exists","up"]},{"osd":2,"uuid":"79ec9995-50e8-4eaf-935a-39a479925734","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6801","nonce":1233108455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6803","nonce":1233108455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6807","nonce":1233108455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6805","nonce":1233108455}]},"public_addr":"172.21.15.146:6801/1233108455","cluster_addr":"172.21.15.146:6803/1233108455","heartbeat_back_addr":"172.21.15.146:6807/1233108455","heartbeat_front_addr":"172.21.15.146:6805/1233108455","state":["exists","up"]},{"osd":3,"uuid":"2d38f4e7-73c3-4e70-9f87-d44da28db452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6811","nonce":4128709465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6813","nonce":4128709465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6817","nonce":4128709465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6815","nonce":4128709465}]},"public_addr":"172.21.15.81:6811/4128709465","cluster_addr":"172.21.15.81:6813/4128709465","heartbeat_back_addr":"172.21.15.81:6817/4128709465","heartbeat_front_addr":"172.21.15.81:6815/4128709465","state":["exists","up"]},{"osd":4,"uuid":"3837a136-a25b-4cb9-aa82-084b477c67d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6809","nonce":1498616220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6811","nonce":1498616220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6815","nonce":1498616220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6813","nonce":1498616220}]},"public_addr":"172.21.15.134:6809/1498616220","cluster_addr":"172.21.15.134:6811/1498616220","heartbeat_back_addr":"172.21.15.134:6815/1498616220","heartbeat_front_addr":"172.21.15.134:6813/1498616220","state":["exists","up"]},{"osd":5,"uuid":"2e783d2e-c181-41a9-97de-f17705a201bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6809","nonce":1276988922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6811","nonce":1276988922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6815","nonce":1276988922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6813","nonce":1276988922}]},"public_addr":"172.21.15.146:6809/1276988922","cluster_addr":"172.21.15.146:6811/1276988922","heartbeat_back_addr":"172.21.15.146:6815/1276988922","heartbeat_front_addr":"172.21.15.146:6813/1276988922","state":["exists","up"]},{"osd":6,"uuid":"6faebdbf-7820-42e5-b07c-15db11f278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6819","nonce":3319125020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6821","nonce":3319125020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6825","nonce":3319125020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6823","nonce":3319125020}]},"public_addr":"172.21.15.81:6819/3319125020","cluster_addr":"172.21.15.81:6821/3319125020","heartbeat_back_addr":"172.21.15.81:6825/3319125020","heartbeat_front_addr":"172.21.15.81:6823/3319125020","state":["exists","up"]},{"osd":7,"uuid":"ec4b6b84-6c5f-4d07-a747-06610b2cd345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6817","nonce":3241993481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6819","nonce":3241993481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6823","nonce":3241993481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6821","nonce":3241993481}]},"public_addr":"172.21.15.134:6817/3241993481","cluster_addr":"172.21.15.134:6819/3241993481","heartbeat_back_addr":"172.21.15.134:6823/3241993481","heartbeat_front_addr":"172.21.15.134:6821/3241993481","state":["exists","up"]},{"osd":8,"uuid":"02b1b0fd-837c-4c29-bedb-54fa2ee7531d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6817","nonce":2423161684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6819","nonce":2423161684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6823","nonce":2423161684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6821","nonce":2423161684}]},"public_addr":"172.21.15.146:6817/2423161684","cluster_addr":"172.21.15.146:6819/2423161684","heartbeat_back_addr":"172.21.15.146:6823/2423161684","heartbeat_front_addr":"172.21.15.146:6821/2423161684","state":["exists","up"]},{"osd":9,"uuid":"46713a8e-743d-44d5-babe-c01d3179afcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6827","nonce":873909886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6829","nonce":873909886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6833","nonce":873909886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6831","nonce":873909886}]},"public_addr":"172.21.15.81:6827/873909886","cluster_addr":"172.21.15.81:6829/873909886","heartbeat_back_addr":"172.21.15.81:6833/873909886","heartbeat_front_addr":"172.21.15.81:6831/873909886","state":["exists","up"]},{"osd":10,"uuid":"12fcae89-30af-436b-a513-3998303da93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6825","nonce":1183629038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6827","nonce":1183629038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6831","nonce":1183629038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6829","nonce":1183629038}]},"public_addr":"172.21.15.134:6825/1183629038","cluster_addr":"172.21.15.134:6827/1183629038","heartbeat_back_addr":"172.21.15.134:6831/1183629038","heartbeat_front_addr":"172.21.15.134:6829/1183629038","state":["exists","up"]},{"osd":11,"uuid":"a543f42c-61da-4a93-b16b-a2891a4ef873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6825","nonce":2627233639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6827","nonce":2627233639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6831","nonce":2627233639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6829","nonce":2627233639}]},"public_addr":"172.21.15.146:6825/2627233639","cluster_addr":"172.21.15.146:6827/2627233639","heartbeat_back_addr":"172.21.15.146:6831/2627233639","heartbeat_front_addr":"172.21.15.146:6829/2627233639","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:08.411954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:41.459869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:15.068172+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:49.711273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:23.231811+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:57.917964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:39:32.982397+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:07.434610+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:43.606108+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:19.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:54.917284+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:42:30.525217+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6801/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/2237510960":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6801/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/3199433706":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1689714816":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/2777950369":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/1982866220":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1112375028":"2024-05-04T16:33:30.274051+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T16:47:50.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.422+0000 7efddf200700 1 -- 172.21.15.81:0/1480209436 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7efdbc0b2990 msgr2=0x7efdbc0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:50.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.422+0000 7efddf200700 1 --2- 172.21.15.81:0/1480209436 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7efdbc0b2990 0x7efdbc0b4e50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efdd819cb30 tx=0x7efdc8005960 comp rx=0 tx=0).stop 2024-05-03T16:47:50.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.422+0000 7efddf200700 1 -- 172.21.15.81:0/1480209436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdd8109500 msgr2=0x7efdd819b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:50.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.422+0000 7efddf200700 1 --2- 172.21.15.81:0/1480209436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdd8109500 0x7efdd819b9f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efdd0007d70 tx=0x7efdd000a340 comp rx=0 tx=0).stop 2024-05-03T16:47:50.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.422+0000 7efddf200700 1 -- 172.21.15.81:0/1480209436 shutdown_connections 2024-05-03T16:47:50.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.422+0000 7efddf200700 1 --2- 172.21.15.81:0/1480209436 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7efdbc0b2990 0x7efdbc0b4e50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:50.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.422+0000 7efddf200700 1 --2- 172.21.15.81:0/1480209436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdd806ba10 0x7efdd81a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:50.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.422+0000 7efddf200700 1 --2- 172.21.15.81:0/1480209436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdd8109500 0x7efdd819b9f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:50.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.422+0000 7efddf200700 1 --2- 172.21.15.81:0/1480209436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdd806c3d0 0x7efdd81a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:50.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.422+0000 7efddf200700 1 -- 172.21.15.81:0/1480209436 >> 172.21.15.81:0/1480209436 conn(0x7efdd8079310 msgr2=0x7efdd8100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:50.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.422+0000 7efddf200700 1 -- 172.21.15.81:0/1480209436 shutdown_connections 2024-05-03T16:47:50.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:50.423+0000 7efddf200700 1 -- 172.21.15.81:0/1480209436 wait complete. 2024-05-03T16:47:50.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:50 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/1480209436' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:47:50.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:50 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1480209436' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:47:51.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:50 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/1480209436' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:47:51.398 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T16:47:51.853 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:47:51.964 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:51 smithi146 ceph-mon[32357]: pgmap v494: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:51.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:51 smithi134 ceph-mon[31708]: pgmap v494: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:51.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:51 smithi081 ceph-mon[28640]: pgmap v494: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:53.939 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:53 smithi081 ceph-mon[28640]: pgmap v495: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:47:53.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:53 smithi134 ceph-mon[31708]: pgmap v495: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:47:54.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:53 smithi146 ceph-mon[32357]: pgmap v495: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:47:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.225+0000 7f8e3ec00700 1 -- 172.21.15.81:0/301693631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e3810fb60 msgr2=0x7f8e3810ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.225+0000 7f8e3ec00700 1 --2- 172.21.15.81:0/301693631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e3810fb60 0x7f8e3810ff40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009990 tx=0x7f8e28009ca0 comp rx=0 tx=0).stop 2024-05-03T16:47:54.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.225+0000 7f8e3ec00700 1 -- 172.21.15.81:0/301693631 shutdown_connections 2024-05-03T16:47:54.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.225+0000 7f8e3ec00700 1 --2- 172.21.15.81:0/301693631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e3810a490 0x7f8e381169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:54.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.225+0000 7f8e3ec00700 1 --2- 172.21.15.81:0/301693631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e3810fb60 0x7f8e3810ff40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:54.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.225+0000 7f8e3ec00700 1 --2- 172.21.15.81:0/301693631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e38109ad0 0x7f8e38109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:54.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.225+0000 7f8e3ec00700 1 -- 172.21.15.81:0/301693631 >> 172.21.15.81:0/301693631 conn(0x7f8e38076c70 msgr2=0x7f8e381082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:54.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.225+0000 7f8e3ec00700 1 -- 172.21.15.81:0/301693631 shutdown_connections 2024-05-03T16:47:54.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.225+0000 7f8e3ec00700 1 -- 172.21.15.81:0/301693631 wait complete. 2024-05-03T16:47:54.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.226+0000 7f8e3ec00700 1 Processor -- start 2024-05-03T16:47:54.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.226+0000 7f8e3ec00700 1 -- start start 2024-05-03T16:47:54.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.227+0000 7f8e3ec00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e38109ad0 0x7f8e381a0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:54.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.227+0000 7f8e3ec00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e3810a490 0x7f8e381a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:54.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.227+0000 7f8e3ec00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e3810fb60 0x7f8e381a4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:54.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.227+0000 7f8e3ec00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8e38119bb0 con 0x7f8e38109ad0 2024-05-03T16:47:54.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.227+0000 7f8e3ec00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8e38119a30 con 0x7f8e3810fb60 2024-05-03T16:47:54.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.227+0000 7f8e3ec00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8e38119d30 con 0x7f8e3810a490 2024-05-03T16:47:54.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.227+0000 7f8e37e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e38109ad0 0x7f8e381a0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:54.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.227+0000 7f8e37e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e38109ad0 0x7f8e381a0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59266/0 (socket says 172.21.15.81:59266) 2024-05-03T16:47:54.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.227+0000 7f8e37e00700 1 -- 172.21.15.81:0/3746787363 learned_addr learned my addr 172.21.15.81:0/3746787363 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.228+0000 7f8e37400700 1 --2- 172.21.15.81:0/3746787363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e3810a490 0x7f8e381a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.228+0000 7f8e3cc00700 1 --2- 172.21.15.81:0/3746787363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e3810fb60 0x7f8e381a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.228+0000 7f8e37e00700 1 -- 172.21.15.81:0/3746787363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e3810a490 msgr2=0x7f8e381a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.228+0000 7f8e37e00700 1 --2- 172.21.15.81:0/3746787363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e3810a490 0x7f8e381a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.228+0000 7f8e37e00700 1 -- 172.21.15.81:0/3746787363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e3810fb60 msgr2=0x7f8e381a4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.228+0000 7f8e37e00700 1 --2- 172.21.15.81:0/3746787363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e3810fb60 0x7f8e381a4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.228+0000 7f8e37e00700 1 -- 172.21.15.81:0/3746787363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e381a5050 con 0x7f8e38109ad0 2024-05-03T16:47:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.228+0000 7f8e3cc00700 1 --2- 172.21.15.81:0/3746787363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e3810fb60 0x7f8e381a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:47:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.228+0000 7f8e37e00700 1 --2- 172.21.15.81:0/3746787363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e38109ad0 0x7f8e381a0040 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8e28005910 tx=0x7f8e280047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.228+0000 7f8e34c00700 1 -- 172.21.15.81:0/3746787363 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e28027070 con 0x7f8e38109ad0 2024-05-03T16:47:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.229+0000 7f8e3ec00700 1 -- 172.21.15.81:0/3746787363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e381a52e0 con 0x7f8e38109ad0 2024-05-03T16:47:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.229+0000 7f8e34c00700 1 -- 172.21.15.81:0/3746787363 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e2800fc00 con 0x7f8e38109ad0 2024-05-03T16:47:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.229+0000 7f8e34c00700 1 -- 172.21.15.81:0/3746787363 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e28022d40 con 0x7f8e38109ad0 2024-05-03T16:47:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.229+0000 7f8e3ec00700 1 -- 172.21.15.81:0/3746787363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e381acbc0 con 0x7f8e38109ad0 2024-05-03T16:47:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.230+0000 7f8e3ec00700 1 -- 172.21.15.81:0/3746787363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e3806a190 con 0x7f8e38109ad0 2024-05-03T16:47:54.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.234+0000 7f8e34c00700 1 -- 172.21.15.81:0/3746787363 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f8e2802a070 con 0x7f8e38109ad0 2024-05-03T16:47:54.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.235+0000 7f8e34c00700 1 --2- 172.21.15.81:0/3746787363 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8e1c0b2910 0x7f8e1c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:54.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.236+0000 7f8e34c00700 1 -- 172.21.15.81:0/3746787363 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f8e280e3c60 con 0x7f8e38109ad0 2024-05-03T16:47:54.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.236+0000 7f8e37400700 1 --2- 172.21.15.81:0/3746787363 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8e1c0b2910 0x7f8e1c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:54.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.237+0000 7f8e37400700 1 --2- 172.21.15.81:0/3746787363 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8e1c0b2910 0x7f8e1c0b4dd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8e24005ea0 tx=0x7f8e24005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:54.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.238+0000 7f8e34c00700 1 -- 172.21.15.81:0/3746787363 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8e28031070 con 0x7f8e38109ad0 2024-05-03T16:47:54.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.519+0000 7f8e3ec00700 1 -- 172.21.15.81:0/3746787363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e3802e510 con 0x7f8e38109ad0 2024-05-03T16:47:54.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.521+0000 7f8e34c00700 1 -- 172.21.15.81:0/3746787363 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f8e28013070 con 0x7f8e38109ad0 2024-05-03T16:47:54.524 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:47:54.524 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/886382058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":886382058},{"type":"v1","addr":"172.21.15.81:6835","nonce":886382058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3285208793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3285208793},{"type":"v1","addr":"172.21.15.81:6837","nonce":3285208793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T16:43:58.734681+0000","modified":"2024-05-03T16:45:31.547191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34466,"mds_1":34439,"mds_2":34418,"mds_3":34400,"mds_4":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3710454674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3710454674},{"type":"v1","addr":"172.21.15.81:6839","nonce":3710454674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1174252889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1174252889},{"type":"v1","addr":"172.21.15.81:6841","nonce":1174252889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1900581381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1900581381},{"type":"v1","addr":"172.21.15.146:6833","nonce":1900581381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/3514751933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3514751933},{"type":"v1","addr":"172.21.15.146:6835","nonce":3514751933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6837/971814714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":971814714},{"type":"v1","addr":"172.21.15.146:6837","nonce":971814714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":32,"addr":"172.21.15.146:6839/3770312555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":3770312555},{"type":"v1","addr":"172.21.15.146:6839","nonce":3770312555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34400":{"gid":34400,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.134:6833/749392804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":749392804},{"type":"v1","addr":"172.21.15.134:6833","nonce":749392804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34418":{"gid":34418,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.134:6835/3681203129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3681203129},{"type":"v1","addr":"172.21.15.134:6835","nonce":3681203129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34439":{"gid":34439,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.134:6837/2915415754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2915415754},{"type":"v1","addr":"172.21.15.134:6837","nonce":2915415754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34466":{"gid":34466,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2061491127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2061491127},{"type":"v1","addr":"172.21.15.134:6839","nonce":2061491127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34466,"qdb_cluster":[24481,34400,34466,34439,34418]},"id":1}]} 2024-05-03T16:47:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.524+0000 7f8e3ec00700 1 -- 172.21.15.81:0/3746787363 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8e1c0b2910 msgr2=0x7f8e1c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.524+0000 7f8e3ec00700 1 --2- 172.21.15.81:0/3746787363 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8e1c0b2910 0x7f8e1c0b4dd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8e24005ea0 tx=0x7f8e24005e30 comp rx=0 tx=0).stop 2024-05-03T16:47:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.524+0000 7f8e3ec00700 1 -- 172.21.15.81:0/3746787363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e38109ad0 msgr2=0x7f8e381a0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.524+0000 7f8e3ec00700 1 --2- 172.21.15.81:0/3746787363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e38109ad0 0x7f8e381a0040 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8e28005910 tx=0x7f8e280047b0 comp rx=0 tx=0).stop 2024-05-03T16:47:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.525+0000 7f8e3ec00700 1 -- 172.21.15.81:0/3746787363 shutdown_connections 2024-05-03T16:47:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.525+0000 7f8e3ec00700 1 --2- 172.21.15.81:0/3746787363 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8e1c0b2910 0x7f8e1c0b4dd0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.525+0000 7f8e3ec00700 1 --2- 172.21.15.81:0/3746787363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e3810fb60 0x7f8e381a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.525+0000 7f8e3ec00700 1 --2- 172.21.15.81:0/3746787363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e38109ad0 0x7f8e381a0040 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.525+0000 7f8e3ec00700 1 --2- 172.21.15.81:0/3746787363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e3810a490 0x7f8e381a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.525+0000 7f8e3ec00700 1 -- 172.21.15.81:0/3746787363 >> 172.21.15.81:0/3746787363 conn(0x7f8e38076c70 msgr2=0x7f8e38077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.525+0000 7f8e3ec00700 1 -- 172.21.15.81:0/3746787363 shutdown_connections 2024-05-03T16:47:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:54.525+0000 7f8e3ec00700 1 -- 172.21.15.81:0/3746787363 wait complete. 2024-05-03T16:47:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 29 2024-05-03T16:47:54.902 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:54 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3746787363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:47:54.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:54 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3746787363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:47:55.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:54 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3746787363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:47:55.508 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-03T16:43:58.734681+0000', 'modified': '2024-05-03T16:45:31.547191+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 34466, 'mds_1': 34439, 'mds_2': 34418, 'mds_3': 34400, 'mds_4': 24481}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14589': {'gid': 14589, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6839/3710454674', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 3710454674}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 3710454674}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14595': {'gid': 14595, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6841/1174252889', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6840', 'nonce': 1174252889}, {'type': 'v1', 'addr': '172.21.15.81:6841', 'nonce': 1174252889}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24418': {'gid': 24418, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6833/1900581381', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 1900581381}, {'type': 'v1', 'addr': '172.21.15.146:6833', 'nonce': 1900581381}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6835/3514751933', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 3514751933}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 3514751933}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6837/971814714', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6836', 'nonce': 971814714}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 971814714}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'i', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 32, 'addr': '172.21.15.146:6839/3770312555', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6838', 'nonce': 3770312555}, {'type': 'v1', 'addr': '172.21.15.146:6839', 'nonce': 3770312555}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34400': {'gid': 34400, 'name': 'k', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 39, 'addr': '172.21.15.134:6833/749392804', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6832', 'nonce': 749392804}, {'type': 'v1', 'addr': '172.21.15.134:6833', 'nonce': 749392804}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34418': {'gid': 34418, 'name': 'e', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 36, 'addr': '172.21.15.134:6835/3681203129', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 3681203129}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 3681203129}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34439': {'gid': 34439, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 32, 'addr': '172.21.15.134:6837/2915415754', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6836', 'nonce': 2915415754}, {'type': 'v1', 'addr': '172.21.15.134:6837', 'nonce': 2915415754}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34466': {'gid': 34466, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.134:6839/2061491127', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6838', 'nonce': 2061491127}, {'type': 'v1', 'addr': '172.21.15.134:6839', 'nonce': 2061491127}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34466, 'qdb_cluster': [24481, 34400, 34466, 34439, 34418]} 2024-05-03T16:47:55.508 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-03T16:47:55.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell mds.i status 2024-05-03T16:47:55.955 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:47:55.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:55 smithi134 ceph-mon[31708]: pgmap v496: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:55.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:55 smithi081 ceph-mon[28640]: pgmap v496: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:56.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:55 smithi146 ceph-mon[32357]: pgmap v496: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:57.887 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:57 smithi081 ceph-mon[28640]: pgmap v497: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:47:57.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:57 smithi134 ceph-mon[31708]: pgmap v497: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:47:58.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:57 smithi146 ceph-mon[32357]: pgmap v497: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:47:58.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.455+0000 7f34e8200700 1 -- 172.21.15.81:0/3031983200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34e006bbb0 msgr2=0x7f34e006c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:58.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.455+0000 7f34e8200700 1 --2- 172.21.15.81:0/3031983200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34e006bbb0 0x7f34e006c030 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009990 tx=0x7f34cc009ca0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.455+0000 7f34e8200700 1 -- 172.21.15.81:0/3031983200 shutdown_connections 2024-05-03T16:47:58.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.455+0000 7f34e8200700 1 --2- 172.21.15.81:0/3031983200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e006c570 0x7f34e0110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.455+0000 7f34e8200700 1 --2- 172.21.15.81:0/3031983200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34e0109540 0x7f34e0109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.455+0000 7f34e8200700 1 --2- 172.21.15.81:0/3031983200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34e006bbb0 0x7f34e006c030 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.455+0000 7f34e8200700 1 -- 172.21.15.81:0/3031983200 >> 172.21.15.81:0/3031983200 conn(0x7f34e0078410 msgr2=0x7f34e0078820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.455+0000 7f34e8200700 1 -- 172.21.15.81:0/3031983200 shutdown_connections 2024-05-03T16:47:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.455+0000 7f34e8200700 1 -- 172.21.15.81:0/3031983200 wait complete. 2024-05-03T16:47:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.457+0000 7f34e8200700 1 Processor -- start 2024-05-03T16:47:58.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.457+0000 7f34e8200700 1 -- start start 2024-05-03T16:47:58.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.457+0000 7f34e8200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34e006bbb0 0x7f34e01a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:58.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.457+0000 7f34e8200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34e006c570 0x7f34e01a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:58.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.457+0000 7f34e8200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e0109540 0x7f34e019bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:58.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.457+0000 7f34e8200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f34e0113520 con 0x7f34e006bbb0 2024-05-03T16:47:58.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.457+0000 7f34e8200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f34e01133a0 con 0x7f34e006c570 2024-05-03T16:47:58.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.457+0000 7f34e8200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f34e01136a0 con 0x7f34e0109540 2024-05-03T16:47:58.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.458+0000 7f34e5800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34e006bbb0 0x7f34e01a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:58.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.458+0000 7f34e5800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34e006bbb0 0x7f34e01a1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33132/0 (socket says 172.21.15.81:33132) 2024-05-03T16:47:58.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.458+0000 7f34e5800700 1 -- 172.21.15.81:0/2988970902 learned_addr learned my addr 172.21.15.81:0/2988970902 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:58.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.458+0000 7f34e4e00700 1 --2- 172.21.15.81:0/2988970902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34e006c570 0x7f34e01a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:58.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.458+0000 7f34e5800700 1 -- 172.21.15.81:0/2988970902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e0109540 msgr2=0x7f34e019bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:58.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.458+0000 7f34e6200700 1 --2- 172.21.15.81:0/2988970902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e0109540 0x7f34e019bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.458+0000 7f34e5800700 1 --2- 172.21.15.81:0/2988970902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e0109540 0x7f34e019bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.458+0000 7f34e5800700 1 -- 172.21.15.81:0/2988970902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34e006c570 msgr2=0x7f34e01a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.458+0000 7f34e5800700 1 --2- 172.21.15.81:0/2988970902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34e006c570 0x7f34e01a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.458+0000 7f34e5800700 1 -- 172.21.15.81:0/2988970902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e019c260 con 0x7f34e006bbb0 2024-05-03T16:47:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.459+0000 7f34e5800700 1 --2- 172.21.15.81:0/2988970902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34e006bbb0 0x7f34e01a1940 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f34d400c9b0 tx=0x7f34d400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.459+0000 7f34de000700 1 -- 172.21.15.81:0/2988970902 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4007b00 con 0x7f34e006bbb0 2024-05-03T16:47:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.459+0000 7f34de000700 1 -- 172.21.15.81:0/2988970902 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34d4007ca0 con 0x7f34e006bbb0 2024-05-03T16:47:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.459+0000 7f34de000700 1 -- 172.21.15.81:0/2988970902 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4018660 con 0x7f34e006bbb0 2024-05-03T16:47:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.459+0000 7f34e8200700 1 -- 172.21.15.81:0/2988970902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e019c550 con 0x7f34e006bbb0 2024-05-03T16:47:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.459+0000 7f34e8200700 1 -- 172.21.15.81:0/2988970902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e01a8810 con 0x7f34e006bbb0 2024-05-03T16:47:58.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.463+0000 7f34de000700 1 -- 172.21.15.81:0/2988970902 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f34d400f450 con 0x7f34e006bbb0 2024-05-03T16:47:58.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.464+0000 7f34f2ab4b80 1 Processor -- start 2024-05-03T16:47:58.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.464+0000 7f34f2ab4b80 1 -- start start 2024-05-03T16:47:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.464+0000 7f34f2ab4b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee408e0 0x55b33ee40cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.464+0000 7f34f2ab4b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee41200 0x55b33ee3aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.464+0000 7f34f2ab4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee3b500 0x55b33ee3b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.464+0000 7f34f2ab4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b33ed8d9d0 con 0x55b33ee3b500 2024-05-03T16:47:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.464+0000 7f34f2ab4b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b33ed2b710 con 0x55b33ee408e0 2024-05-03T16:47:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.464+0000 7f34f2ab4b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b33ed89990 con 0x55b33ee41200 2024-05-03T16:47:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.465+0000 7f34de000700 1 --2- 172.21.15.81:0/2988970902 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f34c80b2990 0x7f34c80b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.465+0000 7f34e4e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee3b500 0x55b33ee3b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.465+0000 7f34e4e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee3b500 0x55b33ee3b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33144/0 (socket says 172.21.15.81:33144) 2024-05-03T16:47:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.465+0000 7f34e4e00700 1 -- 172.21.15.81:0/3734970127 learned_addr learned my addr 172.21.15.81:0/3734970127 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.465+0000 7f34e5800700 1 --2- 172.21.15.81:0/3734970127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee41200 0x55b33ee3aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.465+0000 7f34e6200700 1 --2- 172.21.15.81:0/3734970127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee408e0 0x55b33ee40cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:58.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.465+0000 7f34de000700 1 -- 172.21.15.81:0/2988970902 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f34d40e2740 con 0x7f34e006bbb0 2024-05-03T16:47:58.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.465+0000 7f34e4e00700 1 -- 172.21.15.81:0/3734970127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee41200 msgr2=0x55b33ee3aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:47:58.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.465+0000 7f34e4e00700 1 --2- 172.21.15.81:0/3734970127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee41200 0x55b33ee3aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.465+0000 7f34e4e00700 1 -- 172.21.15.81:0/3734970127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee408e0 msgr2=0x55b33ee40cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:47:58.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.465+0000 7f34e4e00700 1 --2- 172.21.15.81:0/3734970127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee408e0 0x55b33ee40cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.465+0000 7f34e4e00700 1 -- 172.21.15.81:0/3734970127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b33ecda880 con 0x55b33ee3b500 2024-05-03T16:47:58.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.465+0000 7f34e6200700 1 --2- 172.21.15.81:0/2988970902 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f34c80b2990 0x7f34c80b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:58.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.465+0000 7f34e4e00700 1 --2- 172.21.15.81:0/3734970127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee3b500 0x55b33ee3b980 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f34cc005c80 tx=0x7f34cc003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82caa416808d43b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:58.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.466+0000 7f34d2a00700 1 -- 172.21.15.81:0/3734970127 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc027070 con 0x55b33ee3b500 2024-05-03T16:47:58.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.466+0000 7f34d2a00700 1 -- 172.21.15.81:0/3734970127 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34cc005070 con 0x55b33ee3b500 2024-05-03T16:47:58.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.466+0000 7f34d2a00700 1 -- 172.21.15.81:0/3734970127 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc003ab0 con 0x55b33ee3b500 2024-05-03T16:47:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.467+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/3734970127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee3b500 msgr2=0x55b33ee3b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.467+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/3734970127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee3b500 0x55b33ee3b980 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f34cc005c80 tx=0x7f34cc003680 comp rx=0 tx=0).stop 2024-05-03T16:47:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.467+0000 7f34e6200700 1 --2- 172.21.15.81:0/2988970902 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f34c80b2990 0x7f34c80b4e50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f34d800f170 tx=0x7f34d8007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.467+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/3734970127 shutdown_connections 2024-05-03T16:47:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.467+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/3734970127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee3b500 0x55b33ee3b980 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.467+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/3734970127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee408e0 0x55b33ee40cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.467+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/3734970127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee41200 0x55b33ee3aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.467+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/3734970127 >> 172.21.15.81:0/3734970127 conn(0x55b33edb3680 msgr2=0x55b33ee358b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.467+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/3734970127 shutdown_connections 2024-05-03T16:47:58.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.467+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/3734970127 wait complete. 2024-05-03T16:47:58.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.468+0000 7f34f2ab4b80 1 -- start start 2024-05-03T16:47:58.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.468+0000 7f34f2ab4b80 1 Processor -- start 2024-05-03T16:47:58.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.469+0000 7f34f2ab4b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee3b500 0x55b33ee46e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:58.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.469+0000 7f34f2ab4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee408e0 0x55b33ee44220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:58.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.469+0000 7f34f2ab4b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee41200 0x55b33ee44760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:58.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.469+0000 7f34f2ab4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b33ee47c50 con 0x55b33ee408e0 2024-05-03T16:47:58.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.469+0000 7f34f2ab4b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b33ecf3ad0 con 0x55b33ee41200 2024-05-03T16:47:58.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.469+0000 7f34f2ab4b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b33ee47dd0 con 0x55b33ee3b500 2024-05-03T16:47:58.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.469+0000 7f34f2ab4b80 10 client.0 _ll_register_callbacks cb 0x55b33ed34c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:47:58.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.469+0000 7f34e4e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee408e0 0x55b33ee44220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:58.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.469+0000 7f34e4e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee408e0 0x55b33ee44220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33154/0 (socket says 172.21.15.81:33154) 2024-05-03T16:47:58.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.469+0000 7f34e4e00700 1 -- 172.21.15.81:0/3304249081 learned_addr learned my addr 172.21.15.81:0/3304249081 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:58.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.469+0000 7f34e6200700 1 --2- 172.21.15.81:0/3304249081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee41200 0x55b33ee44760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:58.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.469+0000 7f34e5800700 1 --2- 172.21.15.81:0/3304249081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee3b500 0x55b33ee46e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:58.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.469+0000 7f34e4e00700 1 -- 172.21.15.81:0/3304249081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee3b500 msgr2=0x55b33ee46e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:47:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.469+0000 7f34e4e00700 1 --2- 172.21.15.81:0/3304249081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee3b500 0x55b33ee46e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.469+0000 7f34e4e00700 1 -- 172.21.15.81:0/3304249081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee41200 msgr2=0x55b33ee44760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:47:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.469+0000 7f34e4e00700 1 --2- 172.21.15.81:0/3304249081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee41200 0x55b33ee44760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.469+0000 7f34e4e00700 1 -- 172.21.15.81:0/3304249081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b33ed533d0 con 0x55b33ee408e0 2024-05-03T16:47:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.469+0000 7f34e6200700 1 --2- 172.21.15.81:0/3304249081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee41200 0x55b33ee44760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:47:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.470+0000 7f34e4e00700 1 --2- 172.21.15.81:0/3304249081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee408e0 0x55b33ee44220 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0098e0 tx=0x7f34cc0055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4dad3e841d6a00 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.470+0000 7f34c7400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:47:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.470+0000 7f34c7400700 1 -- 172.21.15.81:0/3304249081 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc027070 con 0x55b33ee408e0 2024-05-03T16:47:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.470+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/3304249081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34cc005070 con 0x55b33ee408e0 2024-05-03T16:47:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.470+0000 7f34c7400700 1 -- 172.21.15.81:0/3304249081 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f34cc00bd60 con 0x55b33ee408e0 2024-05-03T16:47:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.470+0000 7f34c7400700 1 -- 172.21.15.81:0/3304249081 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f34cc03a050 con 0x55b33ee408e0 2024-05-03T16:47:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.470+0000 7f34f2ab4b80 10 client.15048 fetch_fsmap learned FSMap version 29 2024-05-03T16:47:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.470+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/3304249081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b33ee523f0 con 0x55b33ee408e0 2024-05-03T16:47:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.471+0000 7f34c7400700 1 -- 172.21.15.81:0/3304249081 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34cc005070 con 0x55b33ee408e0 2024-05-03T16:47:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.471+0000 7f34c7400700 1 -- 172.21.15.81:0/3304249081 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f34cc0227e0 con 0x55b33ee408e0 2024-05-03T16:47:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.471+0000 7f34f2ab4b80 10 client.15048 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:47:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.471+0000 7f34f2ab4b80 10 client.15048 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-03T16:47:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.471+0000 7f34f2ab4b80 20 client.15048 populate_metadata read hostname 'smithi081' 2024-05-03T16:47:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.471+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/3304249081 >> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] conn(0x55b33ee544e0 0x55b33ee53740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.471+0000 7f34f2ab4b80 4 client.15048 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T16:47:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.471+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/3304249081 --> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b33ee07fa0 con 0x55b33ee544e0 2024-05-03T16:47:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.472+0000 7f34e5800700 1 --2- 172.21.15.81:0/3304249081 >> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] conn(0x55b33ee544e0 0x55b33ee53740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.473+0000 7f34e5800700 1 --2- 172.21.15.81:0/3304249081 >> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] conn(0x55b33ee544e0 0x55b33ee53740 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=99f906d5707da3b2 server_cookie=64895690570064fe in_seq=0 out_seq=0 2024-05-03T16:47:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.473+0000 7f34c7400700 10 client.15048 ms_handle_connect on v2:172.21.15.146:6838/3770312555 2024-05-03T16:47:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.475+0000 7f34c7400700 1 -- 172.21.15.81:0/3304249081 <== mds.4 v2:172.21.15.146:6838/3770312555 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b33ee07fa0 con 0x55b33ee544e0 2024-05-03T16:47:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.475+0000 7f34c7400700 10 client.15048 handle_command_reply: tid=0 2024-05-03T16:47:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.475+0000 7f34f2ab4b80 1 client.15048 shutdown 2024-05-03T16:47:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.475+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/3304249081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee408e0 msgr2=0x55b33ee44220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.475+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/3304249081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee408e0 0x55b33ee44220 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0098e0 tx=0x7f34cc0055f0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.476+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/3304249081 shutdown_connections 2024-05-03T16:47:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.476+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/3304249081 >> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] conn(0x55b33ee544e0 0x55b33ee53740 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.476+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/3304249081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee3b500 0x55b33ee46e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.476+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/3304249081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee41200 0x55b33ee44760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.476+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/3304249081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee408e0 0x55b33ee44220 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.476+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/3304249081 >> 172.21.15.81:0/3304249081 conn(0x55b33edb3680 msgr2=0x55b33ee30360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:58.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.476+0000 7f34c7400700 0 client.15048 ms_handle_reset on v2:172.21.15.146:6838/3770312555 2024-05-03T16:47:58.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.476+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/3304249081 shutdown_connections 2024-05-03T16:47:58.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.476+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/3304249081 wait complete. 2024-05-03T16:47:58.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.476+0000 7f34f2ab4b80 20 client.15048 trim_cache size 0 max 16384 2024-05-03T16:47:58.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.498+0000 7f34f2ab4b80 1 Processor -- start 2024-05-03T16:47:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.498+0000 7f34f2ab4b80 1 -- start start 2024-05-03T16:47:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.499+0000 7f34f2ab4b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee3b500 0x55b33ee3aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.499+0000 7f34f2ab4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee408e0 0x55b33ee37160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.499+0000 7f34f2ab4b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee41200 0x55b33ee42b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.499+0000 7f34f2ab4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b33ee53c90 con 0x55b33ee408e0 2024-05-03T16:47:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.499+0000 7f34f2ab4b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b33ee54360 con 0x55b33ee3b500 2024-05-03T16:47:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.499+0000 7f34f2ab4b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b33ee54a30 con 0x55b33ee41200 2024-05-03T16:47:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.499+0000 7f34e4e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee408e0 0x55b33ee37160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.499+0000 7f34e4e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee408e0 0x55b33ee37160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33162/0 (socket says 172.21.15.81:33162) 2024-05-03T16:47:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.499+0000 7f34e4e00700 1 -- 172.21.15.81:0/4030178932 learned_addr learned my addr 172.21.15.81:0/4030178932 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.500+0000 7f34e4e00700 1 -- 172.21.15.81:0/4030178932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee41200 msgr2=0x55b33ee42b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:47:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.500+0000 7f34e6200700 1 --2- 172.21.15.81:0/4030178932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee41200 0x55b33ee42b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.500+0000 7f34e5800700 1 --2- 172.21.15.81:0/4030178932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee3b500 0x55b33ee3aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.500+0000 7f34e4e00700 1 --2- 172.21.15.81:0/4030178932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee41200 0x55b33ee42b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.500+0000 7f34e4e00700 1 -- 172.21.15.81:0/4030178932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee3b500 msgr2=0x55b33ee3aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:47:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.500+0000 7f34e4e00700 1 --2- 172.21.15.81:0/4030178932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee3b500 0x55b33ee3aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.500+0000 7f34e4e00700 1 -- 172.21.15.81:0/4030178932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b33ee54850 con 0x55b33ee408e0 2024-05-03T16:47:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.500+0000 7f34e5800700 1 --2- 172.21.15.81:0/4030178932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee3b500 0x55b33ee3aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:47:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.500+0000 7f34e4e00700 1 --2- 172.21.15.81:0/4030178932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee408e0 0x55b33ee37160 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f34cc022bb0 tx=0x7f34cc003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20460333a7e0ebca server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.500+0000 7f34d2000700 1 -- 172.21.15.81:0/4030178932 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc027040 con 0x55b33ee408e0 2024-05-03T16:47:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.500+0000 7f34d2000700 1 -- 172.21.15.81:0/4030178932 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34cc028040 con 0x55b33ee408e0 2024-05-03T16:47:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.500+0000 7f34d2000700 1 -- 172.21.15.81:0/4030178932 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc0227b0 con 0x55b33ee408e0 2024-05-03T16:47:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.501+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/4030178932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee408e0 msgr2=0x55b33ee37160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.501+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/4030178932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee408e0 0x55b33ee37160 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f34cc022bb0 tx=0x7f34cc003700 comp rx=0 tx=0).stop 2024-05-03T16:47:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.501+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/4030178932 shutdown_connections 2024-05-03T16:47:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.501+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/4030178932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee41200 0x55b33ee42b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.501+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/4030178932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee3b500 0x55b33ee3aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.501+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/4030178932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee408e0 0x55b33ee37160 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.501+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/4030178932 >> 172.21.15.81:0/4030178932 conn(0x55b33edb3680 msgr2=0x55b33ee2f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.501+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/4030178932 shutdown_connections 2024-05-03T16:47:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.501+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/4030178932 wait complete. 2024-05-03T16:47:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.502+0000 7f34f2ab4b80 1 -- start start 2024-05-03T16:47:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.502+0000 7f34f2ab4b80 1 Processor -- start 2024-05-03T16:47:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.502+0000 7f34f2ab4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee3b500 0x55b33ee3a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.502+0000 7f34f2ab4b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee408e0 0x55b33ee3a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.502+0000 7f34f2ab4b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee41200 0x55b33ee3ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.502+0000 7f34f2ab4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b33ee557d0 con 0x55b33ee3b500 2024-05-03T16:47:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.502+0000 7f34f2ab4b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b33ee55100 con 0x55b33ee408e0 2024-05-03T16:47:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.502+0000 7f34f2ab4b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b33ee55ea0 con 0x55b33ee41200 2024-05-03T16:47:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.502+0000 7f34f2ab4b80 10 client.0 _ll_register_callbacks cb 0x55b33ed34c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:47:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.502+0000 7f34e5800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee3b500 0x55b33ee3a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.503+0000 7f34e5800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee3b500 0x55b33ee3a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33174/0 (socket says 172.21.15.81:33174) 2024-05-03T16:47:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.503+0000 7f34e5800700 1 -- 172.21.15.81:0/2326616161 learned_addr learned my addr 172.21.15.81:0/2326616161 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:47:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.503+0000 7f34e6200700 1 --2- 172.21.15.81:0/2326616161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee41200 0x55b33ee3ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.503+0000 7f34e4e00700 1 --2- 172.21.15.81:0/2326616161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee408e0 0x55b33ee3a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.503+0000 7f34e5800700 1 -- 172.21.15.81:0/2326616161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee41200 msgr2=0x55b33ee3ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:47:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.503+0000 7f34e5800700 1 --2- 172.21.15.81:0/2326616161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee41200 0x55b33ee3ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.503+0000 7f34e5800700 1 -- 172.21.15.81:0/2326616161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee408e0 msgr2=0x55b33ee3a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:47:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.503+0000 7f34e5800700 1 --2- 172.21.15.81:0/2326616161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee408e0 0x55b33ee3a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.503+0000 7f34e5800700 1 -- 172.21.15.81:0/2326616161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b33ee5d580 con 0x55b33ee3b500 2024-05-03T16:47:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.503+0000 7f34e4e00700 1 --2- 172.21.15.81:0/2326616161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee408e0 0x55b33ee3a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:47:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.503+0000 7f34e5800700 1 --2- 172.21.15.81:0/2326616161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee3b500 0x55b33ee3a2b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f34d40a6a60 tx=0x7f34d4015cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f143dead79c828 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:47:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.503+0000 7f34c7400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:47:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.504+0000 7f34c7400700 1 -- 172.21.15.81:0/2326616161 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d40a97f0 con 0x55b33ee3b500 2024-05-03T16:47:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.504+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/2326616161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34cc028040 con 0x55b33ee3b500 2024-05-03T16:47:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.504+0000 7f34c7400700 1 -- 172.21.15.81:0/2326616161 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f34d400f970 con 0x55b33ee3b500 2024-05-03T16:47:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.504+0000 7f34c7400700 1 -- 172.21.15.81:0/2326616161 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f34d40adba0 con 0x55b33ee3b500 2024-05-03T16:47:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.504+0000 7f34f2ab4b80 10 client.15054 fetch_fsmap learned FSMap version 29 2024-05-03T16:47:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.504+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/2326616161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b33eec8610 con 0x55b33ee3b500 2024-05-03T16:47:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.504+0000 7f34c7400700 1 -- 172.21.15.81:0/2326616161 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34cc028040 con 0x55b33ee3b500 2024-05-03T16:47:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.504+0000 7f34c7400700 1 -- 172.21.15.81:0/2326616161 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f34d40e1050 con 0x55b33ee3b500 2024-05-03T16:47:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.504+0000 7f34f2ab4b80 10 client.15054 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:47:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.504+0000 7f34f2ab4b80 10 client.15054 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-03T16:47:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.504+0000 7f34f2ab4b80 20 client.15054 populate_metadata read hostname 'smithi081' 2024-05-03T16:47:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.504+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/2326616161 >> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] conn(0x55b33eecd240 0x55b33eecbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:47:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.504+0000 7f34f2ab4b80 4 client.15054 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T16:47:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.504+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/2326616161 --> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] -- command(tid 0: {"prefix": "status"}) -- 0x55b33ed9b3b0 con 0x55b33eecd240 2024-05-03T16:47:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.505+0000 7f34e4e00700 1 --2- 172.21.15.81:0/2326616161 >> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] conn(0x55b33eecd240 0x55b33eecbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:47:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.506+0000 7f34e4e00700 1 --2- 172.21.15.81:0/2326616161 >> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] conn(0x55b33eecd240 0x55b33eecbf50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=101662ee9b18f698 server_cookie=5d4595369179ad2c in_seq=0 out_seq=0 2024-05-03T16:47:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.506+0000 7f34c7400700 10 client.15054 ms_handle_connect on v2:172.21.15.146:6838/3770312555 2024-05-03T16:47:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.506+0000 7f34c7400700 1 -- 172.21.15.81:0/2326616161 <== mds.4 v2:172.21.15.146:6838/3770312555 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b33ed9b3b0 con 0x55b33eecd240 2024-05-03T16:47:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.506+0000 7f34c7400700 10 client.15054 handle_command_reply: tid=0 2024-05-03T16:47:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.507+0000 7f34f2ab4b80 1 client.15054 shutdown 2024-05-03T16:47:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.507+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/2326616161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee3b500 msgr2=0x55b33ee3a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.507+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/2326616161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee3b500 0x55b33ee3a2b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f34d40a6a60 tx=0x7f34d4015cc0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.507+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/2326616161 shutdown_connections 2024-05-03T16:47:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.507+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/2326616161 >> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] conn(0x55b33eecd240 0x55b33eecbf50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.507+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/2326616161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b33ee41200 0x55b33ee3ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.507+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/2326616161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b33ee3b500 0x55b33ee3a2b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.507+0000 7f34f2ab4b80 1 --2- 172.21.15.81:0/2326616161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b33ee408e0 0x55b33ee3a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.507+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/2326616161 >> 172.21.15.81:0/2326616161 conn(0x55b33edb3680 msgr2=0x55b33ee415e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.507+0000 7f34c7400700 0 client.15054 ms_handle_reset on v2:172.21.15.146:6838/3770312555 2024-05-03T16:47:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.507+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/2326616161 shutdown_connections 2024-05-03T16:47:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.507+0000 7f34f2ab4b80 1 -- 172.21.15.81:0/2326616161 wait complete. 2024-05-03T16:47:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.507+0000 7f34f2ab4b80 20 client.15054 trim_cache size 0 max 16384 2024-05-03T16:47:58.513 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-03T16:47:58.513 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8988869e-096a-11ef-bc97-c7b262605968", 2024-05-03T16:47:58.513 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 4, 2024-05-03T16:47:58.513 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24481, 2024-05-03T16:47:58.513 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-05-03T16:47:58.513 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-05-03T16:47:58.513 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-05-03T16:47:58.513 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 151.90460046199999, 2024-05-03T16:47:58.513 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 29, 2024-05-03T16:47:58.513 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 91, 2024-05-03T16:47:58.514 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 91, 2024-05-03T16:47:58.514 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 273.94859849599999 2024-05-03T16:47:58.514 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-03T16:47:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.508+0000 7f34e8200700 1 -- 172.21.15.81:0/2988970902 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f34c80b2990 msgr2=0x7f34c80b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.508+0000 7f34e8200700 1 --2- 172.21.15.81:0/2988970902 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f34c80b2990 0x7f34c80b4e50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f34d800f170 tx=0x7f34d8007480 comp rx=0 tx=0).stop 2024-05-03T16:47:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.508+0000 7f34e8200700 1 -- 172.21.15.81:0/2988970902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34e006bbb0 msgr2=0x7f34e01a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:47:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.508+0000 7f34e8200700 1 --2- 172.21.15.81:0/2988970902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34e006bbb0 0x7f34e01a1940 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f34d400c9b0 tx=0x7f34d400cd70 comp rx=0 tx=0).stop 2024-05-03T16:47:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.508+0000 7f34e8200700 1 -- 172.21.15.81:0/2988970902 shutdown_connections 2024-05-03T16:47:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.508+0000 7f34e8200700 1 --2- 172.21.15.81:0/2988970902 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f34c80b2990 0x7f34c80b4e50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.508+0000 7f34e8200700 1 --2- 172.21.15.81:0/2988970902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e0109540 0x7f34e019bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.508+0000 7f34e8200700 1 --2- 172.21.15.81:0/2988970902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34e006bbb0 0x7f34e01a1940 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.508+0000 7f34e8200700 1 --2- 172.21.15.81:0/2988970902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34e006c570 0x7f34e01a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:47:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.508+0000 7f34e8200700 1 -- 172.21.15.81:0/2988970902 >> 172.21.15.81:0/2988970902 conn(0x7f34e0078410 msgr2=0x7f34e010e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:47:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.508+0000 7f34e8200700 1 -- 172.21.15.81:0/2988970902 shutdown_connections 2024-05-03T16:47:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:47:58.508+0000 7f34e8200700 1 -- 172.21.15.81:0/2988970902 wait complete. 2024-05-03T16:47:59.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell mds.k status 2024-05-03T16:47:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:47:59.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:47:59 smithi134 ceph-mon[31708]: pgmap v498: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:47:59.978 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:47:59 smithi081 ceph-mon[28640]: pgmap v498: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:00.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:47:59 smithi146 ceph-mon[32357]: pgmap v498: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:01.857 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:01 smithi081 ceph-mon[28640]: pgmap v499: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:02.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:01 smithi146 ceph-mon[32357]: pgmap v499: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:01 smithi134 ceph-mon[31708]: pgmap v499: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.444+0000 7f4dd6400700 1 -- 172.21.15.81:0/764414930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd01023a0 msgr2=0x7f4dd0102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.444+0000 7f4dd6400700 1 --2- 172.21.15.81:0/764414930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd01023a0 0x7f4dd0102820 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009990 tx=0x7f4dbc009ca0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.444+0000 7f4dd6400700 1 -- 172.21.15.81:0/764414930 shutdown_connections 2024-05-03T16:48:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.444+0000 7f4dd6400700 1 --2- 172.21.15.81:0/764414930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dd0108410 0x7f4dd01087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.444+0000 7f4dd6400700 1 --2- 172.21.15.81:0/764414930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dd0102d60 0x7f4dd010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.444+0000 7f4dd6400700 1 --2- 172.21.15.81:0/764414930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd01023a0 0x7f4dd0102820 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.444+0000 7f4dd6400700 1 -- 172.21.15.81:0/764414930 >> 172.21.15.81:0/764414930 conn(0x7f4dd0079350 msgr2=0x7f4dd0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.444+0000 7f4dd6400700 1 -- 172.21.15.81:0/764414930 shutdown_connections 2024-05-03T16:48:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.444+0000 7f4dd6400700 1 -- 172.21.15.81:0/764414930 wait complete. 2024-05-03T16:48:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.445+0000 7f4dd6400700 1 Processor -- start 2024-05-03T16:48:02.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.446+0000 7f4dd6400700 1 -- start start 2024-05-03T16:48:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.446+0000 7f4dd6400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd01023a0 0x7f4dd019bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.446+0000 7f4dd6400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dd0102d60 0x7f4dd019c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.446+0000 7f4dd6400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dd0108410 0x7f4dd01a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.446+0000 7f4dd6400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd01124d0 con 0x7f4dd01023a0 2024-05-03T16:48:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.446+0000 7f4dd6400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd0112350 con 0x7f4dd0108410 2024-05-03T16:48:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.446+0000 7f4dd6400700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd0112650 con 0x7f4dd0102d60 2024-05-03T16:48:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.446+0000 7f4dcf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd01023a0 0x7f4dd019bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.446+0000 7f4dcf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd01023a0 0x7f4dd019bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33180/0 (socket says 172.21.15.81:33180) 2024-05-03T16:48:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.446+0000 7f4dcf400700 1 -- 172.21.15.81:0/3640665893 learned_addr learned my addr 172.21.15.81:0/3640665893 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.447+0000 7f4dcea00700 1 --2- 172.21.15.81:0/3640665893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dd0102d60 0x7f4dd019c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.447+0000 7f4dcfe00700 1 --2- 172.21.15.81:0/3640665893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dd0108410 0x7f4dd01a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.447+0000 7f4dcf400700 1 -- 172.21.15.81:0/3640665893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dd0102d60 msgr2=0x7f4dd019c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.447+0000 7f4dcf400700 1 --2- 172.21.15.81:0/3640665893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dd0102d60 0x7f4dd019c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.447+0000 7f4dcf400700 1 -- 172.21.15.81:0/3640665893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dd0108410 msgr2=0x7f4dd01a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.447+0000 7f4dcf400700 1 --2- 172.21.15.81:0/3640665893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dd0108410 0x7f4dd01a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.447+0000 7f4dcf400700 1 -- 172.21.15.81:0/3640665893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd01a0d60 con 0x7f4dd01023a0 2024-05-03T16:48:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.447+0000 7f4dcfe00700 1 --2- 172.21.15.81:0/3640665893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dd0108410 0x7f4dd01a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:48:02.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.447+0000 7f4dcf400700 1 --2- 172.21.15.81:0/3640665893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd01023a0 0x7f4dd019bd50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000c970 tx=0x7f4dc000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:02.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.447+0000 7f4dc7e00700 1 -- 172.21.15.81:0/3640665893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0007aa0 con 0x7f4dd01023a0 2024-05-03T16:48:02.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.448+0000 7f4dc7e00700 1 -- 172.21.15.81:0/3640665893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4dc0004cc0 con 0x7f4dd01023a0 2024-05-03T16:48:02.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.448+0000 7f4dd6400700 1 -- 172.21.15.81:0/3640665893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd01a1050 con 0x7f4dd01023a0 2024-05-03T16:48:02.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.448+0000 7f4dc7e00700 1 -- 172.21.15.81:0/3640665893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0005500 con 0x7f4dd01023a0 2024-05-03T16:48:02.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.448+0000 7f4dd6400700 1 -- 172.21.15.81:0/3640665893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd01a88d0 con 0x7f4dd01023a0 2024-05-03T16:48:02.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.451+0000 7f4dc7e00700 1 -- 172.21.15.81:0/3640665893 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f4dc000f450 con 0x7f4dd01023a0 2024-05-03T16:48:02.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.452+0000 7f4de0debb80 1 Processor -- start 2024-05-03T16:48:02.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.453+0000 7f4de0debb80 1 -- start start 2024-05-03T16:48:02.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.453+0000 7f4de0debb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1753c760 0x563c1753cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.453+0000 7f4de0debb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753d080 0x563c17537f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.453+0000 7f4dc7e00700 1 --2- 172.21.15.81:0/3640665893 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f4db40b2990 0x7f4db40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.453+0000 7f4de0debb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c17538580 0x563c175389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.453+0000 7f4de0debb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c1748a9d0 con 0x563c1753d080 2024-05-03T16:48:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.453+0000 7f4de0debb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563c17428710 con 0x563c17538580 2024-05-03T16:48:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.453+0000 7f4de0debb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563c17486990 con 0x563c1753c760 2024-05-03T16:48:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.453+0000 7f4dc7e00700 1 -- 172.21.15.81:0/3640665893 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f4dc00e25b0 con 0x7f4dd01023a0 2024-05-03T16:48:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.453+0000 7f4dcf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753d080 0x563c17537f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.453+0000 7f4dcf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753d080 0x563c17537f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33194/0 (socket says 172.21.15.81:33194) 2024-05-03T16:48:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.453+0000 7f4dcf400700 1 -- 172.21.15.81:0/3569751281 learned_addr learned my addr 172.21.15.81:0/3569751281 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.454+0000 7f4dcfe00700 1 --2- 172.21.15.81:0/3569751281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1753c760 0x563c1753cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.454+0000 7f4dcea00700 1 --2- 172.21.15.81:0/3640665893 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f4db40b2990 0x7f4db40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.454+0000 7f4dcfe00700 1 --2- 172.21.15.81:0/3569751281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c17538580 0x563c175389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.454+0000 7f4dcf400700 1 -- 172.21.15.81:0/3569751281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1753c760 msgr2=0x563c1753cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.454+0000 7f4dcf400700 1 --2- 172.21.15.81:0/3569751281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1753c760 0x563c1753cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.454+0000 7f4dcf400700 1 -- 172.21.15.81:0/3569751281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c17538580 msgr2=0x563c175389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.454+0000 7f4dcf400700 1 --2- 172.21.15.81:0/3569751281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c17538580 0x563c175389e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.454+0000 7f4dcf400700 1 -- 172.21.15.81:0/3569751281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c173d7880 con 0x563c1753d080 2024-05-03T16:48:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.454+0000 7f4dcfe00700 1 --2- 172.21.15.81:0/3569751281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c17538580 0x563c175389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:48:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.454+0000 7f4dcf400700 1 --2- 172.21.15.81:0/3569751281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753d080 0x563c17537f60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4dc001d030 tx=0x7f4dc00a95f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db0ce5e4eb7cbfd server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.455+0000 7f4dcea00700 1 --2- 172.21.15.81:0/3640665893 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f4db40b2990 0x7f4db40b4e50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00b5c0 tx=0x7f4dbc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.455+0000 7f4dc4c00700 1 -- 172.21.15.81:0/3569751281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0005700 con 0x563c1753d080 2024-05-03T16:48:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.455+0000 7f4dc4c00700 1 -- 172.21.15.81:0/3569751281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4dc00a96f0 con 0x563c1753d080 2024-05-03T16:48:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.455+0000 7f4dc4c00700 1 -- 172.21.15.81:0/3569751281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0091310 con 0x563c1753d080 2024-05-03T16:48:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.456+0000 7f4de0debb80 1 -- 172.21.15.81:0/3569751281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753d080 msgr2=0x563c17537f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.456+0000 7f4de0debb80 1 --2- 172.21.15.81:0/3569751281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753d080 0x563c17537f60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4dc001d030 tx=0x7f4dc00a95f0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.456+0000 7f4de0debb80 1 -- 172.21.15.81:0/3569751281 shutdown_connections 2024-05-03T16:48:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.456+0000 7f4de0debb80 1 --2- 172.21.15.81:0/3569751281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1753c760 0x563c1753cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.456+0000 7f4de0debb80 1 --2- 172.21.15.81:0/3569751281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c17538580 0x563c175389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.456+0000 7f4de0debb80 1 --2- 172.21.15.81:0/3569751281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753d080 0x563c17537f60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.456+0000 7f4de0debb80 1 -- 172.21.15.81:0/3569751281 >> 172.21.15.81:0/3569751281 conn(0x563c17466b10 msgr2=0x563c175327a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.456+0000 7f4de0debb80 1 -- 172.21.15.81:0/3569751281 shutdown_connections 2024-05-03T16:48:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.456+0000 7f4de0debb80 1 -- 172.21.15.81:0/3569751281 wait complete. 2024-05-03T16:48:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.457+0000 7f4de0debb80 1 -- start start 2024-05-03T16:48:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.457+0000 7f4de0debb80 1 Processor -- start 2024-05-03T16:48:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.457+0000 7f4de0debb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c17538580 0x563c17543f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.457+0000 7f4de0debb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1753c760 0x563c175412a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.457+0000 7f4de0debb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753d080 0x563c175417e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.457+0000 7f4de0debb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c17544c50 con 0x563c1753d080 2024-05-03T16:48:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.457+0000 7f4de0debb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563c173f0ad0 con 0x563c1753c760 2024-05-03T16:48:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.457+0000 7f4de0debb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563c17544dd0 con 0x563c17538580 2024-05-03T16:48:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.458+0000 7f4de0debb80 10 client.0 _ll_register_callbacks cb 0x563c17431c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:48:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.458+0000 7f4dcfe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753d080 0x563c175417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.458+0000 7f4dcfe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753d080 0x563c175417e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33206/0 (socket says 172.21.15.81:33206) 2024-05-03T16:48:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.458+0000 7f4dcfe00700 1 -- 172.21.15.81:0/3370092536 learned_addr learned my addr 172.21.15.81:0/3370092536 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.458+0000 7f4dcf400700 1 --2- 172.21.15.81:0/3370092536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c17538580 0x563c17543f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.458+0000 7f4dcea00700 1 --2- 172.21.15.81:0/3370092536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1753c760 0x563c175412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.458+0000 7f4dcfe00700 1 -- 172.21.15.81:0/3370092536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c17538580 msgr2=0x563c17543f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.458+0000 7f4dcfe00700 1 --2- 172.21.15.81:0/3370092536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c17538580 0x563c17543f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.458+0000 7f4dcfe00700 1 -- 172.21.15.81:0/3370092536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1753c760 msgr2=0x563c175412a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.458+0000 7f4dcfe00700 1 --2- 172.21.15.81:0/3370092536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1753c760 0x563c175412a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.458+0000 7f4dcfe00700 1 -- 172.21.15.81:0/3370092536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c174503d0 con 0x563c1753d080 2024-05-03T16:48:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.459+0000 7f4dcfe00700 1 --2- 172.21.15.81:0/3370092536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753d080 0x563c175417e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4dc800a250 tx=0x7f4dc8014ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b22bf354000cc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.459+0000 7f4db9600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:48:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.459+0000 7f4db9600700 1 -- 172.21.15.81:0/3370092536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc800fa60 con 0x563c1753d080 2024-05-03T16:48:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.459+0000 7f4db9600700 1 -- 172.21.15.81:0/3370092536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f4dc800fc00 con 0x563c1753d080 2024-05-03T16:48:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.459+0000 7f4de0debb80 1 -- 172.21.15.81:0/3370092536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dc00a96f0 con 0x563c1753d080 2024-05-03T16:48:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.460+0000 7f4db9600700 1 -- 172.21.15.81:0/3370092536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4dc800fe40 con 0x563c1753d080 2024-05-03T16:48:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.460+0000 7f4de0debb80 10 client.15066 fetch_fsmap learned FSMap version 29 2024-05-03T16:48:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.460+0000 7f4de0debb80 1 -- 172.21.15.81:0/3370092536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563c1754f520 con 0x563c1753d080 2024-05-03T16:48:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.460+0000 7f4db9600700 1 -- 172.21.15.81:0/3370092536 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4dc00a96f0 con 0x563c1753d080 2024-05-03T16:48:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.460+0000 7f4db9600700 1 -- 172.21.15.81:0/3370092536 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4dc8010040 con 0x563c1753d080 2024-05-03T16:48:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.461+0000 7f4de0debb80 10 client.15066 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:48:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.461+0000 7f4de0debb80 10 client.15066 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-03T16:48:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.461+0000 7f4de0debb80 20 client.15066 populate_metadata read hostname 'smithi081' 2024-05-03T16:48:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.461+0000 7f4de0debb80 1 --2- 172.21.15.81:0/3370092536 >> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] conn(0x563c17551ac0 0x563c17552f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.461+0000 7f4de0debb80 4 client.15066 mds_command: new command op to 34400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T16:48:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.461+0000 7f4de0debb80 1 -- 172.21.15.81:0/3370092536 --> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c17505180 con 0x563c17551ac0 2024-05-03T16:48:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.461+0000 7f4dcf400700 1 --2- 172.21.15.81:0/3370092536 >> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] conn(0x563c17551ac0 0x563c17552f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.462+0000 7f4dcf400700 1 --2- 172.21.15.81:0/3370092536 >> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] conn(0x563c17551ac0 0x563c17552f30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1bd813831e724cba server_cookie=5ecb3751e40e5b89 in_seq=0 out_seq=0 2024-05-03T16:48:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.462+0000 7f4db9600700 10 client.15066 ms_handle_connect on v2:172.21.15.134:6832/749392804 2024-05-03T16:48:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.464+0000 7f4db9600700 1 -- 172.21.15.81:0/3370092536 <== mds.3 v2:172.21.15.134:6832/749392804 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563c17505180 con 0x563c17551ac0 2024-05-03T16:48:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.464+0000 7f4db9600700 10 client.15066 handle_command_reply: tid=0 2024-05-03T16:48:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.464+0000 7f4de0debb80 1 client.15066 shutdown 2024-05-03T16:48:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.464+0000 7f4de0debb80 1 -- 172.21.15.81:0/3370092536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753d080 msgr2=0x563c175417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.464+0000 7f4de0debb80 1 --2- 172.21.15.81:0/3370092536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753d080 0x563c175417e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4dc800a250 tx=0x7f4dc8014ba0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.464+0000 7f4de0debb80 1 -- 172.21.15.81:0/3370092536 shutdown_connections 2024-05-03T16:48:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.465+0000 7f4de0debb80 1 --2- 172.21.15.81:0/3370092536 >> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] conn(0x563c17551ac0 0x563c17552f30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.465+0000 7f4de0debb80 1 --2- 172.21.15.81:0/3370092536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c17538580 0x563c17543f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.465+0000 7f4de0debb80 1 --2- 172.21.15.81:0/3370092536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753d080 0x563c175417e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.465+0000 7f4de0debb80 1 --2- 172.21.15.81:0/3370092536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1753c760 0x563c175412a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.465+0000 7f4de0debb80 1 -- 172.21.15.81:0/3370092536 >> 172.21.15.81:0/3370092536 conn(0x563c17466b10 msgr2=0x563c1753ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.465+0000 7f4db9600700 0 client.15066 ms_handle_reset on v2:172.21.15.134:6832/749392804 2024-05-03T16:48:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.465+0000 7f4de0debb80 1 -- 172.21.15.81:0/3370092536 shutdown_connections 2024-05-03T16:48:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.465+0000 7f4de0debb80 1 -- 172.21.15.81:0/3370092536 wait complete. 2024-05-03T16:48:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.465+0000 7f4de0debb80 20 client.15066 trim_cache size 0 max 16384 2024-05-03T16:48:02.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.489+0000 7f4de0debb80 1 Processor -- start 2024-05-03T16:48:02.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.489+0000 7f4de0debb80 1 -- start start 2024-05-03T16:48:02.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.489+0000 7f4de0debb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c17538580 0x563c17538960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:02.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.489+0000 7f4de0debb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753c760 0x563c1753bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:02.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.489+0000 7f4de0debb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1753d080 0x563c17532610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:02.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.489+0000 7f4de0debb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c17551270 con 0x563c1753c760 2024-05-03T16:48:02.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.489+0000 7f4de0debb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563c17551940 con 0x563c17538580 2024-05-03T16:48:02.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.489+0000 7f4de0debb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563c17552010 con 0x563c1753d080 2024-05-03T16:48:02.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.489+0000 7f4dcea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753c760 0x563c1753bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:02.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.490+0000 7f4dcea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753c760 0x563c1753bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33218/0 (socket says 172.21.15.81:33218) 2024-05-03T16:48:02.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.490+0000 7f4dcea00700 1 -- 172.21.15.81:0/2629681029 learned_addr learned my addr 172.21.15.81:0/2629681029 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:02.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.490+0000 7f4dcfe00700 1 --2- 172.21.15.81:0/2629681029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1753d080 0x563c17532610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:02.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.490+0000 7f4dcf400700 1 --2- 172.21.15.81:0/2629681029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c17538580 0x563c17538960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:02.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.490+0000 7f4dcea00700 1 -- 172.21.15.81:0/2629681029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1753d080 msgr2=0x563c17532610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:02.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.490+0000 7f4dcea00700 1 --2- 172.21.15.81:0/2629681029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1753d080 0x563c17532610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.490+0000 7f4dcea00700 1 -- 172.21.15.81:0/2629681029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c17538580 msgr2=0x563c17538960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:02.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.490+0000 7f4dcea00700 1 --2- 172.21.15.81:0/2629681029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c17538580 0x563c17538960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.490+0000 7f4dcea00700 1 -- 172.21.15.81:0/2629681029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c17553e90 con 0x563c1753c760 2024-05-03T16:48:02.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.490+0000 7f4dcea00700 1 --2- 172.21.15.81:0/2629681029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753c760 0x563c1753bab0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009990 tx=0x7f4dbc022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e0525852fe81ee server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:02.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.491+0000 7f4dbbe00700 1 -- 172.21.15.81:0/2629681029 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc00fa40 con 0x563c1753c760 2024-05-03T16:48:02.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.491+0000 7f4dbbe00700 1 -- 172.21.15.81:0/2629681029 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4dbc0054b0 con 0x563c1753c760 2024-05-03T16:48:02.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.491+0000 7f4dbbe00700 1 -- 172.21.15.81:0/2629681029 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc004ac0 con 0x563c1753c760 2024-05-03T16:48:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.491+0000 7f4de0debb80 1 -- 172.21.15.81:0/2629681029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753c760 msgr2=0x563c1753bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.492+0000 7f4de0debb80 1 --2- 172.21.15.81:0/2629681029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753c760 0x563c1753bab0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009990 tx=0x7f4dbc022000 comp rx=0 tx=0).stop 2024-05-03T16:48:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.492+0000 7f4de0debb80 1 -- 172.21.15.81:0/2629681029 shutdown_connections 2024-05-03T16:48:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.492+0000 7f4de0debb80 1 --2- 172.21.15.81:0/2629681029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1753d080 0x563c17532610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.492+0000 7f4de0debb80 1 --2- 172.21.15.81:0/2629681029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c17538580 0x563c17538960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.492+0000 7f4de0debb80 1 --2- 172.21.15.81:0/2629681029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753c760 0x563c1753bab0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.492+0000 7f4de0debb80 1 -- 172.21.15.81:0/2629681029 >> 172.21.15.81:0/2629681029 conn(0x563c17466b10 msgr2=0x563c1753b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.492+0000 7f4de0debb80 1 -- 172.21.15.81:0/2629681029 shutdown_connections 2024-05-03T16:48:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.492+0000 7f4de0debb80 1 -- 172.21.15.81:0/2629681029 wait complete. 2024-05-03T16:48:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.492+0000 7f4de0debb80 1 -- start start 2024-05-03T16:48:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.493+0000 7f4de0debb80 1 Processor -- start 2024-05-03T16:48:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.493+0000 7f4de0debb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c17538580 0x563c1755c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.493+0000 7f4de0debb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753c760 0x563c1755c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.493+0000 7f4de0debb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1753d080 0x563c17555350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.493+0000 7f4de0debb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c17552db0 con 0x563c1753c760 2024-05-03T16:48:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.493+0000 7f4de0debb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563c175526e0 con 0x563c1753d080 2024-05-03T16:48:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.493+0000 7f4de0debb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563c17553480 con 0x563c17538580 2024-05-03T16:48:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.493+0000 7f4de0debb80 10 client.0 _ll_register_callbacks cb 0x563c17431c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:48:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.494+0000 7f4dcea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753c760 0x563c1755c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.494+0000 7f4dcea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753c760 0x563c1755c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33222/0 (socket says 172.21.15.81:33222) 2024-05-03T16:48:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.494+0000 7f4dcea00700 1 -- 172.21.15.81:0/4028793081 learned_addr learned my addr 172.21.15.81:0/4028793081 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.494+0000 7f4dcf400700 1 --2- 172.21.15.81:0/4028793081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c17538580 0x563c1755c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:02.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.494+0000 7f4dcfe00700 1 --2- 172.21.15.81:0/4028793081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1753d080 0x563c17555350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:02.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.494+0000 7f4dcea00700 1 -- 172.21.15.81:0/4028793081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c17538580 msgr2=0x563c1755c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:02.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.494+0000 7f4dcea00700 1 --2- 172.21.15.81:0/4028793081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c17538580 0x563c1755c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.494+0000 7f4dcea00700 1 -- 172.21.15.81:0/4028793081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1753d080 msgr2=0x563c17555350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:02.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.494+0000 7f4dcea00700 1 --2- 172.21.15.81:0/4028793081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1753d080 0x563c17555350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.494+0000 7f4dcea00700 1 -- 172.21.15.81:0/4028793081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c17555990 con 0x563c1753c760 2024-05-03T16:48:02.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.495+0000 7f4dcea00700 1 --2- 172.21.15.81:0/4028793081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753c760 0x563c1755c8f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc031040 tx=0x7f4dbc02f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c31706e12d37a6d server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:02.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.495+0000 7f4db9600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:48:02.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.495+0000 7f4db9600700 1 -- 172.21.15.81:0/4028793081 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc03d070 con 0x563c1753c760 2024-05-03T16:48:02.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.495+0000 7f4de0debb80 1 -- 172.21.15.81:0/4028793081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dbc0054b0 con 0x563c1753c760 2024-05-03T16:48:02.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.495+0000 7f4db9600700 1 -- 172.21.15.81:0/4028793081 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f4dbc039420 con 0x563c1753c760 2024-05-03T16:48:02.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.495+0000 7f4db9600700 1 -- 172.21.15.81:0/4028793081 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4dbc049050 con 0x563c1753c760 2024-05-03T16:48:02.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.495+0000 7f4de0debb80 10 client.15072 fetch_fsmap learned FSMap version 29 2024-05-03T16:48:02.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.495+0000 7f4de0debb80 1 -- 172.21.15.81:0/4028793081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563c175bd850 con 0x563c1753c760 2024-05-03T16:48:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.495+0000 7f4db9600700 1 -- 172.21.15.81:0/4028793081 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4dbc0054b0 con 0x563c1753c760 2024-05-03T16:48:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.496+0000 7f4db9600700 1 -- 172.21.15.81:0/4028793081 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4dbc039b60 con 0x563c1753c760 2024-05-03T16:48:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.496+0000 7f4de0debb80 10 client.15072 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:48:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.496+0000 7f4de0debb80 10 client.15072 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-03T16:48:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.496+0000 7f4de0debb80 20 client.15072 populate_metadata read hostname 'smithi081' 2024-05-03T16:48:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.496+0000 7f4de0debb80 1 --2- 172.21.15.81:0/4028793081 >> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] conn(0x563c175c1e70 0x563c175c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.496+0000 7f4de0debb80 4 client.15072 mds_command: new command op to 34400 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T16:48:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.496+0000 7f4de0debb80 1 -- 172.21.15.81:0/4028793081 --> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] -- command(tid 0: {"prefix": "status"}) -- 0x563c174983b0 con 0x563c175c1e70 2024-05-03T16:48:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.497+0000 7f4dcf400700 1 --2- 172.21.15.81:0/4028793081 >> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] conn(0x563c175c1e70 0x563c175c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:02.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.497+0000 7f4dcf400700 1 --2- 172.21.15.81:0/4028793081 >> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] conn(0x563c175c1e70 0x563c175c0b80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d40705c6e1ffea80 server_cookie=781ac63aeb2f417f in_seq=0 out_seq=0 2024-05-03T16:48:02.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.497+0000 7f4db9600700 10 client.15072 ms_handle_connect on v2:172.21.15.134:6832/749392804 2024-05-03T16:48:02.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.498+0000 7f4db9600700 1 -- 172.21.15.81:0/4028793081 <== mds.3 v2:172.21.15.134:6832/749392804 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x563c174983b0 con 0x563c175c1e70 2024-05-03T16:48:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.498+0000 7f4db9600700 10 client.15072 handle_command_reply: tid=0 2024-05-03T16:48:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.498+0000 7f4de0debb80 1 client.15072 shutdown 2024-05-03T16:48:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.498+0000 7f4de0debb80 1 -- 172.21.15.81:0/4028793081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753c760 msgr2=0x563c1755c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.498+0000 7f4de0debb80 1 --2- 172.21.15.81:0/4028793081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753c760 0x563c1755c8f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc031040 tx=0x7f4dbc02f720 comp rx=0 tx=0).stop 2024-05-03T16:48:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.498+0000 7f4de0debb80 1 -- 172.21.15.81:0/4028793081 shutdown_connections 2024-05-03T16:48:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.498+0000 7f4de0debb80 1 --2- 172.21.15.81:0/4028793081 >> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] conn(0x563c175c1e70 0x563c175c0b80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.498+0000 7f4de0debb80 1 --2- 172.21.15.81:0/4028793081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c17538580 0x563c1755c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.498+0000 7f4de0debb80 1 --2- 172.21.15.81:0/4028793081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1753d080 0x563c17555350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.498+0000 7f4de0debb80 1 --2- 172.21.15.81:0/4028793081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1753c760 0x563c1755c8f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.498+0000 7f4db9600700 0 client.15072 ms_handle_reset on v2:172.21.15.134:6832/749392804 2024-05-03T16:48:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.498+0000 7f4de0debb80 1 -- 172.21.15.81:0/4028793081 >> 172.21.15.81:0/4028793081 conn(0x563c17466b10 msgr2=0x563c17537340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.498+0000 7f4de0debb80 1 -- 172.21.15.81:0/4028793081 shutdown_connections 2024-05-03T16:48:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.499+0000 7f4de0debb80 1 -- 172.21.15.81:0/4028793081 wait complete. 2024-05-03T16:48:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.499+0000 7f4de0debb80 20 client.15072 trim_cache size 0 max 16384 2024-05-03T16:48:02.504 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-03T16:48:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8988869e-096a-11ef-bc97-c7b262605968", 2024-05-03T16:48:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 3, 2024-05-03T16:48:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 34400, 2024-05-03T16:48:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-05-03T16:48:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-05-03T16:48:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-05-03T16:48:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 156.91976560200001, 2024-05-03T16:48:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 29, 2024-05-03T16:48:02.505 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 91, 2024-05-03T16:48:02.505 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 91, 2024-05-03T16:48:02.505 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 308.06780282900002 2024-05-03T16:48:02.505 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-03T16:48:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.499+0000 7f4dd6400700 1 -- 172.21.15.81:0/3640665893 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f4db40b2990 msgr2=0x7f4db40b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.499+0000 7f4dd6400700 1 --2- 172.21.15.81:0/3640665893 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f4db40b2990 0x7f4db40b4e50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00b5c0 tx=0x7f4dbc01a040 comp rx=0 tx=0).stop 2024-05-03T16:48:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.499+0000 7f4dd6400700 1 -- 172.21.15.81:0/3640665893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd01023a0 msgr2=0x7f4dd019bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.499+0000 7f4dd6400700 1 --2- 172.21.15.81:0/3640665893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd01023a0 0x7f4dd019bd50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000c970 tx=0x7f4dc000cd30 comp rx=0 tx=0).stop 2024-05-03T16:48:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.500+0000 7f4dd6400700 1 -- 172.21.15.81:0/3640665893 shutdown_connections 2024-05-03T16:48:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.500+0000 7f4dd6400700 1 --2- 172.21.15.81:0/3640665893 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f4db40b2990 0x7f4db40b4e50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.500+0000 7f4dd6400700 1 --2- 172.21.15.81:0/3640665893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dd0108410 0x7f4dd01a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.500+0000 7f4dd6400700 1 --2- 172.21.15.81:0/3640665893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd01023a0 0x7f4dd019bd50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.500+0000 7f4dd6400700 1 --2- 172.21.15.81:0/3640665893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dd0102d60 0x7f4dd019c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.500+0000 7f4dd6400700 1 -- 172.21.15.81:0/3640665893 >> 172.21.15.81:0/3640665893 conn(0x7f4dd0079350 msgr2=0x7f4dd0100df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.500+0000 7f4dd6400700 1 -- 172.21.15.81:0/3640665893 shutdown_connections 2024-05-03T16:48:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:02.500+0000 7f4dd6400700 1 -- 172.21.15.81:0/3640665893 wait complete. 2024-05-03T16:48:03.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell mds.e status 2024-05-03T16:48:03.891 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:48:03.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:03 smithi081 ceph-mon[28640]: pgmap v500: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:48:04.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:03 smithi146 ceph-mon[32357]: pgmap v500: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:48:04.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:03 smithi134 ceph-mon[31708]: pgmap v500: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:48:05.845 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:05 smithi081 ceph-mon[28640]: pgmap v501: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:06.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:05 smithi146 ceph-mon[32357]: pgmap v501: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:06.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:05 smithi134 ceph-mon[31708]: pgmap v501: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:06.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.393+0000 7f2059a00700 1 -- 172.21.15.81:0/1202507187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2054075840 msgr2=0x7f2054075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:06.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.393+0000 7f2059a00700 1 --2- 172.21.15.81:0/1202507187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2054075840 0x7f2054075c20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2044009990 tx=0x7f2044009ca0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.393+0000 7f2059a00700 1 -- 172.21.15.81:0/1202507187 shutdown_connections 2024-05-03T16:48:06.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.393+0000 7f2059a00700 1 --2- 172.21.15.81:0/1202507187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20541143e0 0x7f20541167d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.393+0000 7f2059a00700 1 --2- 172.21.15.81:0/1202507187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2054075840 0x7f2054075c20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.393+0000 7f2059a00700 1 --2- 172.21.15.81:0/1202507187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2054076160 0x7f2054113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.393+0000 7f2059a00700 1 -- 172.21.15.81:0/1202507187 >> 172.21.15.81:0/1202507187 conn(0x7f20540fef20 msgr2=0x7f2054101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:06.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.393+0000 7f2059a00700 1 -- 172.21.15.81:0/1202507187 shutdown_connections 2024-05-03T16:48:06.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.393+0000 7f2059a00700 1 -- 172.21.15.81:0/1202507187 wait complete. 2024-05-03T16:48:06.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.394+0000 7f2059a00700 1 Processor -- start 2024-05-03T16:48:06.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.394+0000 7f2059a00700 1 -- start start 2024-05-03T16:48:06.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.394+0000 7f2059a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2054075840 0x7f205419ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:06.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.395+0000 7f2059a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2054076160 0x7f20541a0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:06.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.395+0000 7f2059a00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20541143e0 0x7f20541a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:06.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.395+0000 7f2059a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2054119b20 con 0x7f2054076160 2024-05-03T16:48:06.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.395+0000 7f2059a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f20541199a0 con 0x7f2054075840 2024-05-03T16:48:06.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.395+0000 7f2059a00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2054119ca0 con 0x7f20541143e0 2024-05-03T16:48:06.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.395+0000 7f204b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2054076160 0x7f20541a0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:06.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.395+0000 7f204b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2054076160 0x7f20541a0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59818/0 (socket says 172.21.15.81:59818) 2024-05-03T16:48:06.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.395+0000 7f204b400700 1 -- 172.21.15.81:0/1448542515 learned_addr learned my addr 172.21.15.81:0/1448542515 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:06.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.395+0000 7f2053e00700 1 --2- 172.21.15.81:0/1448542515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2054075840 0x7f205419ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:06.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.395+0000 7f204b400700 1 -- 172.21.15.81:0/1448542515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20541143e0 msgr2=0x7f20541a48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:06.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.395+0000 7f204b400700 1 --2- 172.21.15.81:0/1448542515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20541143e0 0x7f20541a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.395+0000 7f204b400700 1 -- 172.21.15.81:0/1448542515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2054075840 msgr2=0x7f205419ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:06.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.395+0000 7f204b400700 1 --2- 172.21.15.81:0/1448542515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2054075840 0x7f205419ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.395+0000 7f204b400700 1 -- 172.21.15.81:0/1448542515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20541a4fe0 con 0x7f2054076160 2024-05-03T16:48:06.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.395+0000 7f2053e00700 1 --2- 172.21.15.81:0/1448542515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2054075840 0x7f205419ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:48:06.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.396+0000 7f204b400700 1 --2- 172.21.15.81:0/1448542515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2054076160 0x7f20541a0510 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f203c00c9b0 tx=0x7f203c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:06.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.396+0000 7f2051600700 1 -- 172.21.15.81:0/1448542515 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c007b00 con 0x7f2054076160 2024-05-03T16:48:06.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.396+0000 7f2051600700 1 -- 172.21.15.81:0/1448542515 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f203c007ca0 con 0x7f2054076160 2024-05-03T16:48:06.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.396+0000 7f2059a00700 1 -- 172.21.15.81:0/1448542515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20541a52d0 con 0x7f2054076160 2024-05-03T16:48:06.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.396+0000 7f2051600700 1 -- 172.21.15.81:0/1448542515 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c018660 con 0x7f2054076160 2024-05-03T16:48:06.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.396+0000 7f2059a00700 1 -- 172.21.15.81:0/1448542515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20541acb50 con 0x7f2054076160 2024-05-03T16:48:06.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.400+0000 7f2051600700 1 -- 172.21.15.81:0/1448542515 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f203c00f450 con 0x7f2054076160 2024-05-03T16:48:06.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.401+0000 7f20659f1b80 1 Processor -- start 2024-05-03T16:48:06.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.401+0000 7f20659f1b80 1 -- start start 2024-05-03T16:48:06.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.402+0000 7f20659f1b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648433669f0 0x564843366dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:06.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.402+0000 7f20659f1b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843367310 0x564843360f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:06.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.402+0000 7f20659f1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564843361580 0x5648433619e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:06.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.402+0000 7f20659f1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5648432b39d0 con 0x564843361580 2024-05-03T16:48:06.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.402+0000 7f20659f1b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564843251710 con 0x5648433669f0 2024-05-03T16:48:06.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.402+0000 7f20659f1b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5648432af990 con 0x564843367310 2024-05-03T16:48:06.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.402+0000 7f2051600700 1 --2- 172.21.15.81:0/1448542515 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f20380b2910 0x7f20380b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:06.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.402+0000 7f204b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564843361580 0x5648433619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:06.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.402+0000 7f204b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564843361580 0x5648433619e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59832/0 (socket says 172.21.15.81:59832) 2024-05-03T16:48:06.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.402+0000 7f204b400700 1 -- 172.21.15.81:0/973315631 learned_addr learned my addr 172.21.15.81:0/973315631 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:06.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.403+0000 7f2053e00700 1 --2- 172.21.15.81:0/973315631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843367310 0x564843360f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:06.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.403+0000 7f2059000700 1 --2- 172.21.15.81:0/973315631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648433669f0 0x564843366dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:06.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.403+0000 7f2051600700 1 -- 172.21.15.81:0/1448542515 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f203c0e28a0 con 0x7f2054076160 2024-05-03T16:48:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.403+0000 7f2059000700 1 --2- 172.21.15.81:0/1448542515 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f20380b2910 0x7f20380b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.403+0000 7f204b400700 1 -- 172.21.15.81:0/973315631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843367310 msgr2=0x564843360f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.403+0000 7f204b400700 1 --2- 172.21.15.81:0/973315631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843367310 0x564843360f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.403+0000 7f204b400700 1 -- 172.21.15.81:0/973315631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648433669f0 msgr2=0x564843366dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.403+0000 7f204b400700 1 --2- 172.21.15.81:0/973315631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648433669f0 0x564843366dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.403+0000 7f204b400700 1 -- 172.21.15.81:0/973315631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564843200880 con 0x564843361580 2024-05-03T16:48:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.403+0000 7f204b400700 1 --2- 172.21.15.81:0/973315631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564843361580 0x5648433619e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f203c0a59d0 tx=0x7f203c056c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444a93dd673a2187 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.404+0000 7f2049600700 1 -- 172.21.15.81:0/973315631 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c0a9460 con 0x564843361580 2024-05-03T16:48:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.404+0000 7f2049600700 1 -- 172.21.15.81:0/973315631 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f203c0aa050 con 0x564843361580 2024-05-03T16:48:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.404+0000 7f2049600700 1 -- 172.21.15.81:0/973315631 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c0a5be0 con 0x564843361580 2024-05-03T16:48:06.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.405+0000 7f20659f1b80 1 -- 172.21.15.81:0/973315631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564843361580 msgr2=0x5648433619e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:06.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.405+0000 7f2059000700 1 --2- 172.21.15.81:0/1448542515 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f20380b2910 0x7f20380b4dd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f205406bdb0 tx=0x7f204c006d70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:06.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.405+0000 7f20659f1b80 1 --2- 172.21.15.81:0/973315631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564843361580 0x5648433619e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f203c0a59d0 tx=0x7f203c056c20 comp rx=0 tx=0).stop 2024-05-03T16:48:06.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.405+0000 7f20659f1b80 1 -- 172.21.15.81:0/973315631 shutdown_connections 2024-05-03T16:48:06.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.405+0000 7f20659f1b80 1 --2- 172.21.15.81:0/973315631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564843361580 0x5648433619e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.405+0000 7f20659f1b80 1 --2- 172.21.15.81:0/973315631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648433669f0 0x564843366dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.405+0000 7f20659f1b80 1 --2- 172.21.15.81:0/973315631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843367310 0x564843360f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.405+0000 7f20659f1b80 1 -- 172.21.15.81:0/973315631 >> 172.21.15.81:0/973315631 conn(0x56484328fb10 msgr2=0x56484335b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:06.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.405+0000 7f20659f1b80 1 -- 172.21.15.81:0/973315631 shutdown_connections 2024-05-03T16:48:06.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.405+0000 7f20659f1b80 1 -- 172.21.15.81:0/973315631 wait complete. 2024-05-03T16:48:06.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.405+0000 7f20659f1b80 1 -- start start 2024-05-03T16:48:06.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.406+0000 7f20659f1b80 1 Processor -- start 2024-05-03T16:48:06.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.406+0000 7f20659f1b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564843361580 0x56484336d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:06.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.406+0000 7f20659f1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648433669f0 0x56484336a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:06.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.406+0000 7f20659f1b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843367310 0x56484336a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:06.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.406+0000 7f20659f1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56484336dd80 con 0x5648433669f0 2024-05-03T16:48:06.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.406+0000 7f20659f1b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564843219ad0 con 0x564843361580 2024-05-03T16:48:06.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.406+0000 7f20659f1b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56484336df00 con 0x564843367310 2024-05-03T16:48:06.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.406+0000 7f20659f1b80 10 client.0 _ll_register_callbacks cb 0x56484325ac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:48:06.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.407+0000 7f204b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648433669f0 0x56484336a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:06.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.407+0000 7f204b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648433669f0 0x56484336a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59848/0 (socket says 172.21.15.81:59848) 2024-05-03T16:48:06.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.407+0000 7f204b400700 1 -- 172.21.15.81:0/2440288497 learned_addr learned my addr 172.21.15.81:0/2440288497 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:06.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.407+0000 7f2053e00700 1 --2- 172.21.15.81:0/2440288497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564843361580 0x56484336d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:06.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.407+0000 7f2059000700 1 --2- 172.21.15.81:0/2440288497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843367310 0x56484336a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:06.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.407+0000 7f204b400700 1 -- 172.21.15.81:0/2440288497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843367310 msgr2=0x56484336a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:06.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.407+0000 7f204b400700 1 --2- 172.21.15.81:0/2440288497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843367310 0x56484336a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.407+0000 7f204b400700 1 -- 172.21.15.81:0/2440288497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564843361580 msgr2=0x56484336d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:06.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.407+0000 7f204b400700 1 --2- 172.21.15.81:0/2440288497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564843361580 0x56484336d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.407+0000 7f204b400700 1 -- 172.21.15.81:0/2440288497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648432793d0 con 0x5648433669f0 2024-05-03T16:48:06.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.407+0000 7f204b400700 1 --2- 172.21.15.81:0/2440288497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648433669f0 0x56484336a430 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f203c0a9650 tx=0x7f203c0b2860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65d64c321924554 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:06.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.407+0000 7f2042000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:48:06.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.408+0000 7f2042000700 1 -- 172.21.15.81:0/2440288497 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c0a9950 con 0x5648433669f0 2024-05-03T16:48:06.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.408+0000 7f2042000700 1 -- 172.21.15.81:0/2440288497 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f203c0a9bb0 con 0x5648433669f0 2024-05-03T16:48:06.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.408+0000 7f20659f1b80 1 -- 172.21.15.81:0/2440288497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f203c0aa050 con 0x5648433669f0 2024-05-03T16:48:06.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.408+0000 7f2042000700 1 -- 172.21.15.81:0/2440288497 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f203c0add00 con 0x5648433669f0 2024-05-03T16:48:06.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.408+0000 7f20659f1b80 10 client.15084 fetch_fsmap learned FSMap version 29 2024-05-03T16:48:06.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.408+0000 7f20659f1b80 1 -- 172.21.15.81:0/2440288497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564843378680 con 0x5648433669f0 2024-05-03T16:48:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.408+0000 7f2042000700 1 -- 172.21.15.81:0/2440288497 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f203c0aa050 con 0x5648433669f0 2024-05-03T16:48:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.408+0000 7f2042000700 1 -- 172.21.15.81:0/2440288497 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f203c0a52c0 con 0x5648433669f0 2024-05-03T16:48:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.409+0000 7f20659f1b80 10 client.15084 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:48:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.409+0000 7f20659f1b80 10 client.15084 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-03T16:48:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.409+0000 7f20659f1b80 20 client.15084 populate_metadata read hostname 'smithi081' 2024-05-03T16:48:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.409+0000 7f20659f1b80 1 --2- 172.21.15.81:0/2440288497 >> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] conn(0x56484337a5d0 0x56484337ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.409+0000 7f20659f1b80 4 client.15084 mds_command: new command op to 34418 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T16:48:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.409+0000 7f20659f1b80 1 -- 172.21.15.81:0/2440288497 --> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56484332e180 con 0x56484337a5d0 2024-05-03T16:48:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.409+0000 7f2053e00700 1 --2- 172.21.15.81:0/2440288497 >> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] conn(0x56484337a5d0 0x56484337ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.411+0000 7f2053e00700 1 --2- 172.21.15.81:0/2440288497 >> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] conn(0x56484337a5d0 0x56484337ba40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b71f9c659c2deede server_cookie=fd7e9f6c12327106 in_seq=0 out_seq=0 2024-05-03T16:48:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.411+0000 7f2042000700 10 client.15084 ms_handle_connect on v2:172.21.15.134:6834/3681203129 2024-05-03T16:48:06.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.413+0000 7f2042000700 1 -- 172.21.15.81:0/2440288497 <== mds.2 v2:172.21.15.134:6834/3681203129 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56484332e180 con 0x56484337a5d0 2024-05-03T16:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.413+0000 7f2042000700 10 client.15084 handle_command_reply: tid=0 2024-05-03T16:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.413+0000 7f20659f1b80 1 client.15084 shutdown 2024-05-03T16:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.413+0000 7f20659f1b80 1 -- 172.21.15.81:0/2440288497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648433669f0 msgr2=0x56484336a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.413+0000 7f20659f1b80 1 --2- 172.21.15.81:0/2440288497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648433669f0 0x56484336a430 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f203c0a9650 tx=0x7f203c0b2860 comp rx=0 tx=0).stop 2024-05-03T16:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.413+0000 7f20659f1b80 1 -- 172.21.15.81:0/2440288497 shutdown_connections 2024-05-03T16:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.413+0000 7f20659f1b80 1 --2- 172.21.15.81:0/2440288497 >> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] conn(0x56484337a5d0 0x56484337ba40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.413+0000 7f20659f1b80 1 --2- 172.21.15.81:0/2440288497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843367310 0x56484336a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.413+0000 7f20659f1b80 1 --2- 172.21.15.81:0/2440288497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564843361580 0x56484336d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.413+0000 7f20659f1b80 1 --2- 172.21.15.81:0/2440288497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648433669f0 0x56484336a430 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.413+0000 7f20659f1b80 1 -- 172.21.15.81:0/2440288497 >> 172.21.15.81:0/2440288497 conn(0x56484328fb10 msgr2=0x56484335b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.413+0000 7f2042000700 0 client.15084 ms_handle_reset on v2:172.21.15.134:6834/3681203129 2024-05-03T16:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.413+0000 7f20659f1b80 1 -- 172.21.15.81:0/2440288497 shutdown_connections 2024-05-03T16:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.413+0000 7f20659f1b80 1 -- 172.21.15.81:0/2440288497 wait complete. 2024-05-03T16:48:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.414+0000 7f20659f1b80 20 client.15084 trim_cache size 0 max 16384 2024-05-03T16:48:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.436+0000 7f20659f1b80 1 Processor -- start 2024-05-03T16:48:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.436+0000 7f20659f1b80 1 -- start start 2024-05-03T16:48:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.437+0000 7f20659f1b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843361580 0x564843360f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.437+0000 7f20659f1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648433669f0 0x56484336a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.437+0000 7f20659f1b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564843367310 0x5648433677b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.437+0000 7f20659f1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564843379d80 con 0x5648433669f0 2024-05-03T16:48:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.437+0000 7f20659f1b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56484337a450 con 0x564843367310 2024-05-03T16:48:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.437+0000 7f20659f1b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56484337ab20 con 0x564843361580 2024-05-03T16:48:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.437+0000 7f204b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648433669f0 0x56484336a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.437+0000 7f204b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648433669f0 0x56484336a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59864/0 (socket says 172.21.15.81:59864) 2024-05-03T16:48:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.437+0000 7f204b400700 1 -- 172.21.15.81:0/3774637185 learned_addr learned my addr 172.21.15.81:0/3774637185 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.437+0000 7f2059000700 1 --2- 172.21.15.81:0/3774637185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564843367310 0x5648433677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.437+0000 7f2053e00700 1 --2- 172.21.15.81:0/3774637185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843361580 0x564843360f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.438+0000 7f204b400700 1 -- 172.21.15.81:0/3774637185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843361580 msgr2=0x564843360f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.438+0000 7f204b400700 1 --2- 172.21.15.81:0/3774637185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843361580 0x564843360f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.438+0000 7f204b400700 1 -- 172.21.15.81:0/3774637185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564843367310 msgr2=0x5648433677b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.438+0000 7f204b400700 1 --2- 172.21.15.81:0/3774637185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564843367310 0x5648433677b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.438+0000 7f204b400700 1 -- 172.21.15.81:0/3774637185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648433689a0 con 0x5648433669f0 2024-05-03T16:48:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.438+0000 7f204b400700 1 --2- 172.21.15.81:0/3774637185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648433669f0 0x56484336a9a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f203c0a6bc0 tx=0x7f203c00a700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e819b69841861b server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.438+0000 7f2048c00700 1 -- 172.21.15.81:0/3774637185 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c08b070 con 0x5648433669f0 2024-05-03T16:48:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.438+0000 7f2048c00700 1 -- 172.21.15.81:0/3774637185 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f203c0a9950 con 0x5648433669f0 2024-05-03T16:48:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.438+0000 7f2048c00700 1 -- 172.21.15.81:0/3774637185 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c0cc0d0 con 0x5648433669f0 2024-05-03T16:48:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.439+0000 7f20659f1b80 1 -- 172.21.15.81:0/3774637185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648433669f0 msgr2=0x56484336a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.439+0000 7f20659f1b80 1 --2- 172.21.15.81:0/3774637185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648433669f0 0x56484336a9a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f203c0a6bc0 tx=0x7f203c00a700 comp rx=0 tx=0).stop 2024-05-03T16:48:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.439+0000 7f20659f1b80 1 -- 172.21.15.81:0/3774637185 shutdown_connections 2024-05-03T16:48:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.439+0000 7f20659f1b80 1 --2- 172.21.15.81:0/3774637185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843361580 0x564843360f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.439+0000 7f20659f1b80 1 --2- 172.21.15.81:0/3774637185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564843367310 0x5648433677b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.439+0000 7f20659f1b80 1 --2- 172.21.15.81:0/3774637185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648433669f0 0x56484336a9a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.439+0000 7f20659f1b80 1 -- 172.21.15.81:0/3774637185 >> 172.21.15.81:0/3774637185 conn(0x56484328fb10 msgr2=0x564843364430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.439+0000 7f20659f1b80 1 -- 172.21.15.81:0/3774637185 shutdown_connections 2024-05-03T16:48:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.439+0000 7f20659f1b80 1 -- 172.21.15.81:0/3774637185 wait complete. 2024-05-03T16:48:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.440+0000 7f20659f1b80 1 -- start start 2024-05-03T16:48:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.440+0000 7f20659f1b80 1 Processor -- start 2024-05-03T16:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.440+0000 7f20659f1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564843361580 0x564843369f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.440+0000 7f20659f1b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648433669f0 0x56484336a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.440+0000 7f20659f1b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843367310 0x56484336a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.440+0000 7f20659f1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56484337b8c0 con 0x564843361580 2024-05-03T16:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.440+0000 7f20659f1b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56484337b1f0 con 0x5648433669f0 2024-05-03T16:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.440+0000 7f20659f1b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56484337bf90 con 0x564843367310 2024-05-03T16:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.440+0000 7f20659f1b80 10 client.0 _ll_register_callbacks cb 0x56484325ac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.441+0000 7f2053e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564843361580 0x564843369f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.441+0000 7f2053e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564843361580 0x564843369f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59868/0 (socket says 172.21.15.81:59868) 2024-05-03T16:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.441+0000 7f2053e00700 1 -- 172.21.15.81:0/3342185616 learned_addr learned my addr 172.21.15.81:0/3342185616 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.441+0000 7f204b400700 1 --2- 172.21.15.81:0/3342185616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648433669f0 0x56484336a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.441+0000 7f2059000700 1 --2- 172.21.15.81:0/3342185616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843367310 0x56484336a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.441+0000 7f2053e00700 1 -- 172.21.15.81:0/3342185616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843367310 msgr2=0x56484336a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.441+0000 7f2053e00700 1 --2- 172.21.15.81:0/3342185616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843367310 0x56484336a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.441+0000 7f2053e00700 1 -- 172.21.15.81:0/3342185616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648433669f0 msgr2=0x56484336a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.441+0000 7f2053e00700 1 --2- 172.21.15.81:0/3342185616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648433669f0 0x56484336a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.441+0000 7f2053e00700 1 -- 172.21.15.81:0/3342185616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564843383490 con 0x564843361580 2024-05-03T16:48:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.441+0000 7f2053e00700 1 --2- 172.21.15.81:0/3342185616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564843361580 0x564843369f30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2044009750 tx=0x7f2044005260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58d50192ad8a93b server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.441+0000 7f2042000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:48:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.442+0000 7f2042000700 1 -- 172.21.15.81:0/3342185616 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044005690 con 0x564843361580 2024-05-03T16:48:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.442+0000 7f20659f1b80 1 -- 172.21.15.81:0/3342185616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f203c0a9950 con 0x564843361580 2024-05-03T16:48:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.442+0000 7f2042000700 1 -- 172.21.15.81:0/3342185616 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f20440037c0 con 0x564843361580 2024-05-03T16:48:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.442+0000 7f2042000700 1 -- 172.21.15.81:0/3342185616 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2044036050 con 0x564843361580 2024-05-03T16:48:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.442+0000 7f20659f1b80 10 client.15090 fetch_fsmap learned FSMap version 29 2024-05-03T16:48:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.442+0000 7f20659f1b80 1 -- 172.21.15.81:0/3342185616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5648433e5fb0 con 0x564843361580 2024-05-03T16:48:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.442+0000 7f2042000700 1 -- 172.21.15.81:0/3342185616 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f203c0a9950 con 0x564843361580 2024-05-03T16:48:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.443+0000 7f2042000700 1 -- 172.21.15.81:0/3342185616 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f204400f460 con 0x564843361580 2024-05-03T16:48:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.443+0000 7f20659f1b80 10 client.15090 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:48:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.443+0000 7f20659f1b80 10 client.15090 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-03T16:48:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.443+0000 7f20659f1b80 20 client.15090 populate_metadata read hostname 'smithi081' 2024-05-03T16:48:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.443+0000 7f20659f1b80 1 --2- 172.21.15.81:0/3342185616 >> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] conn(0x5648433eabd0 0x5648433e98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.443+0000 7f20659f1b80 4 client.15090 mds_command: new command op to 34418 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T16:48:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.443+0000 7f20659f1b80 1 -- 172.21.15.81:0/3342185616 --> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] -- command(tid 0: {"prefix": "status"}) -- 0x5648432c13b0 con 0x5648433eabd0 2024-05-03T16:48:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.444+0000 7f204b400700 1 --2- 172.21.15.81:0/3342185616 >> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] conn(0x5648433eabd0 0x5648433e98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.444+0000 7f204b400700 1 --2- 172.21.15.81:0/3342185616 >> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] conn(0x5648433eabd0 0x5648433e98e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b88d5bd72ede9d4a server_cookie=ad7e788b5e40f9fa in_seq=0 out_seq=0 2024-05-03T16:48:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.444+0000 7f2042000700 10 client.15090 ms_handle_connect on v2:172.21.15.134:6834/3681203129 2024-05-03T16:48:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.445+0000 7f2042000700 1 -- 172.21.15.81:0/3342185616 <== mds.2 v2:172.21.15.134:6834/3681203129 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5648432c13b0 con 0x5648433eabd0 2024-05-03T16:48:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.445+0000 7f2042000700 10 client.15090 handle_command_reply: tid=0 2024-05-03T16:48:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.445+0000 7f20659f1b80 1 client.15090 shutdown 2024-05-03T16:48:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.445+0000 7f20659f1b80 1 -- 172.21.15.81:0/3342185616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564843361580 msgr2=0x564843369f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.445+0000 7f20659f1b80 1 --2- 172.21.15.81:0/3342185616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564843361580 0x564843369f30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2044009750 tx=0x7f2044005260 comp rx=0 tx=0).stop 2024-05-03T16:48:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.445+0000 7f20659f1b80 1 -- 172.21.15.81:0/3342185616 shutdown_connections 2024-05-03T16:48:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.445+0000 7f20659f1b80 1 --2- 172.21.15.81:0/3342185616 >> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] conn(0x5648433eabd0 0x5648433e98e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.445+0000 7f20659f1b80 1 --2- 172.21.15.81:0/3342185616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564843367310 0x56484336a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.445+0000 7f20659f1b80 1 --2- 172.21.15.81:0/3342185616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564843361580 0x564843369f30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.445+0000 7f20659f1b80 1 --2- 172.21.15.81:0/3342185616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648433669f0 0x56484336a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.445+0000 7f2042000700 0 client.15090 ms_handle_reset on v2:172.21.15.134:6834/3681203129 2024-05-03T16:48:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.445+0000 7f20659f1b80 1 -- 172.21.15.81:0/3342185616 >> 172.21.15.81:0/3342185616 conn(0x56484328fb10 msgr2=0x5648433677b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.446+0000 7f20659f1b80 1 -- 172.21.15.81:0/3342185616 shutdown_connections 2024-05-03T16:48:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.446+0000 7f20659f1b80 1 -- 172.21.15.81:0/3342185616 wait complete. 2024-05-03T16:48:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.446+0000 7f20659f1b80 20 client.15090 trim_cache size 0 max 16384 2024-05-03T16:48:06.451 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-03T16:48:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8988869e-096a-11ef-bc97-c7b262605968", 2024-05-03T16:48:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 2, 2024-05-03T16:48:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 34418, 2024-05-03T16:48:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-05-03T16:48:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-05-03T16:48:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-05-03T16:48:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 161.88139678900001, 2024-05-03T16:48:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 29, 2024-05-03T16:48:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 91, 2024-05-03T16:48:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 91, 2024-05-03T16:48:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 298.40923494800001 2024-05-03T16:48:06.451 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-03T16:48:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.446+0000 7f2059a00700 1 -- 172.21.15.81:0/1448542515 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f20380b2910 msgr2=0x7f20380b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.446+0000 7f2059a00700 1 --2- 172.21.15.81:0/1448542515 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f20380b2910 0x7f20380b4dd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f205406bdb0 tx=0x7f204c006d70 comp rx=0 tx=0).stop 2024-05-03T16:48:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.447+0000 7f2059a00700 1 -- 172.21.15.81:0/1448542515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2054076160 msgr2=0x7f20541a0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.447+0000 7f2059a00700 1 --2- 172.21.15.81:0/1448542515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2054076160 0x7f20541a0510 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f203c00c9b0 tx=0x7f203c00cd70 comp rx=0 tx=0).stop 2024-05-03T16:48:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.447+0000 7f2059a00700 1 -- 172.21.15.81:0/1448542515 shutdown_connections 2024-05-03T16:48:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.447+0000 7f2059a00700 1 --2- 172.21.15.81:0/1448542515 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f20380b2910 0x7f20380b4dd0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.447+0000 7f2059a00700 1 --2- 172.21.15.81:0/1448542515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20541143e0 0x7f20541a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.447+0000 7f2059a00700 1 --2- 172.21.15.81:0/1448542515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2054075840 0x7f205419ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.447+0000 7f2059a00700 1 --2- 172.21.15.81:0/1448542515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2054076160 0x7f20541a0510 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.447+0000 7f2059a00700 1 -- 172.21.15.81:0/1448542515 >> 172.21.15.81:0/1448542515 conn(0x7f20540fef20 msgr2=0x7f20540ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.447+0000 7f2059a00700 1 -- 172.21.15.81:0/1448542515 shutdown_connections 2024-05-03T16:48:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:06.447+0000 7f2059a00700 1 -- 172.21.15.81:0/1448542515 wait complete. 2024-05-03T16:48:07.403 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell mds.h status 2024-05-03T16:48:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:48:07.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:07 smithi081 ceph-mon[28640]: pgmap v502: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:48:08.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:07 smithi146 ceph-mon[32357]: pgmap v502: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:48:08.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:07 smithi134 ceph-mon[31708]: pgmap v502: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:48:09.052 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:08 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:48:09.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:08 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:48:09.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:08 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:48:09.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:09 smithi081 ceph-mon[28640]: pgmap v503: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:09.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:09 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:48:09.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:09 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:48:09.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:09 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:48:10.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:09 smithi146 ceph-mon[32357]: pgmap v503: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:10.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:09 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:48:10.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:09 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:48:10.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:09 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:48:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.156+0000 7fe54d000700 1 -- 172.21.15.81:0/3832348475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe548103fd0 msgr2=0x7fe548108020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.156+0000 7fe54d000700 1 --2- 172.21.15.81:0/3832348475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe548103fd0 0x7fe548108020 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe5340099c0 tx=0x7fe534009cd0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.156+0000 7fe54d000700 1 -- 172.21.15.81:0/3832348475 shutdown_connections 2024-05-03T16:48:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.156+0000 7fe54d000700 1 --2- 172.21.15.81:0/3832348475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe548108700 0x7fe5481102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.156+0000 7fe54d000700 1 --2- 172.21.15.81:0/3832348475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe548103620 0x7fe548103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.156+0000 7fe54d000700 1 --2- 172.21.15.81:0/3832348475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe548103fd0 0x7fe548108020 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.156+0000 7fe54d000700 1 -- 172.21.15.81:0/3832348475 >> 172.21.15.81:0/3832348475 conn(0x7fe5480feeb0 msgr2=0x7fe5481012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.156+0000 7fe54d000700 1 -- 172.21.15.81:0/3832348475 shutdown_connections 2024-05-03T16:48:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.156+0000 7fe54d000700 1 -- 172.21.15.81:0/3832348475 wait complete. 2024-05-03T16:48:10.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.157+0000 7fe54d000700 1 Processor -- start 2024-05-03T16:48:10.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.158+0000 7fe54d000700 1 -- start start 2024-05-03T16:48:10.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.158+0000 7fe54d000700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe548103620 0x7fe5481a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:10.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.158+0000 7fe54d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe548103fd0 0x7fe5481a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:10.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.158+0000 7fe54d000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe548108700 0x7fe54819b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:10.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.158+0000 7fe54d000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe548113420 con 0x7fe548103fd0 2024-05-03T16:48:10.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.158+0000 7fe54d000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe5481132a0 con 0x7fe548108700 2024-05-03T16:48:10.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.158+0000 7fe54d000700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe5481135a0 con 0x7fe548103620 2024-05-03T16:48:10.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.158+0000 7fe546a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe548103fd0 0x7fe5481a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:10.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.158+0000 7fe546a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe548103fd0 0x7fe5481a1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59886/0 (socket says 172.21.15.81:59886) 2024-05-03T16:48:10.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.159+0000 7fe546a00700 1 -- 172.21.15.81:0/1990249172 learned_addr learned my addr 172.21.15.81:0/1990249172 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:10.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.159+0000 7fe547400700 1 --2- 172.21.15.81:0/1990249172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe548103620 0x7fe5481a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:10.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.159+0000 7fe547e00700 1 --2- 172.21.15.81:0/1990249172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe548108700 0x7fe54819b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:10.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.159+0000 7fe546a00700 1 -- 172.21.15.81:0/1990249172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe548103620 msgr2=0x7fe5481a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.159+0000 7fe546a00700 1 --2- 172.21.15.81:0/1990249172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe548103620 0x7fe5481a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.159+0000 7fe546a00700 1 -- 172.21.15.81:0/1990249172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe548108700 msgr2=0x7fe54819b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.159+0000 7fe546a00700 1 --2- 172.21.15.81:0/1990249172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe548108700 0x7fe54819b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.159+0000 7fe546a00700 1 -- 172.21.15.81:0/1990249172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54819c140 con 0x7fe548103fd0 2024-05-03T16:48:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.159+0000 7fe546a00700 1 --2- 172.21.15.81:0/1990249172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe548103fd0 0x7fe5481a1d60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe53400b580 tx=0x7fe53400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.160+0000 7fe53fe00700 1 -- 172.21.15.81:0/1990249172 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe534027070 con 0x7fe548103fd0 2024-05-03T16:48:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.160+0000 7fe54d000700 1 -- 172.21.15.81:0/1990249172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe54819c3d0 con 0x7fe548103fd0 2024-05-03T16:48:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.160+0000 7fe53fe00700 1 -- 172.21.15.81:0/1990249172 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe534022470 con 0x7fe548103fd0 2024-05-03T16:48:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.160+0000 7fe53fe00700 1 -- 172.21.15.81:0/1990249172 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe534017650 con 0x7fe548103fd0 2024-05-03T16:48:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.160+0000 7fe54d000700 1 -- 172.21.15.81:0/1990249172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5481a86f0 con 0x7fe548103fd0 2024-05-03T16:48:10.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.164+0000 7fe53fe00700 1 -- 172.21.15.81:0/1990249172 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe53402a070 con 0x7fe548103fd0 2024-05-03T16:48:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.165+0000 7fe559032b80 1 Processor -- start 2024-05-03T16:48:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.165+0000 7fe559032b80 1 -- start start 2024-05-03T16:48:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.165+0000 7fe53fe00700 1 --2- 172.21.15.81:0/1990249172 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe52c0b2910 0x7fe52c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.165+0000 7fe559032b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87467a9f0 0x55b87467add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.165+0000 7fe559032b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 0x55b874674f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.165+0000 7fe559032b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b874675580 0x55b8746759e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.165+0000 7fe559032b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b8745c79d0 con 0x55b87467b310 2024-05-03T16:48:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.165+0000 7fe559032b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b874565710 con 0x55b874675580 2024-05-03T16:48:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.165+0000 7fe559032b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b8745c3990 con 0x55b87467a9f0 2024-05-03T16:48:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.166+0000 7fe53fe00700 1 -- 172.21.15.81:0/1990249172 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fe5340e35f0 con 0x7fe548103fd0 2024-05-03T16:48:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.166+0000 7fe547e00700 1 --2- 172.21.15.81:0/1990249172 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe52c0b2910 0x7fe52c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.166+0000 7fe546a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 0x55b874674f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.166+0000 7fe546a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 0x55b874674f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59890/0 (socket says 172.21.15.81:59890) 2024-05-03T16:48:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.166+0000 7fe546a00700 1 -- 172.21.15.81:0/91681256 learned_addr learned my addr 172.21.15.81:0/91681256 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.166+0000 7fe547400700 1 --2- 172.21.15.81:0/91681256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87467a9f0 0x55b87467add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.166+0000 7fe547e00700 1 --2- 172.21.15.81:0/91681256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b874675580 0x55b8746759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.167+0000 7fe547e00700 1 --2- 172.21.15.81:0/1990249172 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe52c0b2910 0x7fe52c0b4dd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe5400059d0 tx=0x7fe54000c4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:10.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.167+0000 7fe547400700 1 -- 172.21.15.81:0/91681256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b874675580 msgr2=0x55b8746759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:10.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.167+0000 7fe547400700 1 --2- 172.21.15.81:0/91681256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b874675580 0x55b8746759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.167+0000 7fe547400700 1 -- 172.21.15.81:0/91681256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 msgr2=0x55b874674f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:10.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.167+0000 7fe547400700 1 --2- 172.21.15.81:0/91681256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 0x55b874674f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.167+0000 7fe547400700 1 -- 172.21.15.81:0/91681256 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b874514880 con 0x55b87467a9f0 2024-05-03T16:48:10.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.167+0000 7fe546a00700 1 --2- 172.21.15.81:0/91681256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 0x55b874674f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:48:10.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.167+0000 7fe547400700 1 --2- 172.21.15.81:0/91681256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87467a9f0 0x55b87467add0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe54819cb20 tx=0x7fe538007990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=277da4c6b5a3e0af server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:10.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.167+0000 7fe53cc00700 1 -- 172.21.15.81:0/91681256 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538004bb0 con 0x55b87467a9f0 2024-05-03T16:48:10.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.168+0000 7fe53cc00700 1 -- 172.21.15.81:0/91681256 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe538004d50 con 0x55b87467a9f0 2024-05-03T16:48:10.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.168+0000 7fe53cc00700 1 -- 172.21.15.81:0/91681256 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538014e60 con 0x55b87467a9f0 2024-05-03T16:48:10.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.168+0000 7fe559032b80 1 -- 172.21.15.81:0/91681256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87467a9f0 msgr2=0x55b87467add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:10.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.168+0000 7fe559032b80 1 --2- 172.21.15.81:0/91681256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87467a9f0 0x55b87467add0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe54819cb20 tx=0x7fe538007990 comp rx=0 tx=0).stop 2024-05-03T16:48:10.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.169+0000 7fe559032b80 1 -- 172.21.15.81:0/91681256 shutdown_connections 2024-05-03T16:48:10.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.169+0000 7fe559032b80 1 --2- 172.21.15.81:0/91681256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87467a9f0 0x55b87467add0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.169+0000 7fe559032b80 1 --2- 172.21.15.81:0/91681256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b874675580 0x55b8746759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.169+0000 7fe559032b80 1 --2- 172.21.15.81:0/91681256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 0x55b874674f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.169+0000 7fe559032b80 1 -- 172.21.15.81:0/91681256 >> 172.21.15.81:0/91681256 conn(0x55b8745a3b10 msgr2=0x55b87466f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:10.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.169+0000 7fe559032b80 1 -- 172.21.15.81:0/91681256 shutdown_connections 2024-05-03T16:48:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.169+0000 7fe559032b80 1 -- 172.21.15.81:0/91681256 wait complete. 2024-05-03T16:48:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.169+0000 7fe559032b80 1 -- start start 2024-05-03T16:48:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.169+0000 7fe559032b80 1 Processor -- start 2024-05-03T16:48:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.170+0000 7fe559032b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b874675580 0x55b874681010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.170+0000 7fe559032b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b87467a9f0 0x55b87467e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.170+0000 7fe559032b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 0x55b87467e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.170+0000 7fe559032b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b874681d20 con 0x55b87467b310 2024-05-03T16:48:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.170+0000 7fe559032b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b87452dad0 con 0x55b87467a9f0 2024-05-03T16:48:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.170+0000 7fe559032b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b874681ea0 con 0x55b874675580 2024-05-03T16:48:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.170+0000 7fe559032b80 10 client.0 _ll_register_callbacks cb 0x55b87456ec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:48:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.170+0000 7fe547e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 0x55b87467e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.171+0000 7fe547e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 0x55b87467e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59906/0 (socket says 172.21.15.81:59906) 2024-05-03T16:48:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.171+0000 7fe547e00700 1 -- 172.21.15.81:0/3104173421 learned_addr learned my addr 172.21.15.81:0/3104173421 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.171+0000 7fe547400700 1 --2- 172.21.15.81:0/3104173421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b874675580 0x55b874681010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.171+0000 7fe546a00700 1 --2- 172.21.15.81:0/3104173421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b87467a9f0 0x55b87467e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.171+0000 7fe547e00700 1 -- 172.21.15.81:0/3104173421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b874675580 msgr2=0x55b874681010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.171+0000 7fe547e00700 1 --2- 172.21.15.81:0/3104173421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b874675580 0x55b874681010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.171+0000 7fe547e00700 1 -- 172.21.15.81:0/3104173421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b87467a9f0 msgr2=0x55b87467e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.171+0000 7fe547e00700 1 --2- 172.21.15.81:0/3104173421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b87467a9f0 0x55b87467e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.171+0000 7fe547e00700 1 -- 172.21.15.81:0/3104173421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b87458d3d0 con 0x55b87467b310 2024-05-03T16:48:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.172+0000 7fe547e00700 1 --2- 172.21.15.81:0/3104173421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 0x55b87467e8f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe5400129d0 tx=0x7fe5400047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1395860f2cf9ff5 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.172+0000 7fe531600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:48:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.172+0000 7fe531600700 1 -- 172.21.15.81:0/3104173421 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe540012d90 con 0x55b87467b310 2024-05-03T16:48:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.172+0000 7fe531600700 1 -- 172.21.15.81:0/3104173421 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fe540011870 con 0x55b87467b310 2024-05-03T16:48:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.172+0000 7fe559032b80 1 -- 172.21.15.81:0/3104173421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe538004d50 con 0x55b87467b310 2024-05-03T16:48:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.172+0000 7fe531600700 1 -- 172.21.15.81:0/3104173421 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe540011a70 con 0x55b87467b310 2024-05-03T16:48:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.172+0000 7fe559032b80 10 client.15102 fetch_fsmap learned FSMap version 29 2024-05-03T16:48:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.172+0000 7fe559032b80 1 -- 172.21.15.81:0/3104173421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b87468c540 con 0x55b87467b310 2024-05-03T16:48:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.173+0000 7fe531600700 1 -- 172.21.15.81:0/3104173421 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe538004d50 con 0x55b87467b310 2024-05-03T16:48:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.173+0000 7fe531600700 1 -- 172.21.15.81:0/3104173421 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe54001ec40 con 0x55b87467b310 2024-05-03T16:48:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.173+0000 7fe559032b80 10 client.15102 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:48:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.173+0000 7fe559032b80 10 client.15102 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-03T16:48:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.173+0000 7fe559032b80 20 client.15102 populate_metadata read hostname 'smithi081' 2024-05-03T16:48:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.173+0000 7fe559032b80 1 --2- 172.21.15.81:0/3104173421 >> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] conn(0x55b87468ebc0 0x55b874690030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:10.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.173+0000 7fe559032b80 4 client.15102 mds_command: new command op to 34439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T16:48:10.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.173+0000 7fe559032b80 1 -- 172.21.15.81:0/3104173421 --> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b874642180 con 0x55b87468ebc0 2024-05-03T16:48:10.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.174+0000 7fe547400700 1 --2- 172.21.15.81:0/3104173421 >> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] conn(0x55b87468ebc0 0x55b874690030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:10.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.175+0000 7fe547400700 1 --2- 172.21.15.81:0/3104173421 >> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] conn(0x55b87468ebc0 0x55b874690030 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dfb915fe61c50d0a server_cookie=bdd8e5815e266bdc in_seq=0 out_seq=0 2024-05-03T16:48:10.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.175+0000 7fe531600700 10 client.15102 ms_handle_connect on v2:172.21.15.134:6836/2915415754 2024-05-03T16:48:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.177+0000 7fe531600700 1 -- 172.21.15.81:0/3104173421 <== mds.1 v2:172.21.15.134:6836/2915415754 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b874642180 con 0x55b87468ebc0 2024-05-03T16:48:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.177+0000 7fe531600700 10 client.15102 handle_command_reply: tid=0 2024-05-03T16:48:10.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.177+0000 7fe559032b80 1 client.15102 shutdown 2024-05-03T16:48:10.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.177+0000 7fe559032b80 1 -- 172.21.15.81:0/3104173421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 msgr2=0x55b87467e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:10.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.177+0000 7fe559032b80 1 --2- 172.21.15.81:0/3104173421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 0x55b87467e8f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe5400129d0 tx=0x7fe5400047c0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.178+0000 7fe559032b80 1 -- 172.21.15.81:0/3104173421 shutdown_connections 2024-05-03T16:48:10.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.178+0000 7fe559032b80 1 --2- 172.21.15.81:0/3104173421 >> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] conn(0x55b87468ebc0 0x55b874690030 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.178+0000 7fe559032b80 1 --2- 172.21.15.81:0/3104173421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b874675580 0x55b874681010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.178+0000 7fe559032b80 1 --2- 172.21.15.81:0/3104173421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 0x55b87467e8f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.178+0000 7fe531600700 0 client.15102 ms_handle_reset on v2:172.21.15.134:6836/2915415754 2024-05-03T16:48:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.178+0000 7fe559032b80 1 --2- 172.21.15.81:0/3104173421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b87467a9f0 0x55b87467e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.178+0000 7fe559032b80 1 -- 172.21.15.81:0/3104173421 >> 172.21.15.81:0/3104173421 conn(0x55b8745a3b10 msgr2=0x55b87466f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.178+0000 7fe559032b80 1 -- 172.21.15.81:0/3104173421 shutdown_connections 2024-05-03T16:48:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.178+0000 7fe559032b80 1 -- 172.21.15.81:0/3104173421 wait complete. 2024-05-03T16:48:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.178+0000 7fe559032b80 20 client.15102 trim_cache size 0 max 16384 2024-05-03T16:48:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.201+0000 7fe559032b80 1 Processor -- start 2024-05-03T16:48:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.201+0000 7fe559032b80 1 -- start start 2024-05-03T16:48:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.202+0000 7fe559032b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b874675580 0x55b874674f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.202+0000 7fe559032b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87467a9f0 0x55b874678490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.202+0000 7fe559032b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 0x55b8746789d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.202+0000 7fe559032b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b87468e370 con 0x55b87467b310 2024-05-03T16:48:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.202+0000 7fe559032b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b87468ea40 con 0x55b874675580 2024-05-03T16:48:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.202+0000 7fe559032b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b87468f110 con 0x55b87467a9f0 2024-05-03T16:48:10.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.202+0000 7fe547e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 0x55b8746789d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:10.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.202+0000 7fe547e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 0x55b8746789d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59916/0 (socket says 172.21.15.81:59916) 2024-05-03T16:48:10.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.202+0000 7fe547e00700 1 -- 172.21.15.81:0/4083530858 learned_addr learned my addr 172.21.15.81:0/4083530858 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:10.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.202+0000 7fe547400700 1 --2- 172.21.15.81:0/4083530858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b874675580 0x55b874674f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:10.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.202+0000 7fe546a00700 1 --2- 172.21.15.81:0/4083530858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87467a9f0 0x55b874678490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:10.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.203+0000 7fe547e00700 1 -- 172.21.15.81:0/4083530858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87467a9f0 msgr2=0x55b874678490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:10.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.203+0000 7fe547e00700 1 --2- 172.21.15.81:0/4083530858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87467a9f0 0x55b874678490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.203+0000 7fe547e00700 1 -- 172.21.15.81:0/4083530858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b874675580 msgr2=0x55b874674f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:10.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.203+0000 7fe547e00700 1 --2- 172.21.15.81:0/4083530858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b874675580 0x55b874674f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.203+0000 7fe547e00700 1 -- 172.21.15.81:0/4083530858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b874670c10 con 0x55b87467b310 2024-05-03T16:48:10.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.203+0000 7fe547e00700 1 --2- 172.21.15.81:0/4083530858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 0x55b8746789d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe540005920 tx=0x7fe5400278d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dbad1187101c3cb server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:10.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.203+0000 7fe533e00700 1 -- 172.21.15.81:0/4083530858 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54003a030 con 0x55b87467b310 2024-05-03T16:48:10.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.203+0000 7fe533e00700 1 -- 172.21.15.81:0/4083530858 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe5400116c0 con 0x55b87467b310 2024-05-03T16:48:10.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.203+0000 7fe533e00700 1 -- 172.21.15.81:0/4083530858 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe540011090 con 0x55b87467b310 2024-05-03T16:48:10.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.204+0000 7fe559032b80 1 -- 172.21.15.81:0/4083530858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 msgr2=0x55b8746789d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.204+0000 7fe559032b80 1 --2- 172.21.15.81:0/4083530858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 0x55b8746789d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe540005920 tx=0x7fe5400278d0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.204+0000 7fe559032b80 1 -- 172.21.15.81:0/4083530858 shutdown_connections 2024-05-03T16:48:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.204+0000 7fe559032b80 1 --2- 172.21.15.81:0/4083530858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b87467b310 0x55b8746789d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.204+0000 7fe559032b80 1 --2- 172.21.15.81:0/4083530858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b874675580 0x55b874674f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.204+0000 7fe559032b80 1 --2- 172.21.15.81:0/4083530858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87467a9f0 0x55b874678490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.204+0000 7fe559032b80 1 -- 172.21.15.81:0/4083530858 >> 172.21.15.81:0/4083530858 conn(0x55b8745a3b10 msgr2=0x55b87467e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.204+0000 7fe559032b80 1 -- 172.21.15.81:0/4083530858 shutdown_connections 2024-05-03T16:48:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.204+0000 7fe559032b80 1 -- 172.21.15.81:0/4083530858 wait complete. 2024-05-03T16:48:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.205+0000 7fe559032b80 1 -- start start 2024-05-03T16:48:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.205+0000 7fe559032b80 1 Processor -- start 2024-05-03T16:48:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.205+0000 7fe559032b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b874675580 0x55b874674350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.205+0000 7fe559032b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b87467a9f0 0x55b874674890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.205+0000 7fe559032b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87467b310 0x55b874674dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.205+0000 7fe559032b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b87468feb0 con 0x55b874675580 2024-05-03T16:48:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.205+0000 7fe559032b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b87468f7e0 con 0x55b87467a9f0 2024-05-03T16:48:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.205+0000 7fe559032b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b874690580 con 0x55b87467b310 2024-05-03T16:48:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.205+0000 7fe559032b80 10 client.0 _ll_register_callbacks cb 0x55b87456ec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:48:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.206+0000 7fe547400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b874675580 0x55b874674350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.206+0000 7fe547400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b874675580 0x55b874674350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59932/0 (socket says 172.21.15.81:59932) 2024-05-03T16:48:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.206+0000 7fe547400700 1 -- 172.21.15.81:0/3452311688 learned_addr learned my addr 172.21.15.81:0/3452311688 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.206+0000 7fe546a00700 1 --2- 172.21.15.81:0/3452311688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b87467a9f0 0x55b874674890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.206+0000 7fe547400700 1 -- 172.21.15.81:0/3452311688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87467b310 msgr2=0x55b874674dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.206+0000 7fe547e00700 1 --2- 172.21.15.81:0/3452311688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87467b310 0x55b874674dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.206+0000 7fe547400700 1 --2- 172.21.15.81:0/3452311688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87467b310 0x55b874674dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.206+0000 7fe547400700 1 -- 172.21.15.81:0/3452311688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b87467a9f0 msgr2=0x55b874674890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.206+0000 7fe547400700 1 --2- 172.21.15.81:0/3452311688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b87467a9f0 0x55b874674890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.206+0000 7fe547400700 1 -- 172.21.15.81:0/3452311688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b874697c40 con 0x55b874675580 2024-05-03T16:48:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.206+0000 7fe546a00700 1 --2- 172.21.15.81:0/3452311688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b87467a9f0 0x55b874674890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:48:10.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.206+0000 7fe547400700 1 --2- 172.21.15.81:0/3452311688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b874675580 0x55b874674350 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe5380060b0 tx=0x7fe53800a390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c74e29aa9f9fa9 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:10.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.206+0000 7fe531600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:48:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.207+0000 7fe531600700 1 -- 172.21.15.81:0/3452311688 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538003a00 con 0x55b874675580 2024-05-03T16:48:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.207+0000 7fe531600700 1 -- 172.21.15.81:0/3452311688 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fe538003ba0 con 0x55b874675580 2024-05-03T16:48:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.207+0000 7fe559032b80 1 -- 172.21.15.81:0/3452311688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5400116c0 con 0x55b874675580 2024-05-03T16:48:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.207+0000 7fe531600700 1 -- 172.21.15.81:0/3452311688 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe538037050 con 0x55b874675580 2024-05-03T16:48:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.207+0000 7fe559032b80 10 client.15108 fetch_fsmap learned FSMap version 29 2024-05-03T16:48:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.207+0000 7fe559032b80 1 -- 172.21.15.81:0/3452311688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b8746fa550 con 0x55b874675580 2024-05-03T16:48:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.207+0000 7fe531600700 1 -- 172.21.15.81:0/3452311688 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe5400116c0 con 0x55b874675580 2024-05-03T16:48:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.208+0000 7fe531600700 1 -- 172.21.15.81:0/3452311688 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe538028770 con 0x55b874675580 2024-05-03T16:48:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.208+0000 7fe559032b80 10 client.15108 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:48:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.208+0000 7fe559032b80 10 client.15108 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-03T16:48:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.208+0000 7fe559032b80 20 client.15108 populate_metadata read hostname 'smithi081' 2024-05-03T16:48:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.208+0000 7fe559032b80 1 --2- 172.21.15.81:0/3452311688 >> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] conn(0x55b8746feeb0 0x55b8746fdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.208+0000 7fe559032b80 4 client.15108 mds_command: new command op to 34439 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T16:48:10.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.208+0000 7fe559032b80 1 -- 172.21.15.81:0/3452311688 --> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] -- command(tid 0: {"prefix": "status"}) -- 0x55b8745d53b0 con 0x55b8746feeb0 2024-05-03T16:48:10.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.209+0000 7fe546a00700 1 --2- 172.21.15.81:0/3452311688 >> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] conn(0x55b8746feeb0 0x55b8746fdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:10.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.209+0000 7fe546a00700 1 --2- 172.21.15.81:0/3452311688 >> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] conn(0x55b8746feeb0 0x55b8746fdbc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e9536e2ba381dc8b server_cookie=d8f1d8bd77d50e4c in_seq=0 out_seq=0 2024-05-03T16:48:10.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.209+0000 7fe531600700 10 client.15108 ms_handle_connect on v2:172.21.15.134:6836/2915415754 2024-05-03T16:48:10.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.210+0000 7fe531600700 1 -- 172.21.15.81:0/3452311688 <== mds.1 v2:172.21.15.134:6836/2915415754 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b8745d53b0 con 0x55b8746feeb0 2024-05-03T16:48:10.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.210+0000 7fe531600700 10 client.15108 handle_command_reply: tid=0 2024-05-03T16:48:10.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.210+0000 7fe559032b80 1 client.15108 shutdown 2024-05-03T16:48:10.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.210+0000 7fe559032b80 1 -- 172.21.15.81:0/3452311688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b874675580 msgr2=0x55b874674350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:10.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.210+0000 7fe559032b80 1 --2- 172.21.15.81:0/3452311688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b874675580 0x55b874674350 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe5380060b0 tx=0x7fe53800a390 comp rx=0 tx=0).stop 2024-05-03T16:48:10.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.210+0000 7fe559032b80 1 -- 172.21.15.81:0/3452311688 shutdown_connections 2024-05-03T16:48:10.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.210+0000 7fe559032b80 1 --2- 172.21.15.81:0/3452311688 >> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] conn(0x55b8746feeb0 0x55b8746fdbc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.210+0000 7fe559032b80 1 --2- 172.21.15.81:0/3452311688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87467b310 0x55b874674dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.210+0000 7fe559032b80 1 --2- 172.21.15.81:0/3452311688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b874675580 0x55b874674350 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.210+0000 7fe559032b80 1 --2- 172.21.15.81:0/3452311688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b87467a9f0 0x55b874674890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.210+0000 7fe559032b80 1 -- 172.21.15.81:0/3452311688 >> 172.21.15.81:0/3452311688 conn(0x55b8745a3b10 msgr2=0x55b874678490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:10.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.210+0000 7fe531600700 0 client.15108 ms_handle_reset on v2:172.21.15.134:6836/2915415754 2024-05-03T16:48:10.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.211+0000 7fe559032b80 1 -- 172.21.15.81:0/3452311688 shutdown_connections 2024-05-03T16:48:10.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.211+0000 7fe559032b80 1 -- 172.21.15.81:0/3452311688 wait complete. 2024-05-03T16:48:10.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.211+0000 7fe559032b80 20 client.15108 trim_cache size 0 max 16384 2024-05-03T16:48:10.215 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-03T16:48:10.215 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8988869e-096a-11ef-bc97-c7b262605968", 2024-05-03T16:48:10.215 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 1, 2024-05-03T16:48:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 34439, 2024-05-03T16:48:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-05-03T16:48:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-05-03T16:48:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-05-03T16:48:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 166.65863824300001, 2024-05-03T16:48:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 29, 2024-05-03T16:48:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 91, 2024-05-03T16:48:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 91, 2024-05-03T16:48:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 289.75495815300002 2024-05-03T16:48:10.216 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-03T16:48:10.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.211+0000 7fe54d000700 1 -- 172.21.15.81:0/1990249172 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe52c0b2910 msgr2=0x7fe52c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:10.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.211+0000 7fe54d000700 1 --2- 172.21.15.81:0/1990249172 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe52c0b2910 0x7fe52c0b4dd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe5400059d0 tx=0x7fe54000c4a0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.211+0000 7fe54d000700 1 -- 172.21.15.81:0/1990249172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe548103fd0 msgr2=0x7fe5481a1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:10.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.211+0000 7fe54d000700 1 --2- 172.21.15.81:0/1990249172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe548103fd0 0x7fe5481a1d60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe53400b580 tx=0x7fe53400f690 comp rx=0 tx=0).stop 2024-05-03T16:48:10.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.212+0000 7fe54d000700 1 -- 172.21.15.81:0/1990249172 shutdown_connections 2024-05-03T16:48:10.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.212+0000 7fe54d000700 1 --2- 172.21.15.81:0/1990249172 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe52c0b2910 0x7fe52c0b4dd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.212+0000 7fe54d000700 1 --2- 172.21.15.81:0/1990249172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe548103620 0x7fe5481a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.212+0000 7fe54d000700 1 --2- 172.21.15.81:0/1990249172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe548108700 0x7fe54819b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.212+0000 7fe54d000700 1 --2- 172.21.15.81:0/1990249172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe548103fd0 0x7fe5481a1d60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:10.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.212+0000 7fe54d000700 1 -- 172.21.15.81:0/1990249172 >> 172.21.15.81:0/1990249172 conn(0x7fe5480feeb0 msgr2=0x7fe5481011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:10.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.212+0000 7fe54d000700 1 -- 172.21.15.81:0/1990249172 shutdown_connections 2024-05-03T16:48:10.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:10.212+0000 7fe54d000700 1 -- 172.21.15.81:0/1990249172 wait complete. 2024-05-03T16:48:10.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:09 smithi134 ceph-mon[31708]: pgmap v503: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:10.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:09 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:48:10.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:09 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:48:10.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:09 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:48:11.284 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-03T16:48:11.723 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:48:12.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:11 smithi146 ceph-mon[32357]: pgmap v504: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:12.068 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:11 smithi081 ceph-mon[28640]: pgmap v504: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:12.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:11 smithi134 ceph-mon[31708]: pgmap v504: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:13.858 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:13 smithi081 ceph-mon[28640]: pgmap v505: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:48:14.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:13 smithi146 ceph-mon[32357]: pgmap v505: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:48:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.165+0000 7fa0ff400700 1 -- 172.21.15.81:0/4098787135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0f810b6c0 msgr2=0x7fa0f810baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.165+0000 7fa0ff400700 1 --2- 172.21.15.81:0/4098787135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0f810b6c0 0x7fa0f810baa0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec009990 tx=0x7fa0ec009ca0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.165+0000 7fa0ff400700 1 -- 172.21.15.81:0/4098787135 shutdown_connections 2024-05-03T16:48:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.165+0000 7fa0ff400700 1 --2- 172.21.15.81:0/4098787135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f8106080 0x7fa0f8112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.165+0000 7fa0ff400700 1 --2- 172.21.15.81:0/4098787135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0f810b6c0 0x7fa0f810baa0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.165+0000 7fa0ff400700 1 --2- 172.21.15.81:0/4098787135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0f81056c0 0x7fa0f8105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.165+0000 7fa0ff400700 1 -- 172.21.15.81:0/4098787135 >> 172.21.15.81:0/4098787135 conn(0x7fa0f81011b0 msgr2=0x7fa0f81035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.165+0000 7fa0ff400700 1 -- 172.21.15.81:0/4098787135 shutdown_connections 2024-05-03T16:48:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.166+0000 7fa0ff400700 1 -- 172.21.15.81:0/4098787135 wait complete. 2024-05-03T16:48:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.167+0000 7fa0ff400700 1 Processor -- start 2024-05-03T16:48:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.167+0000 7fa0ff400700 1 -- start start 2024-05-03T16:48:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.167+0000 7fa0ff400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0f81056c0 0x7fa0f81a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.167+0000 7fa0ff400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f8106080 0x7fa0f81a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.167+0000 7fa0ff400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0f810b6c0 0x7fa0f819bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.167+0000 7fa0ff400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f8115770 con 0x7fa0f810b6c0 2024-05-03T16:48:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.167+0000 7fa0ff400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f81155f0 con 0x7fa0f8106080 2024-05-03T16:48:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.167+0000 7fa0ff400700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f81158f0 con 0x7fa0f81056c0 2024-05-03T16:48:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.168+0000 7fa0fd400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0f810b6c0 0x7fa0f819bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.168+0000 7fa0fd400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0f810b6c0 0x7fa0f819bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59948/0 (socket says 172.21.15.81:59948) 2024-05-03T16:48:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.168+0000 7fa0fd400700 1 -- 172.21.15.81:0/1467307481 learned_addr learned my addr 172.21.15.81:0/1467307481 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.168+0000 7fa0fca00700 1 --2- 172.21.15.81:0/1467307481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0f81056c0 0x7fa0f81a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.168+0000 7fa0f7e00700 1 --2- 172.21.15.81:0/1467307481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f8106080 0x7fa0f81a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.168+0000 7fa0fd400700 1 -- 172.21.15.81:0/1467307481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0f81056c0 msgr2=0x7fa0f81a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.168+0000 7fa0fd400700 1 --2- 172.21.15.81:0/1467307481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0f81056c0 0x7fa0f81a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.168+0000 7fa0fd400700 1 -- 172.21.15.81:0/1467307481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f8106080 msgr2=0x7fa0f81a1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.168+0000 7fa0fd400700 1 --2- 172.21.15.81:0/1467307481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f8106080 0x7fa0f81a1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.168+0000 7fa0fd400700 1 -- 172.21.15.81:0/1467307481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f819c210 con 0x7fa0f810b6c0 2024-05-03T16:48:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.168+0000 7fa0f7e00700 1 --2- 172.21.15.81:0/1467307481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f8106080 0x7fa0f81a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:48:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.168+0000 7fa0fd400700 1 --2- 172.21.15.81:0/1467307481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0f810b6c0 0x7fa0f819bab0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0007ee0 tx=0x7fa0f000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.169+0000 7fa0f5600700 1 -- 172.21.15.81:0/1467307481 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f000dbd0 con 0x7fa0f810b6c0 2024-05-03T16:48:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.169+0000 7fa0f5600700 1 -- 172.21.15.81:0/1467307481 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0f000dd70 con 0x7fa0f810b6c0 2024-05-03T16:48:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.169+0000 7fa0f5600700 1 -- 172.21.15.81:0/1467307481 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00058d0 con 0x7fa0f810b6c0 2024-05-03T16:48:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.169+0000 7fa0ff400700 1 -- 172.21.15.81:0/1467307481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0f819c500 con 0x7fa0f810b6c0 2024-05-03T16:48:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.169+0000 7fa0ff400700 1 -- 172.21.15.81:0/1467307481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0f81a87c0 con 0x7fa0f810b6c0 2024-05-03T16:48:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.173+0000 7fa0f5600700 1 -- 172.21.15.81:0/1467307481 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa0f001a020 con 0x7fa0f810b6c0 2024-05-03T16:48:14.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.175+0000 7fa109d67b80 1 Processor -- start 2024-05-03T16:48:14.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.175+0000 7fa109d67b80 1 -- start start 2024-05-03T16:48:14.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.175+0000 7fa109d67b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d328e0 0x55ac15d32cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:14.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.175+0000 7fa109d67b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d33200 0x55ac15d2cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:14.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.175+0000 7fa109d67b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d2d500 0x55ac15d2d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:14.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.175+0000 7fa109d67b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ac15c7f9d0 con 0x55ac15d2d500 2024-05-03T16:48:14.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.175+0000 7fa109d67b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ac15c1d710 con 0x55ac15d33200 2024-05-03T16:48:14.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.175+0000 7fa109d67b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ac15c7b990 con 0x55ac15d328e0 2024-05-03T16:48:14.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.175+0000 7fa0f5600700 1 --2- 172.21.15.81:0/1467307481 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa0e00b2910 0x7fa0e00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:14.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.176+0000 7fa0f5600700 1 -- 172.21.15.81:0/1467307481 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fa0f00e1fd0 con 0x7fa0f810b6c0 2024-05-03T16:48:14.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.176+0000 7fa0fd400700 1 --2- 172.21.15.81:0/1467307481 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa0e00b2910 0x7fa0e00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:14.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.176+0000 7fa0f7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d2d500 0x55ac15d2d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:14.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.176+0000 7fa0fca00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d33200 0x55ac15d2cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:14.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.176+0000 7fa0f7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d2d500 0x55ac15d2d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59958/0 (socket says 172.21.15.81:59958) 2024-05-03T16:48:14.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.176+0000 7fa0f7e00700 1 -- 172.21.15.81:0/3406034946 learned_addr learned my addr 172.21.15.81:0/3406034946 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:14.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.176+0000 7fa0f7e00700 1 --2- 172.21.15.81:0/3406034946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d328e0 0x55ac15d32cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:14.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.176+0000 7fa0f7e00700 1 -- 172.21.15.81:0/3406034946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d328e0 msgr2=0x55ac15d32cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:14.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.176+0000 7fa0f7e00700 1 --2- 172.21.15.81:0/3406034946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d328e0 0x55ac15d32cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.176+0000 7fa0f7e00700 1 -- 172.21.15.81:0/3406034946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d33200 msgr2=0x55ac15d2cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:14.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.176+0000 7fa0f7e00700 1 --2- 172.21.15.81:0/3406034946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d33200 0x55ac15d2cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.176+0000 7fa0f7e00700 1 -- 172.21.15.81:0/3406034946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac15bcc880 con 0x55ac15d2d500 2024-05-03T16:48:14.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.177+0000 7fa0fd400700 1 --2- 172.21.15.81:0/1467307481 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa0e00b2910 0x7fa0e00b4dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa0f00df5a0 tx=0x7fa0f0004e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:14.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.177+0000 7fa0f7e00700 1 --2- 172.21.15.81:0/3406034946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d2d500 0x55ac15d2d980 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4013910 tx=0x7fa0e400b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5807fae687b3db06 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:14.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.177+0000 7fa0ea000700 1 -- 172.21.15.81:0/3406034946 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e40115e0 con 0x55ac15d2d500 2024-05-03T16:48:14.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.177+0000 7fa0ea000700 1 -- 172.21.15.81:0/3406034946 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0e4011c10 con 0x55ac15d2d500 2024-05-03T16:48:14.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.177+0000 7fa0ea000700 1 -- 172.21.15.81:0/3406034946 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e400eab0 con 0x55ac15d2d500 2024-05-03T16:48:14.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.178+0000 7fa109d67b80 1 -- 172.21.15.81:0/3406034946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d2d500 msgr2=0x55ac15d2d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:14.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.178+0000 7fa109d67b80 1 --2- 172.21.15.81:0/3406034946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d2d500 0x55ac15d2d980 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4013910 tx=0x7fa0e400b4c0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.178+0000 7fa109d67b80 1 -- 172.21.15.81:0/3406034946 shutdown_connections 2024-05-03T16:48:14.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.178+0000 7fa109d67b80 1 --2- 172.21.15.81:0/3406034946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d328e0 0x55ac15d32cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.178+0000 7fa109d67b80 1 --2- 172.21.15.81:0/3406034946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d2d500 0x55ac15d2d980 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.178+0000 7fa109d67b80 1 --2- 172.21.15.81:0/3406034946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d33200 0x55ac15d2cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.178+0000 7fa109d67b80 1 -- 172.21.15.81:0/3406034946 >> 172.21.15.81:0/3406034946 conn(0x55ac15ca5680 msgr2=0x55ac15d278b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.178+0000 7fa109d67b80 1 -- 172.21.15.81:0/3406034946 shutdown_connections 2024-05-03T16:48:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.178+0000 7fa109d67b80 1 -- 172.21.15.81:0/3406034946 wait complete. 2024-05-03T16:48:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.179+0000 7fa109d67b80 1 -- start start 2024-05-03T16:48:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.179+0000 7fa109d67b80 1 Processor -- start 2024-05-03T16:48:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.180+0000 7fa109d67b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d2d500 0x55ac15d38e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.180+0000 7fa109d67b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d328e0 0x55ac15d361c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.180+0000 7fa109d67b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d33200 0x55ac15d36700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.180+0000 7fa109d67b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ac15d39cb0 con 0x55ac15d328e0 2024-05-03T16:48:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.180+0000 7fa109d67b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ac15be5ad0 con 0x55ac15d33200 2024-05-03T16:48:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.180+0000 7fa109d67b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ac15d39e30 con 0x55ac15d2d500 2024-05-03T16:48:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.180+0000 7fa109d67b80 10 client.0 _ll_register_callbacks cb 0x55ac15c26c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:48:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.180+0000 7fa0fca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d328e0 0x55ac15d361c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.180+0000 7fa0fca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d328e0 0x55ac15d361c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59972/0 (socket says 172.21.15.81:59972) 2024-05-03T16:48:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.180+0000 7fa0fca00700 1 -- 172.21.15.81:0/4252782804 learned_addr learned my addr 172.21.15.81:0/4252782804 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.180+0000 7fa0f7e00700 1 --2- 172.21.15.81:0/4252782804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d2d500 0x55ac15d38e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.180+0000 7fa0f7e00700 1 --2- 172.21.15.81:0/4252782804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d33200 0x55ac15d36700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.180+0000 7fa0fca00700 1 -- 172.21.15.81:0/4252782804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d2d500 msgr2=0x55ac15d38e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.180+0000 7fa0fca00700 1 --2- 172.21.15.81:0/4252782804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d2d500 0x55ac15d38e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.180+0000 7fa0fca00700 1 -- 172.21.15.81:0/4252782804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d33200 msgr2=0x55ac15d36700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.180+0000 7fa0fca00700 1 --2- 172.21.15.81:0/4252782804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d33200 0x55ac15d36700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.180+0000 7fa0fca00700 1 -- 172.21.15.81:0/4252782804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac15c453d0 con 0x55ac15d328e0 2024-05-03T16:48:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.180+0000 7fa0f7e00700 1 --2- 172.21.15.81:0/4252782804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d33200 0x55ac15d36700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:48:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.181+0000 7fa0fca00700 1 --2- 172.21.15.81:0/4252782804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d328e0 0x55ac15d361c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec015000 tx=0x7fa0ec005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be44376de82ca41 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.181+0000 7fa0dea00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:48:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.181+0000 7fa0dea00700 1 -- 172.21.15.81:0/4252782804 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec003bd0 con 0x55ac15d328e0 2024-05-03T16:48:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.181+0000 7fa0dea00700 1 -- 172.21.15.81:0/4252782804 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fa0ec003d70 con 0x55ac15d328e0 2024-05-03T16:48:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.181+0000 7fa109d67b80 1 -- 172.21.15.81:0/4252782804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0e4011c10 con 0x55ac15d328e0 2024-05-03T16:48:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.181+0000 7fa0dea00700 1 -- 172.21.15.81:0/4252782804 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa0ec031050 con 0x55ac15d328e0 2024-05-03T16:48:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.181+0000 7fa109d67b80 10 client.15120 fetch_fsmap learned FSMap version 29 2024-05-03T16:48:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.181+0000 7fa109d67b80 1 -- 172.21.15.81:0/4252782804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ac15d44470 con 0x55ac15d328e0 2024-05-03T16:48:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.182+0000 7fa0dea00700 1 -- 172.21.15.81:0/4252782804 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0e4011c10 con 0x55ac15d328e0 2024-05-03T16:48:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.182+0000 7fa0dea00700 1 -- 172.21.15.81:0/4252782804 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa0ec023570 con 0x55ac15d328e0 2024-05-03T16:48:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.182+0000 7fa109d67b80 10 client.15120 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:48:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.182+0000 7fa109d67b80 10 client.15120 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-03T16:48:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.182+0000 7fa109d67b80 20 client.15120 populate_metadata read hostname 'smithi081' 2024-05-03T16:48:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.182+0000 7fa109d67b80 1 --2- 172.21.15.81:0/4252782804 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55ac15d46b50 0x55ac15d47fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:14.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.182+0000 7fa109d67b80 4 client.15120 mds_command: new command op to 34466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T16:48:14.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.182+0000 7fa109d67b80 1 -- 172.21.15.81:0/4252782804 --> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac15cf9fa0 con 0x55ac15d46b50 2024-05-03T16:48:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.183+0000 7fa0f7e00700 1 --2- 172.21.15.81:0/4252782804 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55ac15d46b50 0x55ac15d47fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.184+0000 7fa0f7e00700 1 --2- 172.21.15.81:0/4252782804 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55ac15d46b50 0x55ac15d47fc0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0fb38b716a94cc server_cookie=3f816b83956e6499 in_seq=0 out_seq=0 2024-05-03T16:48:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.184+0000 7fa0dea00700 10 client.15120 ms_handle_connect on v2:172.21.15.134:6838/2061491127 2024-05-03T16:48:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.186+0000 7fa0dea00700 1 -- 172.21.15.81:0/4252782804 <== mds.0 v2:172.21.15.134:6838/2061491127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ac15cf9fa0 con 0x55ac15d46b50 2024-05-03T16:48:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.186+0000 7fa0dea00700 10 client.15120 handle_command_reply: tid=0 2024-05-03T16:48:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.186+0000 7fa109d67b80 1 client.15120 shutdown 2024-05-03T16:48:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.186+0000 7fa109d67b80 1 -- 172.21.15.81:0/4252782804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d328e0 msgr2=0x55ac15d361c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.186+0000 7fa109d67b80 1 --2- 172.21.15.81:0/4252782804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d328e0 0x55ac15d361c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec015000 tx=0x7fa0ec005800 comp rx=0 tx=0).stop 2024-05-03T16:48:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.187+0000 7fa109d67b80 1 -- 172.21.15.81:0/4252782804 shutdown_connections 2024-05-03T16:48:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.187+0000 7fa109d67b80 1 --2- 172.21.15.81:0/4252782804 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55ac15d46b50 0x55ac15d47fc0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.187+0000 7fa109d67b80 1 --2- 172.21.15.81:0/4252782804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d2d500 0x55ac15d38e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.187+0000 7fa109d67b80 1 --2- 172.21.15.81:0/4252782804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d33200 0x55ac15d36700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.187+0000 7fa109d67b80 1 --2- 172.21.15.81:0/4252782804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d328e0 0x55ac15d361c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.187+0000 7fa0dea00700 0 client.15120 ms_handle_reset on v2:172.21.15.134:6838/2061491127 2024-05-03T16:48:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.187+0000 7fa109d67b80 1 -- 172.21.15.81:0/4252782804 >> 172.21.15.81:0/4252782804 conn(0x55ac15ca5680 msgr2=0x55ac15d22360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.187+0000 7fa109d67b80 1 -- 172.21.15.81:0/4252782804 shutdown_connections 2024-05-03T16:48:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.187+0000 7fa109d67b80 1 -- 172.21.15.81:0/4252782804 wait complete. 2024-05-03T16:48:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.187+0000 7fa109d67b80 20 client.15120 trim_cache size 0 max 16384 2024-05-03T16:48:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.210+0000 7fa109d67b80 1 Processor -- start 2024-05-03T16:48:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.210+0000 7fa109d67b80 1 -- start start 2024-05-03T16:48:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.210+0000 7fa109d67b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d2d500 0x55ac15d2cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.210+0000 7fa109d67b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d328e0 0x55ac15d303f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.210+0000 7fa109d67b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d33200 0x55ac15d30930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:14.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.210+0000 7fa109d67b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ac15d46300 con 0x55ac15d2d500 2024-05-03T16:48:14.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.210+0000 7fa109d67b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ac15d469d0 con 0x55ac15d328e0 2024-05-03T16:48:14.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.210+0000 7fa109d67b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ac15d470a0 con 0x55ac15d33200 2024-05-03T16:48:14.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.210+0000 7fa0f7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d2d500 0x55ac15d2cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.211+0000 7fa0f7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d2d500 0x55ac15d2cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59978/0 (socket says 172.21.15.81:59978) 2024-05-03T16:48:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.211+0000 7fa0f7e00700 1 -- 172.21.15.81:0/1090571679 learned_addr learned my addr 172.21.15.81:0/1090571679 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.211+0000 7fa0fca00700 1 --2- 172.21.15.81:0/1090571679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d328e0 0x55ac15d303f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.211+0000 7fa0f7e00700 1 -- 172.21.15.81:0/1090571679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d33200 msgr2=0x55ac15d30930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.211+0000 7fa0f7e00700 1 --2- 172.21.15.81:0/1090571679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d33200 0x55ac15d30930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.211+0000 7fa0f7e00700 1 -- 172.21.15.81:0/1090571679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d328e0 msgr2=0x55ac15d303f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.211+0000 7fa0f7e00700 1 --2- 172.21.15.81:0/1090571679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d328e0 0x55ac15d303f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.211+0000 7fa0f7e00700 1 -- 172.21.15.81:0/1090571679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac15d34730 con 0x55ac15d2d500 2024-05-03T16:48:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.211+0000 7fa0f7e00700 1 --2- 172.21.15.81:0/1090571679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d2d500 0x55ac15d2cee0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4013f00 tx=0x7fa0e4005980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a5768f6f82ca7b server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.212+0000 7fa0e9600700 1 -- 172.21.15.81:0/1090571679 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4032070 con 0x55ac15d2d500 2024-05-03T16:48:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.212+0000 7fa0e9600700 1 -- 172.21.15.81:0/1090571679 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0e40054e0 con 0x55ac15d2d500 2024-05-03T16:48:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.212+0000 7fa0e9600700 1 -- 172.21.15.81:0/1090571679 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e402da10 con 0x55ac15d2d500 2024-05-03T16:48:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.212+0000 7fa109d67b80 1 -- 172.21.15.81:0/1090571679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d2d500 msgr2=0x55ac15d2cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.213+0000 7fa109d67b80 1 --2- 172.21.15.81:0/1090571679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d2d500 0x55ac15d2cee0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4013f00 tx=0x7fa0e4005980 comp rx=0 tx=0).stop 2024-05-03T16:48:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.213+0000 7fa109d67b80 1 -- 172.21.15.81:0/1090571679 shutdown_connections 2024-05-03T16:48:14.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.213+0000 7fa109d67b80 1 --2- 172.21.15.81:0/1090571679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d33200 0x55ac15d30930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.213+0000 7fa109d67b80 1 --2- 172.21.15.81:0/1090571679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d2d500 0x55ac15d2cee0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.213+0000 7fa109d67b80 1 --2- 172.21.15.81:0/1090571679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d328e0 0x55ac15d303f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.213+0000 7fa109d67b80 1 -- 172.21.15.81:0/1090571679 >> 172.21.15.81:0/1090571679 conn(0x55ac15ca5680 msgr2=0x55ac15d36ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:14.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.213+0000 7fa109d67b80 1 -- 172.21.15.81:0/1090571679 shutdown_connections 2024-05-03T16:48:14.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.213+0000 7fa109d67b80 1 -- 172.21.15.81:0/1090571679 wait complete. 2024-05-03T16:48:14.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.213+0000 7fa109d67b80 1 -- start start 2024-05-03T16:48:14.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.213+0000 7fa109d67b80 1 Processor -- start 2024-05-03T16:48:14.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.214+0000 7fa109d67b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d2d500 0x55ac15d51a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:14.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.214+0000 7fa109d67b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d328e0 0x55ac15d2bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:14.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.214+0000 7fa109d67b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d33200 0x55ac15d2c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:14.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.214+0000 7fa109d67b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ac15d47e40 con 0x55ac15d328e0 2024-05-03T16:48:14.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.214+0000 7fa109d67b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ac15d47770 con 0x55ac15d2d500 2024-05-03T16:48:14.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.214+0000 7fa109d67b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ac15d48510 con 0x55ac15d33200 2024-05-03T16:48:14.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.214+0000 7fa109d67b80 10 client.0 _ll_register_callbacks cb 0x55ac15c26c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:48:14.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.214+0000 7fa0fca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d328e0 0x55ac15d2bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:14.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.214+0000 7fa0fca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d328e0 0x55ac15d2bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59992/0 (socket says 172.21.15.81:59992) 2024-05-03T16:48:14.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.214+0000 7fa0fca00700 1 -- 172.21.15.81:0/2382733484 learned_addr learned my addr 172.21.15.81:0/2382733484 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:14.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.214+0000 7fa0f7e00700 1 --2- 172.21.15.81:0/2382733484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d33200 0x55ac15d2c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:14.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.215+0000 7fa0fca00700 1 -- 172.21.15.81:0/2382733484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d33200 msgr2=0x55ac15d2c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:14.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.215+0000 7fa0fca00700 1 --2- 172.21.15.81:0/2382733484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d33200 0x55ac15d2c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.215+0000 7fa0fca00700 1 -- 172.21.15.81:0/2382733484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d2d500 msgr2=0x55ac15d51a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:14.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.215+0000 7fa0fca00700 1 --2- 172.21.15.81:0/2382733484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d2d500 0x55ac15d51a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.215+0000 7fa0fca00700 1 -- 172.21.15.81:0/2382733484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac15d2cc70 con 0x55ac15d328e0 2024-05-03T16:48:14.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.215+0000 7fa0f7e00700 1 --2- 172.21.15.81:0/2382733484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d33200 0x55ac15d2c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:48:14.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.215+0000 7fa0fca00700 1 --2- 172.21.15.81:0/2382733484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d328e0 0x55ac15d2bed0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec023b50 tx=0x7fa0ec009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7278fded80ebacd1 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:14.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.215+0000 7fa0dea00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:48:14.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.215+0000 7fa0dea00700 1 -- 172.21.15.81:0/2382733484 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec03b030 con 0x55ac15d328e0 2024-05-03T16:48:14.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.215+0000 7fa0dea00700 1 -- 172.21.15.81:0/2382733484 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fa0ec023470 con 0x55ac15d328e0 2024-05-03T16:48:14.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.215+0000 7fa109d67b80 1 -- 172.21.15.81:0/2382733484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0e40054e0 con 0x55ac15d328e0 2024-05-03T16:48:14.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.216+0000 7fa0dea00700 1 -- 172.21.15.81:0/2382733484 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa0ec045050 con 0x55ac15d328e0 2024-05-03T16:48:14.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.216+0000 7fa109d67b80 10 client.15126 fetch_fsmap learned FSMap version 29 2024-05-03T16:48:14.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.216+0000 7fa109d67b80 1 -- 172.21.15.81:0/2382733484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ac15db2080 con 0x55ac15d328e0 2024-05-03T16:48:14.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.216+0000 7fa0dea00700 1 -- 172.21.15.81:0/2382733484 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0e40054e0 con 0x55ac15d328e0 2024-05-03T16:48:14.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.216+0000 7fa0dea00700 1 -- 172.21.15.81:0/2382733484 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa0ec00ba70 con 0x55ac15d328e0 2024-05-03T16:48:14.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.216+0000 7fa109d67b80 10 client.15126 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:48:14.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.216+0000 7fa109d67b80 10 client.15126 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-03T16:48:14.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.216+0000 7fa109d67b80 20 client.15126 populate_metadata read hostname 'smithi081' 2024-05-03T16:48:14.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.216+0000 7fa109d67b80 1 --2- 172.21.15.81:0/2382733484 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55ac15db6bc0 0x55ac15db58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:14.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.216+0000 7fa109d67b80 4 client.15126 mds_command: new command op to 34466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T16:48:14.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.216+0000 7fa109d67b80 1 -- 172.21.15.81:0/2382733484 --> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] -- command(tid 0: {"prefix": "status"}) -- 0x55ac15c8d3b0 con 0x55ac15db6bc0 2024-05-03T16:48:14.221 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:13 smithi134 ceph-mon[31708]: pgmap v505: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:48:14.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.217+0000 7fa0f7e00700 1 --2- 172.21.15.81:0/2382733484 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55ac15db6bc0 0x55ac15db58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.218+0000 7fa0f7e00700 1 --2- 172.21.15.81:0/2382733484 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55ac15db6bc0 0x55ac15db58d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9d184868d6481e2 server_cookie=7500b126acdbea89 in_seq=0 out_seq=0 2024-05-03T16:48:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.218+0000 7fa0dea00700 10 client.15126 ms_handle_connect on v2:172.21.15.134:6838/2061491127 2024-05-03T16:48:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.218+0000 7fa0dea00700 1 -- 172.21.15.81:0/2382733484 <== mds.0 v2:172.21.15.134:6838/2061491127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ac15c8d3b0 con 0x55ac15db6bc0 2024-05-03T16:48:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.218+0000 7fa0dea00700 10 client.15126 handle_command_reply: tid=0 2024-05-03T16:48:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.219+0000 7fa109d67b80 1 client.15126 shutdown 2024-05-03T16:48:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.219+0000 7fa109d67b80 1 -- 172.21.15.81:0/2382733484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d328e0 msgr2=0x55ac15d2bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.219+0000 7fa109d67b80 1 --2- 172.21.15.81:0/2382733484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d328e0 0x55ac15d2bed0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec023b50 tx=0x7fa0ec009ee0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.219+0000 7fa109d67b80 1 -- 172.21.15.81:0/2382733484 shutdown_connections 2024-05-03T16:48:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.219+0000 7fa109d67b80 1 --2- 172.21.15.81:0/2382733484 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55ac15db6bc0 0x55ac15db58d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.219+0000 7fa109d67b80 1 --2- 172.21.15.81:0/2382733484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac15d33200 0x55ac15d2c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.219+0000 7fa109d67b80 1 --2- 172.21.15.81:0/2382733484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ac15d2d500 0x55ac15d51a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.219+0000 7fa0dea00700 0 client.15126 ms_handle_reset on v2:172.21.15.134:6838/2061491127 2024-05-03T16:48:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.219+0000 7fa109d67b80 1 --2- 172.21.15.81:0/2382733484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac15d328e0 0x55ac15d2bed0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.219+0000 7fa109d67b80 1 -- 172.21.15.81:0/2382733484 >> 172.21.15.81:0/2382733484 conn(0x55ac15ca5680 msgr2=0x55ac15d303f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:14.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.219+0000 7fa109d67b80 1 -- 172.21.15.81:0/2382733484 shutdown_connections 2024-05-03T16:48:14.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.219+0000 7fa109d67b80 1 -- 172.21.15.81:0/2382733484 wait complete. 2024-05-03T16:48:14.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.219+0000 7fa109d67b80 20 client.15126 trim_cache size 0 max 16384 2024-05-03T16:48:14.224 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-03T16:48:14.224 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8988869e-096a-11ef-bc97-c7b262605968", 2024-05-03T16:48:14.224 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-05-03T16:48:14.224 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 34466, 2024-05-03T16:48:14.224 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-05-03T16:48:14.224 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-05-03T16:48:14.224 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-05-03T16:48:14.225 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 255.28080103799999, 2024-05-03T16:48:14.225 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 29, 2024-05-03T16:48:14.225 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 91, 2024-05-03T16:48:14.225 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 91, 2024-05-03T16:48:14.225 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 274.81341604699998 2024-05-03T16:48:14.225 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-03T16:48:14.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.220+0000 7fa0ff400700 1 -- 172.21.15.81:0/1467307481 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa0e00b2910 msgr2=0x7fa0e00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:14.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.220+0000 7fa0ff400700 1 --2- 172.21.15.81:0/1467307481 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa0e00b2910 0x7fa0e00b4dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa0f00df5a0 tx=0x7fa0f0004e80 comp rx=0 tx=0).stop 2024-05-03T16:48:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.220+0000 7fa0ff400700 1 -- 172.21.15.81:0/1467307481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0f810b6c0 msgr2=0x7fa0f819bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.220+0000 7fa0ff400700 1 --2- 172.21.15.81:0/1467307481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0f810b6c0 0x7fa0f819bab0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0007ee0 tx=0x7fa0f000d3b0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.220+0000 7fa0ff400700 1 -- 172.21.15.81:0/1467307481 shutdown_connections 2024-05-03T16:48:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.220+0000 7fa0ff400700 1 --2- 172.21.15.81:0/1467307481 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa0e00b2910 0x7fa0e00b4dd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.220+0000 7fa0ff400700 1 --2- 172.21.15.81:0/1467307481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0f81056c0 0x7fa0f81a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.220+0000 7fa0ff400700 1 --2- 172.21.15.81:0/1467307481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0f810b6c0 0x7fa0f819bab0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.220+0000 7fa0ff400700 1 --2- 172.21.15.81:0/1467307481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f8106080 0x7fa0f81a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.220+0000 7fa0ff400700 1 -- 172.21.15.81:0/1467307481 >> 172.21.15.81:0/1467307481 conn(0x7fa0f81011b0 msgr2=0x7fa0f8101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.220+0000 7fa0ff400700 1 -- 172.21.15.81:0/1467307481 shutdown_connections 2024-05-03T16:48:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:14.221+0000 7fa0ff400700 1 -- 172.21.15.81:0/1467307481 wait complete. 2024-05-03T16:48:15.246 INFO:tasks.cephadm:Setup complete, yielding 2024-05-03T16:48:15.247 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-03T16:48:15.257 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-05-03T16:48:15.257 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- bash -c 'ceph orch status' 2024-05-03T16:48:15.690 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:48:16.041 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:15 smithi081 ceph-mon[28640]: pgmap v506: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:16.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:15 smithi146 ceph-mon[32357]: pgmap v506: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:16.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:15 smithi134 ceph-mon[31708]: pgmap v506: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.057+0000 7fe82f200700 1 -- 172.21.15.81:0/2609378264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe828105740 msgr2=0x7fe828105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.057+0000 7fe82f200700 1 --2- 172.21.15.81:0/2609378264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe828105740 0x7fe828105b60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe8180099c0 tx=0x7fe818009cd0 comp rx=0 tx=0).stop 2024-05-03T16:48:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.058+0000 7fe82f200700 1 -- 172.21.15.81:0/2609378264 shutdown_connections 2024-05-03T16:48:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.058+0000 7fe82f200700 1 --2- 172.21.15.81:0/2609378264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8281072e0 0x7fe82810db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.058+0000 7fe82f200700 1 --2- 172.21.15.81:0/2609378264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe828105740 0x7fe828105b60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.058+0000 7fe82f200700 1 --2- 172.21.15.81:0/2609378264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe828106940 0x7fe828106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.058+0000 7fe82f200700 1 -- 172.21.15.81:0/2609378264 >> 172.21.15.81:0/2609378264 conn(0x7fe828100d00 msgr2=0x7fe828103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.058+0000 7fe82f200700 1 -- 172.21.15.81:0/2609378264 shutdown_connections 2024-05-03T16:48:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.058+0000 7fe82f200700 1 -- 172.21.15.81:0/2609378264 wait complete. 2024-05-03T16:48:18.062 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:17 smithi081 ceph-mon[28640]: pgmap v507: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:48:18.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.059+0000 7fe82f200700 1 Processor -- start 2024-05-03T16:48:18.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.059+0000 7fe82f200700 1 -- start start 2024-05-03T16:48:18.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.059+0000 7fe82f200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe828105740 0x7fe82819b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:18.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.059+0000 7fe82f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe828106940 0x7fe82819bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:18.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.059+0000 7fe82f200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8281072e0 0x7fe8281a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:18.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.060+0000 7fe82f200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe8281110d0 con 0x7fe828106940 2024-05-03T16:48:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.060+0000 7fe82f200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe828110f50 con 0x7fe828105740 2024-05-03T16:48:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.060+0000 7fe82f200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe828111250 con 0x7fe8281072e0 2024-05-03T16:48:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.060+0000 7fe827400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe828106940 0x7fe82819bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.060+0000 7fe827400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe828106940 0x7fe82819bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52536/0 (socket says 172.21.15.81:52536) 2024-05-03T16:48:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.060+0000 7fe827400700 1 -- 172.21.15.81:0/2930895439 learned_addr learned my addr 172.21.15.81:0/2930895439 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.060+0000 7fe827e00700 1 --2- 172.21.15.81:0/2930895439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe828105740 0x7fe82819b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.060+0000 7fe827400700 1 -- 172.21.15.81:0/2930895439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8281072e0 msgr2=0x7fe8281a2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.060+0000 7fe827400700 1 --2- 172.21.15.81:0/2930895439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8281072e0 0x7fe8281a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.060+0000 7fe827400700 1 -- 172.21.15.81:0/2930895439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe828105740 msgr2=0x7fe82819b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.060+0000 7fe827400700 1 --2- 172.21.15.81:0/2930895439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe828105740 0x7fe82819b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.060+0000 7fe827400700 1 -- 172.21.15.81:0/2930895439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8281a33d0 con 0x7fe828106940 2024-05-03T16:48:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.061+0000 7fe827400700 1 --2- 172.21.15.81:0/2930895439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe828106940 0x7fe82819bd00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe81400d980 tx=0x7fe81400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.061+0000 7fe824c00700 1 -- 172.21.15.81:0/2930895439 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814016070 con 0x7fe828106940 2024-05-03T16:48:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.061+0000 7fe824c00700 1 -- 172.21.15.81:0/2930895439 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe814010460 con 0x7fe828106940 2024-05-03T16:48:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.061+0000 7fe824c00700 1 -- 172.21.15.81:0/2930895439 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81400f620 con 0x7fe828106940 2024-05-03T16:48:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.061+0000 7fe82f200700 1 -- 172.21.15.81:0/2930895439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8281a36c0 con 0x7fe828106940 2024-05-03T16:48:18.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:17 smithi146 ceph-mon[32357]: pgmap v507: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:48:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.061+0000 7fe82f200700 1 -- 172.21.15.81:0/2930895439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8281a3bb0 con 0x7fe828106940 2024-05-03T16:48:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.063+0000 7fe82f200700 1 -- 172.21.15.81:0/2930895439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe82806a1d0 con 0x7fe828106940 2024-05-03T16:48:18.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.069+0000 7fe824c00700 1 -- 172.21.15.81:0/2930895439 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe814019070 con 0x7fe828106940 2024-05-03T16:48:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.069+0000 7fe824c00700 1 --2- 172.21.15.81:0/2930895439 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe80c0b2990 0x7fe80c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:18.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.070+0000 7fe824c00700 1 -- 172.21.15.81:0/2930895439 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fe8140e2300 con 0x7fe828106940 2024-05-03T16:48:18.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.070+0000 7fe827e00700 1 --2- 172.21.15.81:0/2930895439 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe80c0b2990 0x7fe80c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:18.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.070+0000 7fe827e00700 1 --2- 172.21.15.81:0/2930895439 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe80c0b2990 0x7fe80c0b4e50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe818009990 tx=0x7fe81801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:18.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.071+0000 7fe824c00700 1 -- 172.21.15.81:0/2930895439 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe8140a9ab0 con 0x7fe828106940 2024-05-03T16:48:18.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:17 smithi134 ceph-mon[31708]: pgmap v507: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:48:18.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.323+0000 7fe82f200700 1 -- 172.21.15.81:0/2930895439 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fe8280638e0 con 0x7fe80c0b2990 2024-05-03T16:48:18.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.326+0000 7fe824c00700 1 -- 172.21.15.81:0/2930895439 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fe8280638e0 con 0x7fe80c0b2990 2024-05-03T16:48:18.328 INFO:teuthology.orchestra.run.smithi081.stdout:Backend: cephadm 2024-05-03T16:48:18.328 INFO:teuthology.orchestra.run.smithi081.stdout:Available: Yes 2024-05-03T16:48:18.328 INFO:teuthology.orchestra.run.smithi081.stdout:Paused: No 2024-05-03T16:48:18.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.328+0000 7fe82f200700 1 -- 172.21.15.81:0/2930895439 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe80c0b2990 msgr2=0x7fe80c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:18.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.328+0000 7fe82f200700 1 --2- 172.21.15.81:0/2930895439 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe80c0b2990 0x7fe80c0b4e50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe818009990 tx=0x7fe81801a040 comp rx=0 tx=0).stop 2024-05-03T16:48:18.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.328+0000 7fe82f200700 1 -- 172.21.15.81:0/2930895439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe828106940 msgr2=0x7fe82819bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:18.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.328+0000 7fe82f200700 1 --2- 172.21.15.81:0/2930895439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe828106940 0x7fe82819bd00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe81400d980 tx=0x7fe81400dd40 comp rx=0 tx=0).stop 2024-05-03T16:48:18.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.328+0000 7fe82f200700 1 -- 172.21.15.81:0/2930895439 shutdown_connections 2024-05-03T16:48:18.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.328+0000 7fe82f200700 1 --2- 172.21.15.81:0/2930895439 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe80c0b2990 0x7fe80c0b4e50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:18.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.329+0000 7fe82f200700 1 --2- 172.21.15.81:0/2930895439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8281072e0 0x7fe8281a2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:18.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.329+0000 7fe82f200700 1 --2- 172.21.15.81:0/2930895439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe828105740 0x7fe82819b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:18.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.329+0000 7fe82f200700 1 --2- 172.21.15.81:0/2930895439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe828106940 0x7fe82819bd00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:18.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.329+0000 7fe82f200700 1 -- 172.21.15.81:0/2930895439 >> 172.21.15.81:0/2930895439 conn(0x7fe828100d00 msgr2=0x7fe828109ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:18.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.329+0000 7fe82f200700 1 -- 172.21.15.81:0/2930895439 shutdown_connections 2024-05-03T16:48:18.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:18.329+0000 7fe82f200700 1 -- 172.21.15.81:0/2930895439 wait complete. 2024-05-03T16:48:19.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-03T16:48:19.627 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:48:20.047 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:19 smithi081 ceph-mon[28640]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:48:20.047 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:19 smithi081 ceph-mon[28640]: pgmap v508: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:20.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:19 smithi146 ceph-mon[32357]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:48:20.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:19 smithi146 ceph-mon[32357]: pgmap v508: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:20.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:19 smithi134 ceph-mon[31708]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:48:20.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:19 smithi134 ceph-mon[31708]: pgmap v508: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:21.867 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:21 smithi081 ceph-mon[28640]: pgmap v509: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:22.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:21 smithi146 ceph-mon[32357]: pgmap v509: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:22.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.196+0000 7f3d22e00700 1 -- 172.21.15.81:0/3981897762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d1c1068c0 msgr2=0x7f3d1c108cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:22.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.196+0000 7f3d22e00700 1 --2- 172.21.15.81:0/3981897762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d1c1068c0 0x7f3d1c108cb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009990 tx=0x7f3d04009ca0 comp rx=0 tx=0).stop 2024-05-03T16:48:22.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.196+0000 7f3d22e00700 1 -- 172.21.15.81:0/3981897762 shutdown_connections 2024-05-03T16:48:22.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.196+0000 7f3d22e00700 1 --2- 172.21.15.81:0/3981897762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d1c103f90 0x7f3d1c106380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:22.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.196+0000 7f3d22e00700 1 --2- 172.21.15.81:0/3981897762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d1c1091f0 0x7f3d1c10b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:22.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.196+0000 7f3d22e00700 1 --2- 172.21.15.81:0/3981897762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d1c1068c0 0x7f3d1c108cb0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:22.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.196+0000 7f3d22e00700 1 -- 172.21.15.81:0/3981897762 >> 172.21.15.81:0/3981897762 conn(0x7f3d1c0fd9a0 msgr2=0x7f3d1c0ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:22.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.196+0000 7f3d22e00700 1 -- 172.21.15.81:0/3981897762 shutdown_connections 2024-05-03T16:48:22.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.196+0000 7f3d22e00700 1 -- 172.21.15.81:0/3981897762 wait complete. 2024-05-03T16:48:22.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.197+0000 7f3d22e00700 1 Processor -- start 2024-05-03T16:48:22.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.198+0000 7f3d22e00700 1 -- start start 2024-05-03T16:48:22.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.198+0000 7f3d22e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d1c103f90 0x7f3d1c19b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:22.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.198+0000 7f3d22e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d1c1068c0 0x7f3d1c19bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:22.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.198+0000 7f3d22e00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d1c1091f0 0x7f3d1c1a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:22.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.198+0000 7f3d22e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c10ee30 con 0x7f3d1c103f90 2024-05-03T16:48:22.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.198+0000 7f3d22e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c10ecb0 con 0x7f3d1c1068c0 2024-05-03T16:48:22.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.198+0000 7f3d22e00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c10efb0 con 0x7f3d1c1091f0 2024-05-03T16:48:22.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.198+0000 7f3d1be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d1c103f90 0x7f3d1c19b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:22.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.198+0000 7f3d1be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d1c103f90 0x7f3d1c19b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52554/0 (socket says 172.21.15.81:52554) 2024-05-03T16:48:22.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.198+0000 7f3d1be00700 1 -- 172.21.15.81:0/197639782 learned_addr learned my addr 172.21.15.81:0/197639782 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:22.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.199+0000 7f3d20e00700 1 --2- 172.21.15.81:0/197639782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d1c1091f0 0x7f3d1c1a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:22.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.199+0000 7f3d13400700 1 --2- 172.21.15.81:0/197639782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d1c1068c0 0x7f3d1c19bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:22.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.199+0000 7f3d1be00700 1 -- 172.21.15.81:0/197639782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d1c1091f0 msgr2=0x7f3d1c1a2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:22.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.199+0000 7f3d1be00700 1 --2- 172.21.15.81:0/197639782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d1c1091f0 0x7f3d1c1a2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:22.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.199+0000 7f3d1be00700 1 -- 172.21.15.81:0/197639782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d1c1068c0 msgr2=0x7f3d1c19bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:22.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.199+0000 7f3d1be00700 1 --2- 172.21.15.81:0/197639782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d1c1068c0 0x7f3d1c19bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:22.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.199+0000 7f3d1be00700 1 -- 172.21.15.81:0/197639782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d1c1a3390 con 0x7f3d1c103f90 2024-05-03T16:48:22.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.199+0000 7f3d1be00700 1 --2- 172.21.15.81:0/197639782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d1c103f90 0x7f3d1c19b730 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00c9e0 tx=0x7f3d0c00cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:22.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.199+0000 7f3d19600700 1 -- 172.21.15.81:0/197639782 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c007ac0 con 0x7f3d1c103f90 2024-05-03T16:48:22.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.199+0000 7f3d19600700 1 -- 172.21.15.81:0/197639782 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d0c007c60 con 0x7f3d1c103f90 2024-05-03T16:48:22.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.199+0000 7f3d22e00700 1 -- 172.21.15.81:0/197639782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d1c1a3680 con 0x7f3d1c103f90 2024-05-03T16:48:22.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.199+0000 7f3d19600700 1 -- 172.21.15.81:0/197639782 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c018660 con 0x7f3d1c103f90 2024-05-03T16:48:22.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.200+0000 7f3d22e00700 1 -- 172.21.15.81:0/197639782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d1c1a3bc0 con 0x7f3d1c103f90 2024-05-03T16:48:22.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.201+0000 7f3d22e00700 1 -- 172.21.15.81:0/197639782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d1c06a190 con 0x7f3d1c103f90 2024-05-03T16:48:22.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.203+0000 7f3d19600700 1 -- 172.21.15.81:0/197639782 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3d0c00f450 con 0x7f3d1c103f90 2024-05-03T16:48:22.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.206+0000 7f3d19600700 1 --2- 172.21.15.81:0/197639782 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3d000b2910 0x7f3d000b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:22.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.206+0000 7f3d19600700 1 -- 172.21.15.81:0/197639782 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f3d0c0e2990 con 0x7f3d1c103f90 2024-05-03T16:48:22.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.206+0000 7f3d13400700 1 --2- 172.21.15.81:0/197639782 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3d000b2910 0x7f3d000b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:22.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.207+0000 7f3d13400700 1 --2- 172.21.15.81:0/197639782 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3d000b2910 0x7f3d000b4dd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400b5c0 tx=0x7f3d04005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:22.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.209+0000 7f3d19600700 1 -- 172.21.15.81:0/197639782 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f3d0c054d70 con 0x7f3d1c103f90 2024-05-03T16:48:22.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:21 smithi134 ceph-mon[31708]: pgmap v509: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:22.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.452+0000 7f3d22e00700 1 -- 172.21.15.81:0/197639782 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3d1c1026d0 con 0x7f3d000b2910 2024-05-03T16:48:22.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.494+0000 7f3d19600700 1 -- 172.21.15.81:0/197639782 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f3d1c1026d0 con 0x7f3d000b2910 2024-05-03T16:48:22.496 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-03T16:48:22.496 INFO:teuthology.orchestra.run.smithi081.stdout:mds.a smithi081 running (4m) 2m ago 4m 15.0M - 19.0.0-3450-g9a047fe7 ee4d84620249 ddddc0371d22 2024-05-03T16:48:22.496 INFO:teuthology.orchestra.run.smithi081.stdout:mds.b smithi134 running (4m) 2m ago 4m 24.9M - 19.0.0-3450-g9a047fe7 ee4d84620249 c36d4e016712 2024-05-03T16:48:22.496 INFO:teuthology.orchestra.run.smithi081.stdout:mds.c smithi146 running (5m) 2m ago 5m 16.2M - 19.0.0-3450-g9a047fe7 ee4d84620249 847115f495de 2024-05-03T16:48:22.496 INFO:teuthology.orchestra.run.smithi081.stdout:mds.d smithi081 running (5m) 2m ago 5m 13.2M - 19.0.0-3450-g9a047fe7 ee4d84620249 cbbb5c0207c0 2024-05-03T16:48:22.496 INFO:teuthology.orchestra.run.smithi081.stdout:mds.e smithi134 running (5m) 2m ago 5m 16.7M - 19.0.0-3450-g9a047fe7 ee4d84620249 d3615a15fbb5 2024-05-03T16:48:22.496 INFO:teuthology.orchestra.run.smithi081.stdout:mds.f smithi146 running (5m) 2m ago 5m 15.1M - 19.0.0-3450-g9a047fe7 ee4d84620249 b3f71a4c2b5f 2024-05-03T16:48:22.496 INFO:teuthology.orchestra.run.smithi081.stdout:mds.g smithi081 running (4m) 2m ago 4m 14.9M - 19.0.0-3450-g9a047fe7 ee4d84620249 3bdb1f3b5bab 2024-05-03T16:48:22.497 INFO:teuthology.orchestra.run.smithi081.stdout:mds.h smithi134 running (5m) 2m ago 5m 16.6M - 19.0.0-3450-g9a047fe7 ee4d84620249 b7eedcd07fe7 2024-05-03T16:48:22.497 INFO:teuthology.orchestra.run.smithi081.stdout:mds.i smithi146 running (4m) 2m ago 4m 16.5M - 19.0.0-3450-g9a047fe7 ee4d84620249 d32a27fdb657 2024-05-03T16:48:22.497 INFO:teuthology.orchestra.run.smithi081.stdout:mds.j smithi081 running (5m) 2m ago 5m 13.2M - 19.0.0-3450-g9a047fe7 ee4d84620249 2f4da5fe3972 2024-05-03T16:48:22.497 INFO:teuthology.orchestra.run.smithi081.stdout:mds.k smithi134 running (5m) 2m ago 5m 16.8M - 19.0.0-3450-g9a047fe7 ee4d84620249 c9754eadb06b 2024-05-03T16:48:22.497 INFO:teuthology.orchestra.run.smithi081.stdout:mds.l smithi146 running (5m) 2m ago 5m 15.2M - 19.0.0-3450-g9a047fe7 ee4d84620249 de57b2e8ac3f 2024-05-03T16:48:22.497 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.x smithi081 *:9283,8765 running (15m) 2m ago 15m 529M - 19.0.0-3450-g9a047fe7 ee4d84620249 efb7bca1e819 2024-05-03T16:48:22.497 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.y smithi134 *:8443,8765 running (12m) 2m ago 12m 466M - 19.0.0-3450-g9a047fe7 ee4d84620249 1e2f457195e2 2024-05-03T16:48:22.497 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.z smithi146 *:8443,8765 running (12m) 2m ago 12m 466M - 19.0.0-3450-g9a047fe7 ee4d84620249 17ef6eaac8aa 2024-05-03T16:48:22.497 INFO:teuthology.orchestra.run.smithi081.stdout:mon.a smithi081 running (15m) 2m ago 15m 50.6M 2048M 19.0.0-3450-g9a047fe7 ee4d84620249 ac30952d6fd3 2024-05-03T16:48:22.497 INFO:teuthology.orchestra.run.smithi081.stdout:mon.b smithi134 running (13m) 2m ago 13m 40.0M 2048M 19.0.0-3450-g9a047fe7 ee4d84620249 609640d09339 2024-05-03T16:48:22.497 INFO:teuthology.orchestra.run.smithi081.stdout:mon.c smithi146 running (13m) 2m ago 13m 41.1M 2048M 19.0.0-3450-g9a047fe7 ee4d84620249 a6467fcc8a32 2024-05-03T16:48:22.497 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (12m) 2m ago 12m 45.0M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 4e8e1482c455 2024-05-03T16:48:22.497 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi134 running (11m) 2m ago 11m 45.7M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 2a262ba72092 2024-05-03T16:48:22.497 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi146 running (11m) 2m ago 11m 53.8M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 9565413ef240 2024-05-03T16:48:22.497 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi081 running (10m) 2m ago 10m 51.9M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 b75de4959980 2024-05-03T16:48:22.497 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi134 running (10m) 2m ago 10m 42.9M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 37f9a92980a1 2024-05-03T16:48:22.498 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi146 running (9m) 2m ago 9m 51.5M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 dc6cc5816e85 2024-05-03T16:48:22.498 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 smithi081 running (8m) 2m ago 8m 41.9M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 240f87870c6f 2024-05-03T16:48:22.498 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 smithi134 running (8m) 2m ago 8m 46.4M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 3022e26c5f4a 2024-05-03T16:48:22.498 INFO:teuthology.orchestra.run.smithi081.stdout:osd.8 smithi146 running (7m) 2m ago 7m 43.6M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 434f5f8898a1 2024-05-03T16:48:22.498 INFO:teuthology.orchestra.run.smithi081.stdout:osd.9 smithi081 running (7m) 2m ago 7m 52.6M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 eda782d2b293 2024-05-03T16:48:22.498 INFO:teuthology.orchestra.run.smithi081.stdout:osd.10 smithi134 running (6m) 2m ago 6m 43.3M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 262febe5a5b5 2024-05-03T16:48:22.498 INFO:teuthology.orchestra.run.smithi081.stdout:osd.11 smithi146 running (5m) 2m ago 5m 42.0M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 f885b91ed7be 2024-05-03T16:48:22.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.498+0000 7f3d22e00700 1 -- 172.21.15.81:0/197639782 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3d000b2910 msgr2=0x7f3d000b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:22.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.498+0000 7f3d22e00700 1 --2- 172.21.15.81:0/197639782 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3d000b2910 0x7f3d000b4dd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400b5c0 tx=0x7f3d04005fb0 comp rx=0 tx=0).stop 2024-05-03T16:48:22.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.498+0000 7f3d22e00700 1 -- 172.21.15.81:0/197639782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d1c103f90 msgr2=0x7f3d1c19b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:22.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.498+0000 7f3d22e00700 1 --2- 172.21.15.81:0/197639782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d1c103f90 0x7f3d1c19b730 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00c9e0 tx=0x7f3d0c00cda0 comp rx=0 tx=0).stop 2024-05-03T16:48:22.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.498+0000 7f3d22e00700 1 -- 172.21.15.81:0/197639782 shutdown_connections 2024-05-03T16:48:22.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.498+0000 7f3d22e00700 1 --2- 172.21.15.81:0/197639782 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3d000b2910 0x7f3d000b4dd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:22.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.498+0000 7f3d22e00700 1 --2- 172.21.15.81:0/197639782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d1c1091f0 0x7f3d1c1a2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:22.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.498+0000 7f3d22e00700 1 --2- 172.21.15.81:0/197639782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d1c103f90 0x7f3d1c19b730 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:22.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.498+0000 7f3d22e00700 1 --2- 172.21.15.81:0/197639782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d1c1068c0 0x7f3d1c19bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:22.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.498+0000 7f3d22e00700 1 -- 172.21.15.81:0/197639782 >> 172.21.15.81:0/197639782 conn(0x7f3d1c0fd9a0 msgr2=0x7f3d1c101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:22.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.498+0000 7f3d22e00700 1 -- 172.21.15.81:0/197639782 shutdown_connections 2024-05-03T16:48:22.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:22.498+0000 7f3d22e00700 1 -- 172.21.15.81:0/197639782 wait complete. 2024-05-03T16:48:23.462 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-03T16:48:23.930 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:48:24.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:23 smithi146 ceph-mon[32357]: pgmap v510: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:48:24.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:23 smithi146 ceph-mon[32357]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:48:24.079 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:23 smithi081 ceph-mon[28640]: pgmap v510: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:48:24.079 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:23 smithi081 ceph-mon[28640]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:48:24.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:23 smithi134 ceph-mon[31708]: pgmap v510: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:48:24.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:23 smithi134 ceph-mon[31708]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:48:25.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:25 smithi081 ceph-mon[28640]: pgmap v511: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:26.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:25 smithi146 ceph-mon[32357]: pgmap v511: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:26.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:25 smithi134 ceph-mon[31708]: pgmap v511: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.333+0000 7f2faea00700 1 -- 172.21.15.81:0/2973002794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa810faf0 msgr2=0x7f2fa8111ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.333+0000 7f2faea00700 1 --2- 172.21.15.81:0/2973002794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa810faf0 0x7f2fa8111ee0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009990 tx=0x7f2fa0009ca0 comp rx=0 tx=0).stop 2024-05-03T16:48:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.333+0000 7f2faea00700 1 -- 172.21.15.81:0/2973002794 shutdown_connections 2024-05-03T16:48:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.333+0000 7f2faea00700 1 --2- 172.21.15.81:0/2973002794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fa80774d0 0x7f2fa8075930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.333+0000 7f2faea00700 1 --2- 172.21.15.81:0/2973002794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa810faf0 0x7f2fa8111ee0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.333+0000 7f2faea00700 1 --2- 172.21.15.81:0/2973002794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fa8075f00 0x7f2fa8076380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.333+0000 7f2faea00700 1 -- 172.21.15.81:0/2973002794 >> 172.21.15.81:0/2973002794 conn(0x7f2fa80feab0 msgr2=0x7f2fa8100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.333+0000 7f2faea00700 1 -- 172.21.15.81:0/2973002794 shutdown_connections 2024-05-03T16:48:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.333+0000 7f2faea00700 1 -- 172.21.15.81:0/2973002794 wait complete. 2024-05-03T16:48:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.334+0000 7f2faea00700 1 Processor -- start 2024-05-03T16:48:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.335+0000 7f2faea00700 1 -- start start 2024-05-03T16:48:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.335+0000 7f2faea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa8075f00 0x7f2fa819fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.335+0000 7f2faea00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fa80774d0 0x7f2fa81a0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.335+0000 7f2faea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fa810faf0 0x7f2fa81a7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.335+0000 7f2faea00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa81154a0 con 0x7f2fa8075f00 2024-05-03T16:48:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.335+0000 7f2faea00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa8115320 con 0x7f2fa810faf0 2024-05-03T16:48:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.335+0000 7f2faea00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa8115620 con 0x7f2fa80774d0 2024-05-03T16:48:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.335+0000 7f2fa7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa8075f00 0x7f2fa819fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.335+0000 7f2fa7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa8075f00 0x7f2fa819fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60952/0 (socket says 172.21.15.81:60952) 2024-05-03T16:48:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.335+0000 7f2fa7e00700 1 -- 172.21.15.81:0/3980929226 learned_addr learned my addr 172.21.15.81:0/3980929226 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.336+0000 7f2f9f400700 1 --2- 172.21.15.81:0/3980929226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fa80774d0 0x7f2fa81a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.336+0000 7f2faca00700 1 --2- 172.21.15.81:0/3980929226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fa810faf0 0x7f2fa81a7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.336+0000 7f2fa7e00700 1 -- 172.21.15.81:0/3980929226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fa80774d0 msgr2=0x7f2fa81a0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.336+0000 7f2fa7e00700 1 --2- 172.21.15.81:0/3980929226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fa80774d0 0x7f2fa81a0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.336+0000 7f2fa7e00700 1 -- 172.21.15.81:0/3980929226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fa810faf0 msgr2=0x7f2fa81a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.336+0000 7f2fa7e00700 1 --2- 172.21.15.81:0/3980929226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fa810faf0 0x7f2fa81a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.336+0000 7f2fa7e00700 1 -- 172.21.15.81:0/3980929226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa81a7720 con 0x7f2fa8075f00 2024-05-03T16:48:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.336+0000 7f2faca00700 1 --2- 172.21.15.81:0/3980929226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fa810faf0 0x7f2fa81a7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:48:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.336+0000 7f2fa7e00700 1 --2- 172.21.15.81:0/3980929226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa8075f00 0x7f2fa819fac0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2f98007e20 tx=0x7f2f9800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.337+0000 7f2fa5600700 1 -- 172.21.15.81:0/3980929226 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98016020 con 0x7f2fa8075f00 2024-05-03T16:48:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.337+0000 7f2fa5600700 1 -- 172.21.15.81:0/3980929226 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f9800adc0 con 0x7f2fa8075f00 2024-05-03T16:48:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.337+0000 7f2faea00700 1 -- 172.21.15.81:0/3980929226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa81a7a10 con 0x7f2fa8075f00 2024-05-03T16:48:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.337+0000 7f2fa5600700 1 -- 172.21.15.81:0/3980929226 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f980115e0 con 0x7f2fa8075f00 2024-05-03T16:48:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.337+0000 7f2faea00700 1 -- 172.21.15.81:0/3980929226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa81a7f50 con 0x7f2fa8075f00 2024-05-03T16:48:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.338+0000 7f2faea00700 1 -- 172.21.15.81:0/3980929226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa806a190 con 0x7f2fa8075f00 2024-05-03T16:48:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.340+0000 7f2fa5600700 1 -- 172.21.15.81:0/3980929226 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f2f98019020 con 0x7f2fa8075f00 2024-05-03T16:48:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.342+0000 7f2fa5600700 1 --2- 172.21.15.81:0/3980929226 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f2f8c0b2910 0x7f2f8c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.342+0000 7f2fa5600700 1 -- 172.21.15.81:0/3980929226 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f2f980e2800 con 0x7f2fa8075f00 2024-05-03T16:48:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.342+0000 7f2f9f400700 1 --2- 172.21.15.81:0/3980929226 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f2f8c0b2910 0x7f2f8c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:26.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.343+0000 7f2f9f400700 1 --2- 172.21.15.81:0/3980929226 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f2f8c0b2910 0x7f2f8c0b4dd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2f90005fd0 tx=0x7f2f90005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.344+0000 7f2fa5600700 1 -- 172.21.15.81:0/3980929226 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f2f980aa0c0 con 0x7f2fa8075f00 2024-05-03T16:48:26.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.589+0000 7f2faea00700 1 -- 172.21.15.81:0/3980929226 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f2fa80638e0 con 0x7f2f8c0b2910 2024-05-03T16:48:26.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.612+0000 7f2fa5600700 1 -- 172.21.15.81:0/3980929226 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f2fa80638e0 con 0x7f2f8c0b2910 2024-05-03T16:48:26.614 INFO:teuthology.orchestra.run.smithi081.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-03T16:48:26.614 INFO:teuthology.orchestra.run.smithi081.stdout:mds.all 12/12 2m ago 5m smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi146=c;smithi146=f;smithi146=i;smithi146=l;count:12 2024-05-03T16:48:26.614 INFO:teuthology.orchestra.run.smithi081.stdout:mgr 3/3 2m ago 12m smithi081=x;smithi134=y;smithi146=z;count:3 2024-05-03T16:48:26.614 INFO:teuthology.orchestra.run.smithi081.stdout:mon 3/3 2m ago 13m smithi081:172.21.15.81=a;smithi134:172.21.15.134=b;smithi146:172.21.15.146=c;count:3 2024-05-03T16:48:26.614 INFO:teuthology.orchestra.run.smithi081.stdout:osd 12 2m ago - 2024-05-03T16:48:26.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.615+0000 7f2faea00700 1 -- 172.21.15.81:0/3980929226 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f2f8c0b2910 msgr2=0x7f2f8c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:26.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.615+0000 7f2faea00700 1 --2- 172.21.15.81:0/3980929226 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f2f8c0b2910 0x7f2f8c0b4dd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2f90005fd0 tx=0x7f2f90005dd0 comp rx=0 tx=0).stop 2024-05-03T16:48:26.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.615+0000 7f2faea00700 1 -- 172.21.15.81:0/3980929226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa8075f00 msgr2=0x7f2fa819fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:26.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.615+0000 7f2faea00700 1 --2- 172.21.15.81:0/3980929226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa8075f00 0x7f2fa819fac0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2f98007e20 tx=0x7f2f9800a340 comp rx=0 tx=0).stop 2024-05-03T16:48:26.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.616+0000 7f2faea00700 1 -- 172.21.15.81:0/3980929226 shutdown_connections 2024-05-03T16:48:26.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.616+0000 7f2faea00700 1 --2- 172.21.15.81:0/3980929226 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f2f8c0b2910 0x7f2f8c0b4dd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:26.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.616+0000 7f2faea00700 1 --2- 172.21.15.81:0/3980929226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fa810faf0 0x7f2fa81a7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:26.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.616+0000 7f2faea00700 1 --2- 172.21.15.81:0/3980929226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa8075f00 0x7f2fa819fac0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:26.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.616+0000 7f2faea00700 1 --2- 172.21.15.81:0/3980929226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fa80774d0 0x7f2fa81a0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:26.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.616+0000 7f2faea00700 1 -- 172.21.15.81:0/3980929226 >> 172.21.15.81:0/3980929226 conn(0x7f2fa80feab0 msgr2=0x7f2fa8102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:26.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.616+0000 7f2faea00700 1 -- 172.21.15.81:0/3980929226 shutdown_connections 2024-05-03T16:48:26.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:26.616+0000 7f2faea00700 1 -- 172.21.15.81:0/3980929226 wait complete. 2024-05-03T16:48:27.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-03T16:48:28.039 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:48:28.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:27 smithi146 ceph-mon[32357]: pgmap v512: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:48:28.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:27 smithi146 ceph-mon[32357]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:48:28.184 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:27 smithi081 ceph-mon[28640]: pgmap v512: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:48:28.184 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:27 smithi081 ceph-mon[28640]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:48:28.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:27 smithi134 ceph-mon[31708]: pgmap v512: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:48:28.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:27 smithi134 ceph-mon[31708]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:48:30.068 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:29 smithi081 ceph-mon[28640]: pgmap v513: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:30.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:29 smithi134 ceph-mon[31708]: pgmap v513: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:30.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:29 smithi146 ceph-mon[32357]: pgmap v513: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.477+0000 7f8ad5600700 1 -- 172.21.15.81:0/2002522864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ad010b5d0 msgr2=0x7f8ad0111e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.477+0000 7f8ad5600700 1 --2- 172.21.15.81:0/2002522864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ad010b5d0 0x7f8ad0111e80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8ac800b0d0 tx=0x7f8ac800b3e0 comp rx=0 tx=0).stop 2024-05-03T16:48:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.478+0000 7f8ad5600700 1 -- 172.21.15.81:0/2002522864 shutdown_connections 2024-05-03T16:48:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.478+0000 7f8ad5600700 1 --2- 172.21.15.81:0/2002522864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ad010b5d0 0x7f8ad0111e80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:30.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.478+0000 7f8ad5600700 1 --2- 172.21.15.81:0/2002522864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad0109a30 0x7f8ad0109e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:30.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.478+0000 7f8ad5600700 1 --2- 172.21.15.81:0/2002522864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad010ac30 0x7f8ad010b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:30.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.478+0000 7f8ad5600700 1 -- 172.21.15.81:0/2002522864 >> 172.21.15.81:0/2002522864 conn(0x7f8ad0078a00 msgr2=0x7f8ad007ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:30.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.478+0000 7f8ad5600700 1 -- 172.21.15.81:0/2002522864 shutdown_connections 2024-05-03T16:48:30.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.478+0000 7f8ad5600700 1 -- 172.21.15.81:0/2002522864 wait complete. 2024-05-03T16:48:30.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.479+0000 7f8ad5600700 1 Processor -- start 2024-05-03T16:48:30.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.479+0000 7f8ad5600700 1 -- start start 2024-05-03T16:48:30.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.479+0000 7f8ad5600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad0109a30 0x7f8ad019fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:30.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.479+0000 7f8ad5600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ad010ac30 0x7f8ad019ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:30.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.479+0000 7f8ad5600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad010b5d0 0x7f8ad01a6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.479+0000 7f8ad5600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad01153d0 con 0x7f8ad010ac30 2024-05-03T16:48:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.479+0000 7f8ad5600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad0115250 con 0x7f8ad010b5d0 2024-05-03T16:48:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.479+0000 7f8ad5600700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad0115550 con 0x7f8ad0109a30 2024-05-03T16:48:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.480+0000 7f8acf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ad010ac30 0x7f8ad019ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.480+0000 7f8acf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ad010ac30 0x7f8ad019ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60970/0 (socket says 172.21.15.81:60970) 2024-05-03T16:48:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.480+0000 7f8acf400700 1 -- 172.21.15.81:0/3363825807 learned_addr learned my addr 172.21.15.81:0/3363825807 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.480+0000 7f8acfe00700 1 --2- 172.21.15.81:0/3363825807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad0109a30 0x7f8ad019fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.480+0000 7f8ad4c00700 1 --2- 172.21.15.81:0/3363825807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad010b5d0 0x7f8ad01a6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.480+0000 7f8acf400700 1 -- 172.21.15.81:0/3363825807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad0109a30 msgr2=0x7f8ad019fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.480+0000 7f8acf400700 1 --2- 172.21.15.81:0/3363825807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad0109a30 0x7f8ad019fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.480+0000 7f8acf400700 1 -- 172.21.15.81:0/3363825807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad010b5d0 msgr2=0x7f8ad01a6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.480+0000 7f8acf400700 1 --2- 172.21.15.81:0/3363825807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad010b5d0 0x7f8ad01a6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.480+0000 7f8acf400700 1 -- 172.21.15.81:0/3363825807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad01a7670 con 0x7f8ad010ac30 2024-05-03T16:48:30.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.480+0000 7f8acf400700 1 --2- 172.21.15.81:0/3363825807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ad010ac30 0x7f8ad019ff50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00d9b0 tx=0x7f8abc00dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:30.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.481+0000 7f8accc00700 1 -- 172.21.15.81:0/3363825807 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc017070 con 0x7f8ad010ac30 2024-05-03T16:48:30.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.481+0000 7f8accc00700 1 -- 172.21.15.81:0/3363825807 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8abc004830 con 0x7f8ad010ac30 2024-05-03T16:48:30.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.481+0000 7f8accc00700 1 -- 172.21.15.81:0/3363825807 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc0053a0 con 0x7f8ad010ac30 2024-05-03T16:48:30.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.481+0000 7f8ad5600700 1 -- 172.21.15.81:0/3363825807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad01a7960 con 0x7f8ad010ac30 2024-05-03T16:48:30.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.481+0000 7f8ad5600700 1 -- 172.21.15.81:0/3363825807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad01a7e50 con 0x7f8ad010ac30 2024-05-03T16:48:30.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.482+0000 7f8ad5600700 1 -- 172.21.15.81:0/3363825807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad006a190 con 0x7f8ad010ac30 2024-05-03T16:48:30.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.484+0000 7f8accc00700 1 -- 172.21.15.81:0/3363825807 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f8abc0049e0 con 0x7f8ad010ac30 2024-05-03T16:48:30.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.486+0000 7f8accc00700 1 --2- 172.21.15.81:0/3363825807 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8ab40b2910 0x7f8ab40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:30.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.486+0000 7f8accc00700 1 -- 172.21.15.81:0/3363825807 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f8abc0e2ab0 con 0x7f8ad010ac30 2024-05-03T16:48:30.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.486+0000 7f8acfe00700 1 --2- 172.21.15.81:0/3363825807 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8ab40b2910 0x7f8ab40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.487+0000 7f8acfe00700 1 --2- 172.21.15.81:0/3363825807 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8ab40b2910 0x7f8ab40b4dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0005950 tx=0x7f8ac00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:30.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.489+0000 7f8accc00700 1 -- 172.21.15.81:0/3363825807 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8abc020020 con 0x7f8ad010ac30 2024-05-03T16:48:30.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.726+0000 7f8ad5600700 1 -- 172.21.15.81:0/3363825807 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f8ad00638e0 con 0x7f8ab40b2910 2024-05-03T16:48:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.728+0000 7f8accc00700 1 -- 172.21.15.81:0/3363825807 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f8ad00638e0 con 0x7f8ab40b2910 2024-05-03T16:48:30.730 INFO:teuthology.orchestra.run.smithi081.stdout:HOST ADDR LABELS STATUS 2024-05-03T16:48:30.730 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081 172.21.15.81 2024-05-03T16:48:30.730 INFO:teuthology.orchestra.run.smithi081.stdout:smithi134 172.21.15.134 2024-05-03T16:48:30.730 INFO:teuthology.orchestra.run.smithi081.stdout:smithi146 172.21.15.146 2024-05-03T16:48:30.730 INFO:teuthology.orchestra.run.smithi081.stdout:3 hosts in cluster 2024-05-03T16:48:30.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.731+0000 7f8ad5600700 1 -- 172.21.15.81:0/3363825807 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8ab40b2910 msgr2=0x7f8ab40b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:30.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.731+0000 7f8ad5600700 1 --2- 172.21.15.81:0/3363825807 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8ab40b2910 0x7f8ab40b4dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0005950 tx=0x7f8ac00058e0 comp rx=0 tx=0).stop 2024-05-03T16:48:30.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.731+0000 7f8ad5600700 1 -- 172.21.15.81:0/3363825807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ad010ac30 msgr2=0x7f8ad019ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:30.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.731+0000 7f8ad5600700 1 --2- 172.21.15.81:0/3363825807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ad010ac30 0x7f8ad019ff50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00d9b0 tx=0x7f8abc00dd70 comp rx=0 tx=0).stop 2024-05-03T16:48:30.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.731+0000 7f8ad5600700 1 -- 172.21.15.81:0/3363825807 shutdown_connections 2024-05-03T16:48:30.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.731+0000 7f8ad5600700 1 --2- 172.21.15.81:0/3363825807 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f8ab40b2910 0x7f8ab40b4dd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:30.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.732+0000 7f8ad5600700 1 --2- 172.21.15.81:0/3363825807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad0109a30 0x7f8ad019fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:30.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.732+0000 7f8ad5600700 1 --2- 172.21.15.81:0/3363825807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad010b5d0 0x7f8ad01a6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:30.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.732+0000 7f8ad5600700 1 --2- 172.21.15.81:0/3363825807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ad010ac30 0x7f8ad019ff50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:30.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.732+0000 7f8ad5600700 1 -- 172.21.15.81:0/3363825807 >> 172.21.15.81:0/3363825807 conn(0x7f8ad0078a00 msgr2=0x7f8ad010df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:30.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.732+0000 7f8ad5600700 1 -- 172.21.15.81:0/3363825807 shutdown_connections 2024-05-03T16:48:30.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:30.732+0000 7f8ad5600700 1 -- 172.21.15.81:0/3363825807 wait complete. 2024-05-03T16:48:31.558 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-03T16:48:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:48:32.163 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:31 smithi081 ceph-mon[28640]: pgmap v514: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:32.163 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:31 smithi081 ceph-mon[28640]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:48:32.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:31 smithi134 ceph-mon[31708]: pgmap v514: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:32.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:31 smithi134 ceph-mon[31708]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:48:32.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:31 smithi146 ceph-mon[32357]: pgmap v514: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:32.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:31 smithi146 ceph-mon[32357]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:48:34.047 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:33 smithi081 ceph-mon[28640]: pgmap v515: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:48:34.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:33 smithi134 ceph-mon[31708]: pgmap v515: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:48:34.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:33 smithi146 ceph-mon[32357]: pgmap v515: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:48:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.333+0000 7ffab6c00700 1 -- 172.21.15.81:0/255030687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab0109b40 msgr2=0x7ffab0109f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.333+0000 7ffab6c00700 1 --2- 172.21.15.81:0/255030687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab0109b40 0x7ffab0109f60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000b0d0 tx=0x7ffaa000b3e0 comp rx=0 tx=0).stop 2024-05-03T16:48:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.333+0000 7ffab6c00700 1 -- 172.21.15.81:0/255030687 shutdown_connections 2024-05-03T16:48:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.333+0000 7ffab6c00700 1 --2- 172.21.15.81:0/255030687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab010b6e0 0x7ffab0111f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.333+0000 7ffab6c00700 1 --2- 172.21.15.81:0/255030687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab0109b40 0x7ffab0109f60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.333+0000 7ffab6c00700 1 --2- 172.21.15.81:0/255030687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffab010ad40 0x7ffab010b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.333+0000 7ffab6c00700 1 -- 172.21.15.81:0/255030687 >> 172.21.15.81:0/255030687 conn(0x7ffab0078b10 msgr2=0x7ffab007af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.333+0000 7ffab6c00700 1 -- 172.21.15.81:0/255030687 shutdown_connections 2024-05-03T16:48:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.333+0000 7ffab6c00700 1 -- 172.21.15.81:0/255030687 wait complete. 2024-05-03T16:48:34.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.334+0000 7ffab6c00700 1 Processor -- start 2024-05-03T16:48:34.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.335+0000 7ffab6c00700 1 -- start start 2024-05-03T16:48:34.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.335+0000 7ffab6c00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab0109b40 0x7ffab019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:34.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.335+0000 7ffab6c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab010ad40 0x7ffab01a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:34.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.335+0000 7ffab6c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffab010b6e0 0x7ffab01a71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:34.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.335+0000 7ffab6c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffab0115550 con 0x7ffab010ad40 2024-05-03T16:48:34.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.335+0000 7ffab6c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffab01153d0 con 0x7ffab010b6e0 2024-05-03T16:48:34.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.335+0000 7ffab6c00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffab01156d0 con 0x7ffab0109b40 2024-05-03T16:48:34.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.335+0000 7ffaa7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab010ad40 0x7ffab01a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:34.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.335+0000 7ffaa7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab010ad40 0x7ffab01a0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60996/0 (socket says 172.21.15.81:60996) 2024-05-03T16:48:34.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.335+0000 7ffaa7400700 1 -- 172.21.15.81:0/4099642994 learned_addr learned my addr 172.21.15.81:0/4099642994 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:34.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.336+0000 7ffaafe00700 1 --2- 172.21.15.81:0/4099642994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab0109b40 0x7ffab019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:34.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.336+0000 7ffab4c00700 1 --2- 172.21.15.81:0/4099642994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffab010b6e0 0x7ffab01a71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:34.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.336+0000 7ffaa7400700 1 -- 172.21.15.81:0/4099642994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab0109b40 msgr2=0x7ffab019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:34.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.336+0000 7ffaa7400700 1 --2- 172.21.15.81:0/4099642994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab0109b40 0x7ffab019fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:34.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.336+0000 7ffaa7400700 1 -- 172.21.15.81:0/4099642994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffab010b6e0 msgr2=0x7ffab01a71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:34.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.336+0000 7ffaa7400700 1 --2- 172.21.15.81:0/4099642994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffab010b6e0 0x7ffab01a71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:34.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.336+0000 7ffaa7400700 1 -- 172.21.15.81:0/4099642994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab01a7890 con 0x7ffab010ad40 2024-05-03T16:48:34.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.336+0000 7ffaafe00700 1 --2- 172.21.15.81:0/4099642994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab0109b40 0x7ffab019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:48:34.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.336+0000 7ffab4c00700 1 --2- 172.21.15.81:0/4099642994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffab010b6e0 0x7ffab01a71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:48:34.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.336+0000 7ffaa7400700 1 --2- 172.21.15.81:0/4099642994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab010ad40 0x7ffab01a0180 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800b530 tx=0x7ffa9800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:34.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.336+0000 7ffaad600700 1 -- 172.21.15.81:0/4099642994 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98015020 con 0x7ffab010ad40 2024-05-03T16:48:34.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.336+0000 7ffaad600700 1 -- 172.21.15.81:0/4099642994 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa98011cc0 con 0x7ffab010ad40 2024-05-03T16:48:34.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.336+0000 7ffab6c00700 1 -- 172.21.15.81:0/4099642994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab01a7b80 con 0x7ffab010ad40 2024-05-03T16:48:34.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.336+0000 7ffaad600700 1 -- 172.21.15.81:0/4099642994 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98010d30 con 0x7ffab010ad40 2024-05-03T16:48:34.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.337+0000 7ffab6c00700 1 -- 172.21.15.81:0/4099642994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab01a8110 con 0x7ffab010ad40 2024-05-03T16:48:34.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.338+0000 7ffab6c00700 1 -- 172.21.15.81:0/4099642994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab006a1d0 con 0x7ffab010ad40 2024-05-03T16:48:34.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.340+0000 7ffaad600700 1 -- 172.21.15.81:0/4099642994 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ffa98018020 con 0x7ffab010ad40 2024-05-03T16:48:34.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.341+0000 7ffaad600700 1 --2- 172.21.15.81:0/4099642994 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ffa940b2990 0x7ffa940b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:34.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.341+0000 7ffaad600700 1 -- 172.21.15.81:0/4099642994 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7ffa980e1eb0 con 0x7ffab010ad40 2024-05-03T16:48:34.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.342+0000 7ffaafe00700 1 --2- 172.21.15.81:0/4099642994 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ffa940b2990 0x7ffa940b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:34.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.342+0000 7ffaafe00700 1 --2- 172.21.15.81:0/4099642994 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ffa940b2990 0x7ffa940b4e50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffab01a1120 tx=0x7ffaa000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:34.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.346+0000 7ffaad600700 1 -- 172.21.15.81:0/4099642994 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ffa9801f020 con 0x7ffab010ad40 2024-05-03T16:48:34.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.581+0000 7ffab6c00700 1 -- 172.21.15.81:0/4099642994 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7ffab00638e0 con 0x7ffa940b2990 2024-05-03T16:48:34.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.584+0000 7ffaad600700 1 -- 172.21.15.81:0/4099642994 <== mgr.14152 v2:172.21.15.81:6800/1773670984 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7ffab00638e0 con 0x7ffa940b2990 2024-05-03T16:48:34.586 INFO:teuthology.orchestra.run.smithi081.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-03T16:48:34.586 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400N7400BGN 372G No 7m ago Has a FileSystem, LVM detected 2024-05-03T16:48:34.586 INFO:teuthology.orchestra.run.smithi081.stdout:smithi134 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62420002400BGN 372G No 6m ago Has a FileSystem, LVM detected 2024-05-03T16:48:34.586 INFO:teuthology.orchestra.run.smithi081.stdout:smithi146 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GB400BGN 372G No 5m ago Has a FileSystem, LVM detected 2024-05-03T16:48:34.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.587+0000 7ffab6c00700 1 -- 172.21.15.81:0/4099642994 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ffa940b2990 msgr2=0x7ffa940b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:34.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.587+0000 7ffab6c00700 1 --2- 172.21.15.81:0/4099642994 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ffa940b2990 0x7ffa940b4e50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffab01a1120 tx=0x7ffaa000b040 comp rx=0 tx=0).stop 2024-05-03T16:48:34.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.587+0000 7ffab6c00700 1 -- 172.21.15.81:0/4099642994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab010ad40 msgr2=0x7ffab01a0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:34.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.587+0000 7ffab6c00700 1 --2- 172.21.15.81:0/4099642994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab010ad40 0x7ffab01a0180 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800b530 tx=0x7ffa9800b8f0 comp rx=0 tx=0).stop 2024-05-03T16:48:34.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.588+0000 7ffab6c00700 1 -- 172.21.15.81:0/4099642994 shutdown_connections 2024-05-03T16:48:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.588+0000 7ffab6c00700 1 --2- 172.21.15.81:0/4099642994 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ffa940b2990 0x7ffa940b4e50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.588+0000 7ffab6c00700 1 --2- 172.21.15.81:0/4099642994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab0109b40 0x7ffab019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.588+0000 7ffab6c00700 1 --2- 172.21.15.81:0/4099642994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffab010b6e0 0x7ffab01a71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.588+0000 7ffab6c00700 1 --2- 172.21.15.81:0/4099642994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab010ad40 0x7ffab01a0180 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.588+0000 7ffab6c00700 1 -- 172.21.15.81:0/4099642994 >> 172.21.15.81:0/4099642994 conn(0x7ffab0078b10 msgr2=0x7ffab010e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.588+0000 7ffab6c00700 1 -- 172.21.15.81:0/4099642994 shutdown_connections 2024-05-03T16:48:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:34.588+0000 7ffab6c00700 1 -- 172.21.15.81:0/4099642994 wait complete. 2024-05-03T16:48:35.504 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-03T16:48:35.513 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-05-03T16:48:35.513 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-03T16:48:35.977 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:48:36.128 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:35 smithi081 ceph-mon[28640]: pgmap v516: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:36.128 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:35 smithi081 ceph-mon[28640]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:48:36.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:35 smithi134 ceph-mon[31708]: pgmap v516: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:36.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:35 smithi134 ceph-mon[31708]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:48:36.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:35 smithi146 ceph-mon[32357]: pgmap v516: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:36.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:35 smithi146 ceph-mon[32357]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:48:37.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:37 smithi081 ceph-mon[28640]: pgmap v517: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:48:38.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:37 smithi134 ceph-mon[31708]: pgmap v517: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:48:38.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.275+0000 7f3ca8400700 1 -- 172.21.15.81:0/1322143093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca010ad40 msgr2=0x7f3ca010b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:38.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.275+0000 7f3ca8400700 1 --2- 172.21.15.81:0/1322143093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca010ad40 0x7f3ca010b1a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c0099c0 tx=0x7f3c8c009cd0 comp rx=0 tx=0).stop 2024-05-03T16:48:38.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.276+0000 7f3ca8400700 1 -- 172.21.15.81:0/1322143093 shutdown_connections 2024-05-03T16:48:38.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.276+0000 7f3ca8400700 1 --2- 172.21.15.81:0/1322143093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ca010b6e0 0x7f3ca0111f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:38.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.276+0000 7f3ca8400700 1 --2- 172.21.15.81:0/1322143093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca0109b40 0x7f3ca0109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:38.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.276+0000 7f3ca8400700 1 --2- 172.21.15.81:0/1322143093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca010ad40 0x7f3ca010b1a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:38.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.276+0000 7f3ca8400700 1 -- 172.21.15.81:0/1322143093 >> 172.21.15.81:0/1322143093 conn(0x7f3ca0078b10 msgr2=0x7f3ca007af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:38.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.276+0000 7f3ca8400700 1 -- 172.21.15.81:0/1322143093 shutdown_connections 2024-05-03T16:48:38.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.276+0000 7f3ca8400700 1 -- 172.21.15.81:0/1322143093 wait complete. 2024-05-03T16:48:38.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.277+0000 7f3ca8400700 1 Processor -- start 2024-05-03T16:48:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.277+0000 7f3ca8400700 1 -- start start 2024-05-03T16:48:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.277+0000 7f3ca8400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0109b40 0x7f3ca019fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.277+0000 7f3ca8400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca010ad40 0x7f3ca019fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.277+0000 7f3ca8400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ca010b6e0 0x7f3ca01a7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.277+0000 7f3ca8400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca0115490 con 0x7f3ca0109b40 2024-05-03T16:48:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.277+0000 7f3ca8400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca0115310 con 0x7f3ca010ad40 2024-05-03T16:48:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.277+0000 7f3ca8400700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca0115610 con 0x7f3ca010b6e0 2024-05-03T16:48:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.278+0000 7f3ca5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0109b40 0x7f3ca019fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.278+0000 7f3ca5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0109b40 0x7f3ca019fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35332/0 (socket says 172.21.15.81:35332) 2024-05-03T16:48:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.278+0000 7f3ca5a00700 1 -- 172.21.15.81:0/4190456989 learned_addr learned my addr 172.21.15.81:0/4190456989 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.278+0000 7f3ca5000700 1 --2- 172.21.15.81:0/4190456989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca010ad40 0x7f3ca019fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.278+0000 7f3ca6400700 1 --2- 172.21.15.81:0/4190456989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ca010b6e0 0x7f3ca01a7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.278+0000 7f3ca5a00700 1 -- 172.21.15.81:0/4190456989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ca010b6e0 msgr2=0x7f3ca01a7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:38.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.278+0000 7f3ca5a00700 1 --2- 172.21.15.81:0/4190456989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ca010b6e0 0x7f3ca01a7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:38.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.278+0000 7f3ca5a00700 1 -- 172.21.15.81:0/4190456989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca010ad40 msgr2=0x7f3ca019fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:38.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.278+0000 7f3ca5a00700 1 --2- 172.21.15.81:0/4190456989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca010ad40 0x7f3ca019fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:38.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.278+0000 7f3ca5a00700 1 -- 172.21.15.81:0/4190456989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca01a7710 con 0x7f3ca0109b40 2024-05-03T16:48:38.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.279+0000 7f3ca5a00700 1 --2- 172.21.15.81:0/4190456989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0109b40 0x7f3ca019fab0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400c9c0 tx=0x7f3c9400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:38.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.279+0000 7f3c9e000700 1 -- 172.21.15.81:0/4190456989 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c94007ac0 con 0x7f3ca0109b40 2024-05-03T16:48:38.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.279+0000 7f3c9e000700 1 -- 172.21.15.81:0/4190456989 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c94007c60 con 0x7f3ca0109b40 2024-05-03T16:48:38.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.279+0000 7f3ca8400700 1 -- 172.21.15.81:0/4190456989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca01a7a00 con 0x7f3ca0109b40 2024-05-03T16:48:38.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.279+0000 7f3c9e000700 1 -- 172.21.15.81:0/4190456989 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c94018660 con 0x7f3ca0109b40 2024-05-03T16:48:38.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.279+0000 7f3ca8400700 1 -- 172.21.15.81:0/4190456989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca01a7f90 con 0x7f3ca0109b40 2024-05-03T16:48:38.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.280+0000 7f3ca8400700 1 -- 172.21.15.81:0/4190456989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca006a190 con 0x7f3ca0109b40 2024-05-03T16:48:38.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.282+0000 7f3c9e000700 1 -- 172.21.15.81:0/4190456989 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3c9400f450 con 0x7f3ca0109b40 2024-05-03T16:48:38.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.284+0000 7f3c9e000700 1 --2- 172.21.15.81:0/4190456989 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3c880b2990 0x7f3c880b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:38.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.284+0000 7f3c9e000700 1 -- 172.21.15.81:0/4190456989 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f3c940e27d0 con 0x7f3ca0109b40 2024-05-03T16:48:38.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.284+0000 7f3ca5000700 1 --2- 172.21.15.81:0/4190456989 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3c880b2990 0x7f3c880b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:38.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.285+0000 7f3ca5000700 1 --2- 172.21.15.81:0/4190456989 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3c880b2990 0x7f3c880b4e50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c000c00 tx=0x7f3c8c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:38.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.288+0000 7f3c9e000700 1 -- 172.21.15.81:0/4190456989 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f3c94014030 con 0x7f3ca0109b40 2024-05-03T16:48:38.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:37 smithi146 ceph-mon[32357]: pgmap v517: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:48:38.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.569+0000 7f3ca8400700 1 -- 172.21.15.81:0/4190456989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3ca002e540 con 0x7f3ca0109b40 2024-05-03T16:48:38.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.569+0000 7f3c9e000700 1 -- 172.21.15.81:0/4190456989 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) ==== 76+0+3098 (secure 0 0 0) 0x7f3c940a9f80 con 0x7f3ca0109b40 2024-05-03T16:48:38.571 INFO:teuthology.orchestra.run.smithi081.stdout:e29 2024-05-03T16:48:38.571 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-03T16:48:38.571 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-03T16:48:38.572 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-05-03T16:48:38.572 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:48:38.572 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-05-03T16:48:38.572 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-05-03T16:48:38.572 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 29 2024-05-03T16:48:38.572 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-03T16:48:38.572 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-05-03T16:43:58.734681+0000 2024-05-03T16:48:38.572 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-05-03T16:45:31.547191+0000 2024-05-03T16:48:38.572 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-05-03T16:48:38.572 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-05-03T16:48:38.572 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 300 2024-05-03T16:48:38.572 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-05-03T16:48:38.572 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-05-03T16:48:38.572 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-05-03T16:48:38.573 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-05-03T16:48:38.573 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-05-03T16:48:38.573 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 0 2024-05-03T16:48:38.573 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-03T16:48:38.573 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 5 2024-05-03T16:48:38.573 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1,2,3,4 2024-05-03T16:48:38.573 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=34466,1=34439,2=34418,3=34400,4=24481} 2024-05-03T16:48:38.573 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-05-03T16:48:38.573 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-05-03T16:48:38.573 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-05-03T16:48:38.573 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3,4] 2024-05-03T16:48:38.573 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-05-03T16:48:38.573 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-05-03T16:48:38.573 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-05-03T16:48:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-05-03T16:48:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 0 2024-05-03T16:48:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 34466 members: 24481,34400,34466,34439,34418 2024-05-03T16:48:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b{0:34466} state up:active seq 6 addr [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T16:48:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c{0:24463} state up:standby-replay seq 1 addr [v2:172.21.15.146:6836/971814714,v1:172.21.15.146:6837/971814714] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T16:48:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.h{1:34439} state up:active seq 32 addr [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T16:48:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.f{1:24451} state up:standby-replay seq 1 addr [v2:172.21.15.146:6834/3514751933,v1:172.21.15.146:6835/3514751933] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T16:48:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.e{2:34418} state up:active seq 36 addr [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T16:48:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.l{2:24418} state up:standby-replay seq 1 addr [v2:172.21.15.146:6832/1900581381,v1:172.21.15.146:6833/1900581381] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T16:48:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.k{3:34400} state up:active seq 39 addr [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T16:48:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a{3:14595} state up:standby-replay seq 1 addr [v2:172.21.15.81:6840/1174252889,v1:172.21.15.81:6841/1174252889] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T16:48:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.i{4:24481} state up:active seq 32 addr [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T16:48:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.g{4:14589} state up:standby-replay seq 1 addr [v2:172.21.15.81:6838/3710454674,v1:172.21.15.81:6839/3710454674] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T16:48:38.574 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:48:38.575 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:48:38.575 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-05-03T16:48:38.575 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:48:38.575 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.j{-1:14526} state up:standby seq 1 addr [v2:172.21.15.81:6834/886382058,v1:172.21.15.81:6835/886382058] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T16:48:38.575 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d{-1:14532} state up:standby seq 1 addr [v2:172.21.15.81:6836/3285208793,v1:172.21.15.81:6837/3285208793] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T16:48:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.574+0000 7f3ca8400700 1 -- 172.21.15.81:0/4190456989 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3c880b2990 msgr2=0x7f3c880b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.574+0000 7f3ca8400700 1 --2- 172.21.15.81:0/4190456989 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3c880b2990 0x7f3c880b4e50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c000c00 tx=0x7f3c8c01a040 comp rx=0 tx=0).stop 2024-05-03T16:48:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.574+0000 7f3ca8400700 1 -- 172.21.15.81:0/4190456989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0109b40 msgr2=0x7f3ca019fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.574+0000 7f3ca8400700 1 --2- 172.21.15.81:0/4190456989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0109b40 0x7f3ca019fab0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400c9c0 tx=0x7f3c9400cd80 comp rx=0 tx=0).stop 2024-05-03T16:48:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.574+0000 7f3ca8400700 1 -- 172.21.15.81:0/4190456989 shutdown_connections 2024-05-03T16:48:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.574+0000 7f3ca8400700 1 --2- 172.21.15.81:0/4190456989 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f3c880b2990 0x7f3c880b4e50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.574+0000 7f3ca8400700 1 --2- 172.21.15.81:0/4190456989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ca010b6e0 0x7f3ca01a7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.574+0000 7f3ca8400700 1 --2- 172.21.15.81:0/4190456989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0109b40 0x7f3ca019fab0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.574+0000 7f3ca8400700 1 --2- 172.21.15.81:0/4190456989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca010ad40 0x7f3ca019fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.574+0000 7f3ca8400700 1 -- 172.21.15.81:0/4190456989 >> 172.21.15.81:0/4190456989 conn(0x7f3ca0078b10 msgr2=0x7f3ca010e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.574+0000 7f3ca8400700 1 -- 172.21.15.81:0/4190456989 shutdown_connections 2024-05-03T16:48:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:38.575+0000 7f3ca8400700 1 -- 172.21.15.81:0/4190456989 wait complete. 2024-05-03T16:48:38.577 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 29 2024-05-03T16:48:39.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:38 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/4190456989' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-03T16:48:39.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:38 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/4190456989' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-03T16:48:39.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:38 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/4190456989' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-03T16:48:39.556 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-03T16:48:39.996 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:48:40.148 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:39 smithi081 ceph-mon[28640]: pgmap v518: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:40.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:39 smithi134 ceph-mon[31708]: pgmap v518: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:40.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:39 smithi146 ceph-mon[32357]: pgmap v518: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:42.133 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:41 smithi081 ceph-mon[28640]: pgmap v519: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:42.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:41 smithi134 ceph-mon[31708]: pgmap v519: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:42.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:41 smithi146 ceph-mon[32357]: pgmap v519: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:48:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.387+0000 7f5aeea00700 1 -- 172.21.15.81:0/2443846737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae8103430 msgr2=0x7f5ae8103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.387+0000 7f5aeea00700 1 --2- 172.21.15.81:0/2443846737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae8103430 0x7f5ae8103850 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00b0d0 tx=0x7f5adc00b3e0 comp rx=0 tx=0).stop 2024-05-03T16:48:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.387+0000 7f5aeea00700 1 -- 172.21.15.81:0/2443846737 shutdown_connections 2024-05-03T16:48:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.387+0000 7f5aeea00700 1 --2- 172.21.15.81:0/2443846737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ae8104fd0 0x7f5ae810b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.387+0000 7f5aeea00700 1 --2- 172.21.15.81:0/2443846737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae8103430 0x7f5ae8103850 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.387+0000 7f5aeea00700 1 --2- 172.21.15.81:0/2443846737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ae8104630 0x7f5ae8104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.387+0000 7f5aeea00700 1 -- 172.21.15.81:0/2443846737 >> 172.21.15.81:0/2443846737 conn(0x7f5ae80fe9d0 msgr2=0x7f5ae8100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.388+0000 7f5aeea00700 1 -- 172.21.15.81:0/2443846737 shutdown_connections 2024-05-03T16:48:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.388+0000 7f5aeea00700 1 -- 172.21.15.81:0/2443846737 wait complete. 2024-05-03T16:48:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.389+0000 7f5aeea00700 1 Processor -- start 2024-05-03T16:48:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.389+0000 7f5aeea00700 1 -- start start 2024-05-03T16:48:42.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.390+0000 7f5aeea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ae8103430 0x7f5ae8077240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:42.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.390+0000 7f5aeea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae8104630 0x7f5ae8075890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:42.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.390+0000 7f5aeea00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ae8104fd0 0x7f5ae8075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:42.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.390+0000 7f5aeea00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae810edd0 con 0x7f5ae8104630 2024-05-03T16:48:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.390+0000 7f5aeea00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae810ec50 con 0x7f5ae8103430 2024-05-03T16:48:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.390+0000 7f5aeea00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae810ef50 con 0x7f5ae8104fd0 2024-05-03T16:48:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.390+0000 7f5aecc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae8104630 0x7f5ae8075890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.390+0000 7f5aecc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae8104630 0x7f5ae8075890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35356/0 (socket says 172.21.15.81:35356) 2024-05-03T16:48:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.390+0000 7f5aecc00700 1 -- 172.21.15.81:0/3853674628 learned_addr learned my addr 172.21.15.81:0/3853674628 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.390+0000 7f5aed600700 1 --2- 172.21.15.81:0/3853674628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ae8103430 0x7f5ae8077240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.390+0000 7f5aee000700 1 --2- 172.21.15.81:0/3853674628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ae8104fd0 0x7f5ae8075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.390+0000 7f5aecc00700 1 -- 172.21.15.81:0/3853674628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ae8104fd0 msgr2=0x7f5ae8075dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.391+0000 7f5aecc00700 1 --2- 172.21.15.81:0/3853674628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ae8104fd0 0x7f5ae8075dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.391+0000 7f5aecc00700 1 -- 172.21.15.81:0/3853674628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ae8103430 msgr2=0x7f5ae8077240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.391+0000 7f5aecc00700 1 --2- 172.21.15.81:0/3853674628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ae8103430 0x7f5ae8077240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.391+0000 7f5aecc00700 1 -- 172.21.15.81:0/3853674628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ae8076680 con 0x7f5ae8104630 2024-05-03T16:48:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.391+0000 7f5aecc00700 1 --2- 172.21.15.81:0/3853674628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae8104630 0x7f5ae8075890 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400d980 tx=0x7f5ad400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.391+0000 7f5ae6000700 1 -- 172.21.15.81:0/3853674628 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4017070 con 0x7f5ae8104630 2024-05-03T16:48:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.391+0000 7f5ae6000700 1 -- 172.21.15.81:0/3853674628 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ad4004830 con 0x7f5ae8104630 2024-05-03T16:48:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.391+0000 7f5ae6000700 1 -- 172.21.15.81:0/3853674628 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad40053a0 con 0x7f5ae8104630 2024-05-03T16:48:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.391+0000 7f5aeea00700 1 -- 172.21.15.81:0/3853674628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ae81a3600 con 0x7f5ae8104630 2024-05-03T16:48:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.391+0000 7f5aeea00700 1 -- 172.21.15.81:0/3853674628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ae81a3ac0 con 0x7f5ae8104630 2024-05-03T16:48:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.393+0000 7f5aeea00700 1 -- 172.21.15.81:0/3853674628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ae806a190 con 0x7f5ae8104630 2024-05-03T16:48:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.395+0000 7f5ae6000700 1 -- 172.21.15.81:0/3853674628 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5ad40049e0 con 0x7f5ae8104630 2024-05-03T16:48:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.396+0000 7f5ae6000700 1 --2- 172.21.15.81:0/3853674628 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5ad00b2990 0x7f5ad00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.397+0000 7f5ae6000700 1 -- 172.21.15.81:0/3853674628 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f5ad40e26d0 con 0x7f5ae8104630 2024-05-03T16:48:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.397+0000 7f5aed600700 1 --2- 172.21.15.81:0/3853674628 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5ad00b2990 0x7f5ad00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.397+0000 7f5aed600700 1 --2- 172.21.15.81:0/3853674628 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5ad00b2990 0x7f5ad00b4e50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5adc009fd0 tx=0x7f5adc00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:42.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.401+0000 7f5ae6000700 1 -- 172.21.15.81:0/3853674628 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f5ad4020020 con 0x7f5ae8104630 2024-05-03T16:48:42.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.635+0000 7f5aeea00700 1 -- 172.21.15.81:0/3853674628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f5ae802e510 con 0x7f5ae8104630 2024-05-03T16:48:42.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.637+0000 7f5ae6000700 1 -- 172.21.15.81:0/3853674628 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v91) ==== 56+0+5691 (secure 0 0 0) 0x7f5ad40a9e80 con 0x7f5ae8104630 2024-05-03T16:48:42.640 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 91 2024-05-03T16:48:42.640 INFO:teuthology.orchestra.run.smithi081.stdout:fsid 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T16:48:42.640 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-05-03T16:32:56.440204+0000 2024-05-03T16:48:42.640 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-05-03T16:45:06.079032+0000 2024-05-03T16:48:42.640 INFO:teuthology.orchestra.run.smithi081.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-03T16:48:42.641 INFO:teuthology.orchestra.run.smithi081.stdout:crush_version 27 2024-05-03T16:48:42.641 INFO:teuthology.orchestra.run.smithi081.stdout:full_ratio 0.95 2024-05-03T16:48:42.641 INFO:teuthology.orchestra.run.smithi081.stdout:backfillfull_ratio 0.9 2024-05-03T16:48:42.641 INFO:teuthology.orchestra.run.smithi081.stdout:nearfull_ratio 0.85 2024-05-03T16:48:42.641 INFO:teuthology.orchestra.run.smithi081.stdout:require_min_compat_client luminous 2024-05-03T16:48:42.641 INFO:teuthology.orchestra.run.smithi081.stdout:min_compat_client luminous 2024-05-03T16:48:42.641 INFO:teuthology.orchestra.run.smithi081.stdout:require_osd_release squid 2024-05-03T16:48:42.641 INFO:teuthology.orchestra.run.smithi081.stdout:stretch_mode_enabled false 2024-05-03T16:48:42.641 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-03T16:48:42.641 INFO:teuthology.orchestra.run.smithi081.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-05-03T16:48:42.641 INFO:teuthology.orchestra.run.smithi081.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-05-03T16:48:42.641 INFO:teuthology.orchestra.run.smithi081.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 89 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-05-03T16:48:42.641 INFO:teuthology.orchestra.run.smithi081.stdout:max_osd 12 2024-05-03T16:48:42.641 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 up in weight 1 up_from 8 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6802/1639968055,v1:172.21.15.81:6803/1639968055] [v2:172.21.15.81:6804/1639968055,v1:172.21.15.81:6805/1639968055] exists,up 957b05dc-dfb9-4561-8800-b7ec0aba679d 2024-05-03T16:48:42.642 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 up in weight 1 up_from 13 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6800/1928503491,v1:172.21.15.134:6801/1928503491] [v2:172.21.15.134:6802/1928503491,v1:172.21.15.134:6803/1928503491] exists,up 3bb199cd-b4d0-4c67-b98f-2106336dd57b 2024-05-03T16:48:42.642 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 up in weight 1 up_from 18 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6800/1233108455,v1:172.21.15.146:6801/1233108455] [v2:172.21.15.146:6802/1233108455,v1:172.21.15.146:6803/1233108455] exists,up 79ec9995-50e8-4eaf-935a-39a479925734 2024-05-03T16:48:42.642 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 up in weight 1 up_from 26 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6810/4128709465,v1:172.21.15.81:6811/4128709465] [v2:172.21.15.81:6812/4128709465,v1:172.21.15.81:6813/4128709465] exists,up 2d38f4e7-73c3-4e70-9f87-d44da28db452 2024-05-03T16:48:42.642 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 up in weight 1 up_from 32 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6808/1498616220,v1:172.21.15.134:6809/1498616220] [v2:172.21.15.134:6810/1498616220,v1:172.21.15.134:6811/1498616220] exists,up 3837a136-a25b-4cb9-aa82-084b477c67d4 2024-05-03T16:48:42.642 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 up in weight 1 up_from 37 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6808/1276988922,v1:172.21.15.146:6809/1276988922] [v2:172.21.15.146:6810/1276988922,v1:172.21.15.146:6811/1276988922] exists,up 2e783d2e-c181-41a9-97de-f17705a201bd 2024-05-03T16:48:42.642 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 up in weight 1 up_from 43 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6818/3319125020,v1:172.21.15.81:6819/3319125020] [v2:172.21.15.81:6820/3319125020,v1:172.21.15.81:6821/3319125020] exists,up 6faebdbf-7820-42e5-b07c-15db11f278dd 2024-05-03T16:48:42.642 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 up in weight 1 up_from 48 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6816/3241993481,v1:172.21.15.134:6817/3241993481] [v2:172.21.15.134:6818/3241993481,v1:172.21.15.134:6819/3241993481] exists,up ec4b6b84-6c5f-4d07-a747-06610b2cd345 2024-05-03T16:48:42.642 INFO:teuthology.orchestra.run.smithi081.stdout:osd.8 up in weight 1 up_from 55 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6816/2423161684,v1:172.21.15.146:6817/2423161684] [v2:172.21.15.146:6818/2423161684,v1:172.21.15.146:6819/2423161684] exists,up 02b1b0fd-837c-4c29-bedb-54fa2ee7531d 2024-05-03T16:48:42.642 INFO:teuthology.orchestra.run.smithi081.stdout:osd.9 up in weight 1 up_from 61 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6826/873909886,v1:172.21.15.81:6827/873909886] [v2:172.21.15.81:6828/873909886,v1:172.21.15.81:6829/873909886] exists,up 46713a8e-743d-44d5-babe-c01d3179afcb 2024-05-03T16:48:42.642 INFO:teuthology.orchestra.run.smithi081.stdout:osd.10 up in weight 1 up_from 66 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6824/1183629038,v1:172.21.15.134:6825/1183629038] [v2:172.21.15.134:6826/1183629038,v1:172.21.15.134:6827/1183629038] exists,up 12fcae89-30af-436b-a513-3998303da93e 2024-05-03T16:48:42.642 INFO:teuthology.orchestra.run.smithi081.stdout:osd.11 up in weight 1 up_from 72 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6824/2627233639,v1:172.21.15.146:6825/2627233639] [v2:172.21.15.146:6826/2627233639,v1:172.21.15.146:6827/2627233639] exists,up a543f42c-61da-4a93-b16b-a2891a4ef873 2024-05-03T16:48:42.643 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 2.0 [7,11] 2024-05-03T16:48:42.643 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 2.13 [2,11] 2024-05-03T16:48:42.643 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 2.1a [8,4] 2024-05-03T16:48:42.643 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 2.1b [2,1] 2024-05-03T16:48:42.643 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 2.1f [8,4] 2024-05-03T16:48:42.643 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 3.1d [5,9] 2024-05-03T16:48:42.643 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 3.1e [3,9] 2024-05-03T16:48:42.643 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 3.31 [4,8] 2024-05-03T16:48:42.643 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 3.34 [4,9] 2024-05-03T16:48:42.643 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 4.e [5,8] 2024-05-03T16:48:42.643 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 4.f [9,8] 2024-05-03T16:48:42.643 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 4.12 [9,10] 2024-05-03T16:48:42.643 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 4.14 [9,8] 2024-05-03T16:48:42.643 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6801/2734678359 expires 2024-05-04T16:34:04.089390+0000 2024-05-03T16:48:42.643 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6800/2734678359 expires 2024-05-04T16:34:04.089390+0000 2024-05-03T16:48:42.644 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/2237510960 expires 2024-05-04T16:34:04.089390+0000 2024-05-03T16:48:42.644 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6801/2256692598 expires 2024-05-04T16:33:30.274051+0000 2024-05-03T16:48:42.644 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/3199433706 expires 2024-05-04T16:33:30.274051+0000 2024-05-03T16:48:42.644 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/1689714816 expires 2024-05-04T16:33:30.274051+0000 2024-05-03T16:48:42.644 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/2777950369 expires 2024-05-04T16:34:04.089390+0000 2024-05-03T16:48:42.644 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/1982866220 expires 2024-05-04T16:34:04.089390+0000 2024-05-03T16:48:42.644 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6800/2256692598 expires 2024-05-04T16:33:30.274051+0000 2024-05-03T16:48:42.644 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/1112375028 expires 2024-05-04T16:33:30.274051+0000 2024-05-03T16:48:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.640+0000 7f5aeea00700 1 -- 172.21.15.81:0/3853674628 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5ad00b2990 msgr2=0x7f5ad00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.641+0000 7f5aeea00700 1 --2- 172.21.15.81:0/3853674628 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5ad00b2990 0x7f5ad00b4e50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5adc009fd0 tx=0x7f5adc00b040 comp rx=0 tx=0).stop 2024-05-03T16:48:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.641+0000 7f5aeea00700 1 -- 172.21.15.81:0/3853674628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae8104630 msgr2=0x7f5ae8075890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.641+0000 7f5aeea00700 1 --2- 172.21.15.81:0/3853674628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae8104630 0x7f5ae8075890 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400d980 tx=0x7f5ad400dd40 comp rx=0 tx=0).stop 2024-05-03T16:48:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.641+0000 7f5aeea00700 1 -- 172.21.15.81:0/3853674628 shutdown_connections 2024-05-03T16:48:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.641+0000 7f5aeea00700 1 --2- 172.21.15.81:0/3853674628 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5ad00b2990 0x7f5ad00b4e50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.641+0000 7f5aeea00700 1 --2- 172.21.15.81:0/3853674628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ae8104fd0 0x7f5ae8075dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.641+0000 7f5aeea00700 1 --2- 172.21.15.81:0/3853674628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ae8103430 0x7f5ae8077240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.641+0000 7f5aeea00700 1 --2- 172.21.15.81:0/3853674628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae8104630 0x7f5ae8075890 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.641+0000 7f5aeea00700 1 -- 172.21.15.81:0/3853674628 >> 172.21.15.81:0/3853674628 conn(0x7f5ae80fe9d0 msgr2=0x7f5ae81079a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:42.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.641+0000 7f5aeea00700 1 -- 172.21.15.81:0/3853674628 shutdown_connections 2024-05-03T16:48:42.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:42.641+0000 7f5aeea00700 1 -- 172.21.15.81:0/3853674628 wait complete. 2024-05-03T16:48:42.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:42 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3853674628' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-03T16:48:43.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:42 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3853674628' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-03T16:48:43.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:42 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3853674628' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-03T16:48:43.517 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-03T16:48:43.532 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T16:48:43.983 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:48:44.138 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:43 smithi081 ceph-mon[28640]: pgmap v520: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T16:48:44.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:43 smithi134 ceph-mon[31708]: pgmap v520: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T16:48:44.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:43 smithi146 ceph-mon[32357]: pgmap v520: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T16:48:46.132 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:45 smithi081 ceph-mon[28640]: pgmap v521: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:48:46.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:45 smithi134 ceph-mon[31708]: pgmap v521: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:48:46.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:45 smithi146 ceph-mon[32357]: pgmap v521: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:48:46.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.425+0000 7fd119000700 1 -- 172.21.15.81:0/1844583307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11410b680 msgr2=0x7fd11410ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:46.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.425+0000 7fd119000700 1 --2- 172.21.15.81:0/1844583307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11410b680 0x7fd11410ba60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd1040099c0 tx=0x7fd104009cd0 comp rx=0 tx=0).stop 2024-05-03T16:48:46.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.425+0000 7fd119000700 1 -- 172.21.15.81:0/1844583307 shutdown_connections 2024-05-03T16:48:46.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.425+0000 7fd119000700 1 --2- 172.21.15.81:0/1844583307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd114105f90 0x7fd114112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:46.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.425+0000 7fd119000700 1 --2- 172.21.15.81:0/1844583307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11410b680 0x7fd11410ba60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:46.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.425+0000 7fd119000700 1 --2- 172.21.15.81:0/1844583307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1141055d0 0x7fd114105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:46.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.425+0000 7fd119000700 1 -- 172.21.15.81:0/1844583307 >> 172.21.15.81:0/1844583307 conn(0x7fd1141010e0 msgr2=0x7fd114103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.425+0000 7fd119000700 1 -- 172.21.15.81:0/1844583307 shutdown_connections 2024-05-03T16:48:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.425+0000 7fd119000700 1 -- 172.21.15.81:0/1844583307 wait complete. 2024-05-03T16:48:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.426+0000 7fd119000700 1 Processor -- start 2024-05-03T16:48:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.427+0000 7fd119000700 1 -- start start 2024-05-03T16:48:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.427+0000 7fd119000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1141055d0 0x7fd1141a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.427+0000 7fd119000700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd114105f90 0x7fd1141a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.427+0000 7fd119000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11410b680 0x7fd11419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.427+0000 7fd119000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd114115630 con 0x7fd11410b680 2024-05-03T16:48:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.427+0000 7fd119000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd1141154b0 con 0x7fd1141055d0 2024-05-03T16:48:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.427+0000 7fd119000700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd1141157b0 con 0x7fd114105f90 2024-05-03T16:48:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.427+0000 7fd113e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11410b680 0x7fd11419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.428+0000 7fd113e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11410b680 0x7fd11419b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45072/0 (socket says 172.21.15.81:45072) 2024-05-03T16:48:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.428+0000 7fd113e00700 1 -- 172.21.15.81:0/2833219959 learned_addr learned my addr 172.21.15.81:0/2833219959 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.428+0000 7fd112a00700 1 --2- 172.21.15.81:0/2833219959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd114105f90 0x7fd1141a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.428+0000 7fd113400700 1 --2- 172.21.15.81:0/2833219959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1141055d0 0x7fd1141a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.428+0000 7fd113e00700 1 -- 172.21.15.81:0/2833219959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd114105f90 msgr2=0x7fd1141a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.428+0000 7fd113e00700 1 --2- 172.21.15.81:0/2833219959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd114105f90 0x7fd1141a1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.428+0000 7fd113e00700 1 -- 172.21.15.81:0/2833219959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1141055d0 msgr2=0x7fd1141a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.428+0000 7fd113e00700 1 --2- 172.21.15.81:0/2833219959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1141055d0 0x7fd1141a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:46.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.428+0000 7fd113e00700 1 -- 172.21.15.81:0/2833219959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11419bfd0 con 0x7fd11410b680 2024-05-03T16:48:46.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.428+0000 7fd112a00700 1 --2- 172.21.15.81:0/2833219959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd114105f90 0x7fd1141a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:48:46.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.428+0000 7fd113e00700 1 --2- 172.21.15.81:0/2833219959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11410b680 0x7fd11419b870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd10c007d70 tx=0x7fd10c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:46.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.429+0000 7fd10be00700 1 -- 172.21.15.81:0/2833219959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c016020 con 0x7fd11410b680 2024-05-03T16:48:46.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.429+0000 7fd10be00700 1 -- 172.21.15.81:0/2833219959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd10c00ad40 con 0x7fd11410b680 2024-05-03T16:48:46.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.429+0000 7fd119000700 1 -- 172.21.15.81:0/2833219959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd11419c2c0 con 0x7fd11410b680 2024-05-03T16:48:46.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.429+0000 7fd10be00700 1 -- 172.21.15.81:0/2833219959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c0115e0 con 0x7fd11410b680 2024-05-03T16:48:46.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.429+0000 7fd119000700 1 -- 172.21.15.81:0/2833219959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1141a8580 con 0x7fd11410b680 2024-05-03T16:48:46.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.430+0000 7fd119000700 1 -- 172.21.15.81:0/2833219959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd11410db10 con 0x7fd11410b680 2024-05-03T16:48:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.432+0000 7fd10be00700 1 -- 172.21.15.81:0/2833219959 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd10c019020 con 0x7fd11410b680 2024-05-03T16:48:46.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.434+0000 7fd10be00700 1 --2- 172.21.15.81:0/2833219959 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd0f80b2910 0x7fd0f80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:46.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.434+0000 7fd10be00700 1 -- 172.21.15.81:0/2833219959 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fd10c0e2610 con 0x7fd11410b680 2024-05-03T16:48:46.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.434+0000 7fd113400700 1 --2- 172.21.15.81:0/2833219959 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd0f80b2910 0x7fd0f80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:46.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.435+0000 7fd113400700 1 --2- 172.21.15.81:0/2833219959 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd0f80b2910 0x7fd0f80b4dd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd104009990 tx=0x7fd10401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:46.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.439+0000 7fd10be00700 1 -- 172.21.15.81:0/2833219959 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd10c020020 con 0x7fd11410b680 2024-05-03T16:48:46.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.723+0000 7fd119000700 1 -- 172.21.15.81:0/2833219959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd11419cda0 con 0x7fd11410b680 2024-05-03T16:48:46.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.725+0000 7fd10be00700 1 -- 172.21.15.81:0/2833219959 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7fd10c0a9f30 con 0x7fd11410b680 2024-05-03T16:48:46.728 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:48:46.728 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/886382058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":886382058},{"type":"v1","addr":"172.21.15.81:6835","nonce":886382058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3285208793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3285208793},{"type":"v1","addr":"172.21.15.81:6837","nonce":3285208793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T16:43:58.734681+0000","modified":"2024-05-03T16:45:31.547191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34466,"mds_1":34439,"mds_2":34418,"mds_3":34400,"mds_4":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3710454674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3710454674},{"type":"v1","addr":"172.21.15.81:6839","nonce":3710454674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1174252889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1174252889},{"type":"v1","addr":"172.21.15.81:6841","nonce":1174252889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1900581381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1900581381},{"type":"v1","addr":"172.21.15.146:6833","nonce":1900581381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/3514751933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3514751933},{"type":"v1","addr":"172.21.15.146:6835","nonce":3514751933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6837/971814714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":971814714},{"type":"v1","addr":"172.21.15.146:6837","nonce":971814714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":32,"addr":"172.21.15.146:6839/3770312555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":3770312555},{"type":"v1","addr":"172.21.15.146:6839","nonce":3770312555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34400":{"gid":34400,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.134:6833/749392804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":749392804},{"type":"v1","addr":"172.21.15.134:6833","nonce":749392804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34418":{"gid":34418,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.134:6835/3681203129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3681203129},{"type":"v1","addr":"172.21.15.134:6835","nonce":3681203129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34439":{"gid":34439,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.134:6837/2915415754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2915415754},{"type":"v1","addr":"172.21.15.134:6837","nonce":2915415754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34466":{"gid":34466,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2061491127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2061491127},{"type":"v1","addr":"172.21.15.134:6839","nonce":2061491127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34466,"qdb_cluster":[24481,34400,34466,34439,34418]},"id":1}]} 2024-05-03T16:48:46.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.729+0000 7fd119000700 1 -- 172.21.15.81:0/2833219959 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd0f80b2910 msgr2=0x7fd0f80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:46.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.729+0000 7fd119000700 1 --2- 172.21.15.81:0/2833219959 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd0f80b2910 0x7fd0f80b4dd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd104009990 tx=0x7fd10401a040 comp rx=0 tx=0).stop 2024-05-03T16:48:46.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.729+0000 7fd119000700 1 -- 172.21.15.81:0/2833219959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11410b680 msgr2=0x7fd11419b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:46.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.729+0000 7fd119000700 1 --2- 172.21.15.81:0/2833219959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11410b680 0x7fd11419b870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd10c007d70 tx=0x7fd10c00a340 comp rx=0 tx=0).stop 2024-05-03T16:48:46.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.729+0000 7fd119000700 1 -- 172.21.15.81:0/2833219959 shutdown_connections 2024-05-03T16:48:46.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.729+0000 7fd119000700 1 --2- 172.21.15.81:0/2833219959 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fd0f80b2910 0x7fd0f80b4dd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:46.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.729+0000 7fd119000700 1 --2- 172.21.15.81:0/2833219959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11410b680 0x7fd11419b870 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:46.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.730+0000 7fd119000700 1 --2- 172.21.15.81:0/2833219959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1141055d0 0x7fd1141a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:46.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.730+0000 7fd119000700 1 --2- 172.21.15.81:0/2833219959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd114105f90 0x7fd1141a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:46.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.730+0000 7fd119000700 1 -- 172.21.15.81:0/2833219959 >> 172.21.15.81:0/2833219959 conn(0x7fd1141010e0 msgr2=0x7fd1141026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:46.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.730+0000 7fd119000700 1 -- 172.21.15.81:0/2833219959 shutdown_connections 2024-05-03T16:48:46.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:46.730+0000 7fd119000700 1 -- 172.21.15.81:0/2833219959 wait complete. 2024-05-03T16:48:46.734 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 29 2024-05-03T16:48:46.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:46 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2833219959' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:48:47.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:46 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2833219959' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:48:47.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:46 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2833219959' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:48:47.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T16:48:48.139 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:48:48.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:47 smithi134 ceph-mon[31708]: pgmap v522: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-05-03T16:48:48.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:47 smithi081 ceph-mon[28640]: pgmap v522: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-05-03T16:48:48.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:47 smithi146 ceph-mon[32357]: pgmap v522: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-05-03T16:48:50.170 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:49 smithi081 ceph-mon[28640]: pgmap v523: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-05-03T16:48:50.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:49 smithi134 ceph-mon[31708]: pgmap v523: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-05-03T16:48:50.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:49 smithi146 ceph-mon[32357]: pgmap v523: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-05-03T16:48:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.494+0000 7ff823e00700 1 -- 172.21.15.81:0/2251880582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff824104600 msgr2=0x7ff8241049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.494+0000 7ff823e00700 1 --2- 172.21.15.81:0/2251880582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff824104600 0x7ff8241049e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff814009990 tx=0x7ff814009ca0 comp rx=0 tx=0).stop 2024-05-03T16:48:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.494+0000 7ff823e00700 1 -- 172.21.15.81:0/2251880582 shutdown_connections 2024-05-03T16:48:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.494+0000 7ff823e00700 1 --2- 172.21.15.81:0/2251880582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff82410da30 0x7ff82410fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.494+0000 7ff823e00700 1 --2- 172.21.15.81:0/2251880582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff824104600 0x7ff8241049e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.494+0000 7ff823e00700 1 --2- 172.21.15.81:0/2251880582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff824104f20 0x7ff82410d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.494+0000 7ff823e00700 1 -- 172.21.15.81:0/2251880582 >> 172.21.15.81:0/2251880582 conn(0x7ff8240fde50 msgr2=0x7ff824100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.494+0000 7ff823e00700 1 -- 172.21.15.81:0/2251880582 shutdown_connections 2024-05-03T16:48:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.494+0000 7ff823e00700 1 -- 172.21.15.81:0/2251880582 wait complete. 2024-05-03T16:48:50.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.496+0000 7ff823e00700 1 Processor -- start 2024-05-03T16:48:50.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.496+0000 7ff823e00700 1 -- start start 2024-05-03T16:48:50.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.496+0000 7ff823e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff824104600 0x7ff82419f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:50.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.496+0000 7ff823e00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff824104f20 0x7ff82419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:50.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.496+0000 7ff823e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff82410da30 0x7ff8241998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:50.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.496+0000 7ff823e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff824113520 con 0x7ff82410da30 2024-05-03T16:48:50.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.496+0000 7ff823e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff8241133a0 con 0x7ff824104600 2024-05-03T16:48:50.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.496+0000 7ff823e00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff8241136a0 con 0x7ff824104f20 2024-05-03T16:48:50.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.497+0000 7ff823400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff82410da30 0x7ff8241998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:50.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.497+0000 7ff823400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff82410da30 0x7ff8241998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45096/0 (socket says 172.21.15.81:45096) 2024-05-03T16:48:50.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.497+0000 7ff823400700 1 -- 172.21.15.81:0/3852173750 learned_addr learned my addr 172.21.15.81:0/3852173750 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:50.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.497+0000 7ff822000700 1 --2- 172.21.15.81:0/3852173750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff824104f20 0x7ff82419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:50.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.497+0000 7ff822a00700 1 --2- 172.21.15.81:0/3852173750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff824104600 0x7ff82419f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:50.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.497+0000 7ff823400700 1 -- 172.21.15.81:0/3852173750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff824104f20 msgr2=0x7ff82419fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:50.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.497+0000 7ff823400700 1 --2- 172.21.15.81:0/3852173750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff824104f20 0x7ff82419fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:50.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.497+0000 7ff823400700 1 -- 172.21.15.81:0/3852173750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff824104600 msgr2=0x7ff82419f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:50.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.497+0000 7ff823400700 1 --2- 172.21.15.81:0/3852173750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff824104600 0x7ff82419f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:50.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.497+0000 7ff823400700 1 -- 172.21.15.81:0/3852173750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff82419a080 con 0x7ff82410da30 2024-05-03T16:48:50.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.497+0000 7ff822000700 1 --2- 172.21.15.81:0/3852173750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff824104f20 0x7ff82419fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:48:50.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.498+0000 7ff823400700 1 --2- 172.21.15.81:0/3852173750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff82410da30 0x7ff8241998a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00ada0 tx=0x7ff81c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:50.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.498+0000 7ff81b400700 1 -- 172.21.15.81:0/3852173750 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81c017020 con 0x7ff82410da30 2024-05-03T16:48:50.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.498+0000 7ff81b400700 1 -- 172.21.15.81:0/3852173750 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff81c00ce10 con 0x7ff82410da30 2024-05-03T16:48:50.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.498+0000 7ff823e00700 1 -- 172.21.15.81:0/3852173750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff82419a370 con 0x7ff82410da30 2024-05-03T16:48:50.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.498+0000 7ff81b400700 1 -- 172.21.15.81:0/3852173750 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81c005280 con 0x7ff82410da30 2024-05-03T16:48:50.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.498+0000 7ff823e00700 1 -- 172.21.15.81:0/3852173750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff824102190 con 0x7ff82410da30 2024-05-03T16:48:50.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.499+0000 7ff823e00700 1 -- 172.21.15.81:0/3852173750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff82406c2f0 con 0x7ff82410da30 2024-05-03T16:48:50.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.502+0000 7ff81b400700 1 -- 172.21.15.81:0/3852173750 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff81c00c980 con 0x7ff82410da30 2024-05-03T16:48:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.503+0000 7ff81b400700 1 --2- 172.21.15.81:0/3852173750 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff8080b2990 0x7ff8080b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.504+0000 7ff81b400700 1 -- 172.21.15.81:0/3852173750 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7ff81c0e1e00 con 0x7ff82410da30 2024-05-03T16:48:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.504+0000 7ff822a00700 1 --2- 172.21.15.81:0/3852173750 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff8080b2990 0x7ff8080b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.504+0000 7ff822a00700 1 --2- 172.21.15.81:0/3852173750 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff8080b2990 0x7ff8080b4e50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff814003760 tx=0x7ff81400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:50.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.508+0000 7ff81b400700 1 -- 172.21.15.81:0/3852173750 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff81c021020 con 0x7ff82410da30 2024-05-03T16:48:50.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.791+0000 7ff823e00700 1 -- 172.21.15.81:0/3852173750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff82402e510 con 0x7ff82410da30 2024-05-03T16:48:50.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.792+0000 7ff81b400700 1 -- 172.21.15.81:0/3852173750 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7ff81c0a9640 con 0x7ff82410da30 2024-05-03T16:48:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:48:50.795 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/886382058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":886382058},{"type":"v1","addr":"172.21.15.81:6835","nonce":886382058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3285208793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3285208793},{"type":"v1","addr":"172.21.15.81:6837","nonce":3285208793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T16:43:58.734681+0000","modified":"2024-05-03T16:45:31.547191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34466,"mds_1":34439,"mds_2":34418,"mds_3":34400,"mds_4":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3710454674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3710454674},{"type":"v1","addr":"172.21.15.81:6839","nonce":3710454674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1174252889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1174252889},{"type":"v1","addr":"172.21.15.81:6841","nonce":1174252889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1900581381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1900581381},{"type":"v1","addr":"172.21.15.146:6833","nonce":1900581381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/3514751933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3514751933},{"type":"v1","addr":"172.21.15.146:6835","nonce":3514751933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6837/971814714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":971814714},{"type":"v1","addr":"172.21.15.146:6837","nonce":971814714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":32,"addr":"172.21.15.146:6839/3770312555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":3770312555},{"type":"v1","addr":"172.21.15.146:6839","nonce":3770312555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34400":{"gid":34400,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.134:6833/749392804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":749392804},{"type":"v1","addr":"172.21.15.134:6833","nonce":749392804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34418":{"gid":34418,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.134:6835/3681203129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3681203129},{"type":"v1","addr":"172.21.15.134:6835","nonce":3681203129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34439":{"gid":34439,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.134:6837/2915415754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2915415754},{"type":"v1","addr":"172.21.15.134:6837","nonce":2915415754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34466":{"gid":34466,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2061491127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2061491127},{"type":"v1","addr":"172.21.15.134:6839","nonce":2061491127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34466,"qdb_cluster":[24481,34400,34466,34439,34418]},"id":1}]} 2024-05-03T16:48:50.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.795+0000 7ff823e00700 1 -- 172.21.15.81:0/3852173750 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff8080b2990 msgr2=0x7ff8080b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:50.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.795+0000 7ff823e00700 1 --2- 172.21.15.81:0/3852173750 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff8080b2990 0x7ff8080b4e50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff814003760 tx=0x7ff81400b540 comp rx=0 tx=0).stop 2024-05-03T16:48:50.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.795+0000 7ff823e00700 1 -- 172.21.15.81:0/3852173750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff82410da30 msgr2=0x7ff8241998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:50.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.795+0000 7ff823e00700 1 --2- 172.21.15.81:0/3852173750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff82410da30 0x7ff8241998a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00ada0 tx=0x7ff81c00c330 comp rx=0 tx=0).stop 2024-05-03T16:48:50.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.795+0000 7ff823e00700 1 -- 172.21.15.81:0/3852173750 shutdown_connections 2024-05-03T16:48:50.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.795+0000 7ff823e00700 1 --2- 172.21.15.81:0/3852173750 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff8080b2990 0x7ff8080b4e50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:50.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.795+0000 7ff823e00700 1 --2- 172.21.15.81:0/3852173750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff82410da30 0x7ff8241998a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:50.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.795+0000 7ff823e00700 1 --2- 172.21.15.81:0/3852173750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff824104600 0x7ff82419f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:50.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.795+0000 7ff823e00700 1 --2- 172.21.15.81:0/3852173750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff824104f20 0x7ff82419fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:50.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.795+0000 7ff823e00700 1 -- 172.21.15.81:0/3852173750 >> 172.21.15.81:0/3852173750 conn(0x7ff8240fde50 msgr2=0x7ff8240feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:50.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.796+0000 7ff823e00700 1 -- 172.21.15.81:0/3852173750 shutdown_connections 2024-05-03T16:48:50.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:50.796+0000 7ff823e00700 1 -- 172.21.15.81:0/3852173750 wait complete. 2024-05-03T16:48:50.799 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 29 2024-05-03T16:48:51.161 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:50 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3852173750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:48:51.213 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:50 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3852173750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:48:51.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:50 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3852173750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T16:48:51.703 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T16:48:52.149 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:48:52.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:51 smithi134 ceph-mon[31708]: pgmap v524: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-05-03T16:48:52.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:51 smithi081 ceph-mon[28640]: pgmap v524: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-05-03T16:48:52.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:51 smithi146 ceph-mon[32357]: pgmap v524: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-05-03T16:48:53.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:53 smithi081 ceph-mon[28640]: pgmap v525: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-03T16:48:54.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:53 smithi134 ceph-mon[31708]: pgmap v525: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-03T16:48:54.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:53 smithi146 ceph-mon[32357]: pgmap v525: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-03T16:48:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.626+0000 7f5a34a00700 1 -- 172.21.15.81:0/3655353312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30075ff0 msgr2=0x7f5a3010f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.626+0000 7f5a34a00700 1 --2- 172.21.15.81:0/3655353312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30075ff0 0x7f5a3010f960 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5a18009990 tx=0x7f5a18009ca0 comp rx=0 tx=0).stop 2024-05-03T16:48:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.627+0000 7f5a34a00700 1 -- 172.21.15.81:0/3655353312 shutdown_connections 2024-05-03T16:48:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.627+0000 7f5a34a00700 1 --2- 172.21.15.81:0/3655353312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a300756d0 0x7f5a30075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.627+0000 7f5a34a00700 1 --2- 172.21.15.81:0/3655353312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a3010fea0 0x7f5a30112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.627+0000 7f5a34a00700 1 --2- 172.21.15.81:0/3655353312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30075ff0 0x7f5a3010f960 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.627+0000 7f5a34a00700 1 -- 172.21.15.81:0/3655353312 >> 172.21.15.81:0/3655353312 conn(0x7f5a3007a600 msgr2=0x7f5a3007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.627+0000 7f5a34a00700 1 -- 172.21.15.81:0/3655353312 shutdown_connections 2024-05-03T16:48:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.627+0000 7f5a34a00700 1 -- 172.21.15.81:0/3655353312 wait complete. 2024-05-03T16:48:54.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.628+0000 7f5a34a00700 1 Processor -- start 2024-05-03T16:48:54.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.628+0000 7f5a34a00700 1 -- start start 2024-05-03T16:48:54.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.628+0000 7f5a34a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a300756d0 0x7f5a301a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:54.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.628+0000 7f5a34a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30075ff0 0x7f5a301a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:54.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.628+0000 7f5a34a00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3010fea0 0x7f5a3019bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:54.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.628+0000 7f5a34a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5a30115720 con 0x7f5a30075ff0 2024-05-03T16:48:54.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.628+0000 7f5a34a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a301155a0 con 0x7f5a300756d0 2024-05-03T16:48:54.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.628+0000 7f5a34a00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5a301158a0 con 0x7f5a3010fea0 2024-05-03T16:48:54.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.629+0000 7f5a25400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30075ff0 0x7f5a301a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:54.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.629+0000 7f5a25400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30075ff0 0x7f5a301a1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45114/0 (socket says 172.21.15.81:45114) 2024-05-03T16:48:54.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.629+0000 7f5a25400700 1 -- 172.21.15.81:0/3830307361 learned_addr learned my addr 172.21.15.81:0/3830307361 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:54.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.629+0000 7f5a2de00700 1 --2- 172.21.15.81:0/3830307361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a300756d0 0x7f5a301a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:54.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.629+0000 7f5a2e800700 1 --2- 172.21.15.81:0/3830307361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3010fea0 0x7f5a3019bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:54.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.629+0000 7f5a25400700 1 -- 172.21.15.81:0/3830307361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3010fea0 msgr2=0x7f5a3019bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:54.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.629+0000 7f5a25400700 1 --2- 172.21.15.81:0/3830307361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3010fea0 0x7f5a3019bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:54.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.629+0000 7f5a25400700 1 -- 172.21.15.81:0/3830307361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a300756d0 msgr2=0x7f5a301a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:54.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.629+0000 7f5a25400700 1 --2- 172.21.15.81:0/3830307361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a300756d0 0x7f5a301a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:54.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.629+0000 7f5a25400700 1 -- 172.21.15.81:0/3830307361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3019c260 con 0x7f5a30075ff0 2024-05-03T16:48:54.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.629+0000 7f5a25400700 1 --2- 172.21.15.81:0/3830307361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30075ff0 0x7f5a301a1e80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5a18000c00 tx=0x7f5a180047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:54.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.630+0000 7f5a27400700 1 -- 172.21.15.81:0/3830307361 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a18027070 con 0x7f5a30075ff0 2024-05-03T16:48:54.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.630+0000 7f5a27400700 1 -- 172.21.15.81:0/3830307361 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a1800fb80 con 0x7f5a30075ff0 2024-05-03T16:48:54.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.630+0000 7f5a34a00700 1 -- 172.21.15.81:0/3830307361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3019c4f0 con 0x7f5a30075ff0 2024-05-03T16:48:54.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.630+0000 7f5a27400700 1 -- 172.21.15.81:0/3830307361 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a18022d00 con 0x7f5a30075ff0 2024-05-03T16:48:54.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.630+0000 7f5a34a00700 1 -- 172.21.15.81:0/3830307361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a301a8810 con 0x7f5a30075ff0 2024-05-03T16:48:54.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.631+0000 7f5a34a00700 1 -- 172.21.15.81:0/3830307361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a3006a190 con 0x7f5a30075ff0 2024-05-03T16:48:54.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.633+0000 7f5a27400700 1 -- 172.21.15.81:0/3830307361 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5a1802a070 con 0x7f5a30075ff0 2024-05-03T16:48:54.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.635+0000 7f5a27400700 1 --2- 172.21.15.81:0/3830307361 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5a140b2990 0x7f5a140b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:54.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.635+0000 7f5a27400700 1 -- 172.21.15.81:0/3830307361 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f5a180e39c0 con 0x7f5a30075ff0 2024-05-03T16:48:54.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.635+0000 7f5a2de00700 1 --2- 172.21.15.81:0/3830307361 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5a140b2990 0x7f5a140b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:54.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.636+0000 7f5a2de00700 1 --2- 172.21.15.81:0/3830307361 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5a140b2990 0x7f5a140b4e50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5a20004630 tx=0x7f5a2000b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:54.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.637+0000 7f5a27400700 1 -- 172.21.15.81:0/3830307361 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f5a18031070 con 0x7f5a30075ff0 2024-05-03T16:48:54.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.869+0000 7f5a34a00700 1 -- 172.21.15.81:0/3830307361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a3002e510 con 0x7f5a30075ff0 2024-05-03T16:48:54.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.873+0000 7f5a27400700 1 -- 172.21.15.81:0/3830307361 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24767 (secure 0 0 0) 0x7f5a18013070 con 0x7f5a30075ff0 2024-05-03T16:48:54.876 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T16:48:54.876 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":91,"fsid":"8988869e-096a-11ef-bc97-c7b262605968","created":"2024-05-03T16:32:56.440204+0000","modified":"2024-05-03T16:45:06.079032+0000","last_up_change":"2024-05-03T16:42:31.768974+0000","last_in_change":"2024-05-03T16:42:06.989688+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T16:37:18.271939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T16:43:50.469793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T16:43:54.708564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T16:44:09.064474+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"957b05dc-dfb9-4561-8800-b7ec0aba679d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6803","nonce":1639968055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6805","nonce":1639968055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6809","nonce":1639968055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6807","nonce":1639968055}]},"public_addr":"172.21.15.81:6803/1639968055","cluster_addr":"172.21.15.81:6805/1639968055","heartbeat_back_addr":"172.21.15.81:6809/1639968055","heartbeat_front_addr":"172.21.15.81:6807/1639968055","state":["exists","up"]},{"osd":1,"uuid":"3bb199cd-b4d0-4c67-b98f-2106336dd57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6801","nonce":1928503491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6803","nonce":1928503491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6807","nonce":1928503491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6805","nonce":1928503491}]},"public_addr":"172.21.15.134:6801/1928503491","cluster_addr":"172.21.15.134:6803/1928503491","heartbeat_back_addr":"172.21.15.134:6807/1928503491","heartbeat_front_addr":"172.21.15.134:6805/1928503491","state":["exists","up"]},{"osd":2,"uuid":"79ec9995-50e8-4eaf-935a-39a479925734","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6801","nonce":1233108455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6803","nonce":1233108455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6807","nonce":1233108455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6805","nonce":1233108455}]},"public_addr":"172.21.15.146:6801/1233108455","cluster_addr":"172.21.15.146:6803/1233108455","heartbeat_back_addr":"172.21.15.146:6807/1233108455","heartbeat_front_addr":"172.21.15.146:6805/1233108455","state":["exists","up"]},{"osd":3,"uuid":"2d38f4e7-73c3-4e70-9f87-d44da28db452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6811","nonce":4128709465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6813","nonce":4128709465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6817","nonce":4128709465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6815","nonce":4128709465}]},"public_addr":"172.21.15.81:6811/4128709465","cluster_addr":"172.21.15.81:6813/4128709465","heartbeat_back_addr":"172.21.15.81:6817/4128709465","heartbeat_front_addr":"172.21.15.81:6815/4128709465","state":["exists","up"]},{"osd":4,"uuid":"3837a136-a25b-4cb9-aa82-084b477c67d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6809","nonce":1498616220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6811","nonce":1498616220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6815","nonce":1498616220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6813","nonce":1498616220}]},"public_addr":"172.21.15.134:6809/1498616220","cluster_addr":"172.21.15.134:6811/1498616220","heartbeat_back_addr":"172.21.15.134:6815/1498616220","heartbeat_front_addr":"172.21.15.134:6813/1498616220","state":["exists","up"]},{"osd":5,"uuid":"2e783d2e-c181-41a9-97de-f17705a201bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6809","nonce":1276988922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6811","nonce":1276988922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6815","nonce":1276988922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6813","nonce":1276988922}]},"public_addr":"172.21.15.146:6809/1276988922","cluster_addr":"172.21.15.146:6811/1276988922","heartbeat_back_addr":"172.21.15.146:6815/1276988922","heartbeat_front_addr":"172.21.15.146:6813/1276988922","state":["exists","up"]},{"osd":6,"uuid":"6faebdbf-7820-42e5-b07c-15db11f278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6819","nonce":3319125020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6821","nonce":3319125020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6825","nonce":3319125020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6823","nonce":3319125020}]},"public_addr":"172.21.15.81:6819/3319125020","cluster_addr":"172.21.15.81:6821/3319125020","heartbeat_back_addr":"172.21.15.81:6825/3319125020","heartbeat_front_addr":"172.21.15.81:6823/3319125020","state":["exists","up"]},{"osd":7,"uuid":"ec4b6b84-6c5f-4d07-a747-06610b2cd345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6817","nonce":3241993481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6819","nonce":3241993481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6823","nonce":3241993481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6821","nonce":3241993481}]},"public_addr":"172.21.15.134:6817/3241993481","cluster_addr":"172.21.15.134:6819/3241993481","heartbeat_back_addr":"172.21.15.134:6823/3241993481","heartbeat_front_addr":"172.21.15.134:6821/3241993481","state":["exists","up"]},{"osd":8,"uuid":"02b1b0fd-837c-4c29-bedb-54fa2ee7531d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6817","nonce":2423161684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6819","nonce":2423161684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6823","nonce":2423161684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6821","nonce":2423161684}]},"public_addr":"172.21.15.146:6817/2423161684","cluster_addr":"172.21.15.146:6819/2423161684","heartbeat_back_addr":"172.21.15.146:6823/2423161684","heartbeat_front_addr":"172.21.15.146:6821/2423161684","state":["exists","up"]},{"osd":9,"uuid":"46713a8e-743d-44d5-babe-c01d3179afcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6827","nonce":873909886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6829","nonce":873909886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6833","nonce":873909886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6831","nonce":873909886}]},"public_addr":"172.21.15.81:6827/873909886","cluster_addr":"172.21.15.81:6829/873909886","heartbeat_back_addr":"172.21.15.81:6833/873909886","heartbeat_front_addr":"172.21.15.81:6831/873909886","state":["exists","up"]},{"osd":10,"uuid":"12fcae89-30af-436b-a513-3998303da93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6825","nonce":1183629038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6827","nonce":1183629038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6831","nonce":1183629038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6829","nonce":1183629038}]},"public_addr":"172.21.15.134:6825/1183629038","cluster_addr":"172.21.15.134:6827/1183629038","heartbeat_back_addr":"172.21.15.134:6831/1183629038","heartbeat_front_addr":"172.21.15.134:6829/1183629038","state":["exists","up"]},{"osd":11,"uuid":"a543f42c-61da-4a93-b16b-a2891a4ef873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6825","nonce":2627233639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6827","nonce":2627233639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6831","nonce":2627233639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6829","nonce":2627233639}]},"public_addr":"172.21.15.146:6825/2627233639","cluster_addr":"172.21.15.146:6827/2627233639","heartbeat_back_addr":"172.21.15.146:6831/2627233639","heartbeat_front_addr":"172.21.15.146:6829/2627233639","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:08.411954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:41.459869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:15.068172+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:49.711273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:23.231811+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:57.917964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:39:32.982397+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:07.434610+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:43.606108+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:19.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:54.917284+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:42:30.525217+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6801/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/2237510960":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6801/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/3199433706":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1689714816":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/2777950369":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/1982866220":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1112375028":"2024-05-04T16:33:30.274051+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T16:48:54.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.876+0000 7f5a34a00700 1 -- 172.21.15.81:0/3830307361 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5a140b2990 msgr2=0x7f5a140b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:54.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.876+0000 7f5a34a00700 1 --2- 172.21.15.81:0/3830307361 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5a140b2990 0x7f5a140b4e50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5a20004630 tx=0x7f5a2000b3c0 comp rx=0 tx=0).stop 2024-05-03T16:48:54.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.876+0000 7f5a34a00700 1 -- 172.21.15.81:0/3830307361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30075ff0 msgr2=0x7f5a301a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:54.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.876+0000 7f5a34a00700 1 --2- 172.21.15.81:0/3830307361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30075ff0 0x7f5a301a1e80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5a18000c00 tx=0x7f5a180047b0 comp rx=0 tx=0).stop 2024-05-03T16:48:54.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.876+0000 7f5a34a00700 1 -- 172.21.15.81:0/3830307361 shutdown_connections 2024-05-03T16:48:54.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.876+0000 7f5a34a00700 1 --2- 172.21.15.81:0/3830307361 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5a140b2990 0x7f5a140b4e50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:54.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.876+0000 7f5a34a00700 1 --2- 172.21.15.81:0/3830307361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3010fea0 0x7f5a3019bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:54.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.876+0000 7f5a34a00700 1 --2- 172.21.15.81:0/3830307361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a300756d0 0x7f5a301a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:54.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.876+0000 7f5a34a00700 1 --2- 172.21.15.81:0/3830307361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30075ff0 0x7f5a301a1e80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:54.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.876+0000 7f5a34a00700 1 -- 172.21.15.81:0/3830307361 >> 172.21.15.81:0/3830307361 conn(0x7f5a3007a600 msgr2=0x7f5a30100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:54.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.877+0000 7f5a34a00700 1 -- 172.21.15.81:0/3830307361 shutdown_connections 2024-05-03T16:48:54.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:54.877+0000 7f5a34a00700 1 -- 172.21.15.81:0/3830307361 wait complete. 2024-05-03T16:48:55.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:54 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3830307361' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:48:55.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:54 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3830307361' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:48:55.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:54 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3830307361' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T16:48:55.778 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-03T16:43:58.734681+0000', 'modified': '2024-05-03T16:45:31.547191+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 34466, 'mds_1': 34439, 'mds_2': 34418, 'mds_3': 34400, 'mds_4': 24481}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14589': {'gid': 14589, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6839/3710454674', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 3710454674}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 3710454674}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14595': {'gid': 14595, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6841/1174252889', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6840', 'nonce': 1174252889}, {'type': 'v1', 'addr': '172.21.15.81:6841', 'nonce': 1174252889}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24418': {'gid': 24418, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6833/1900581381', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 1900581381}, {'type': 'v1', 'addr': '172.21.15.146:6833', 'nonce': 1900581381}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6835/3514751933', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 3514751933}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 3514751933}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6837/971814714', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6836', 'nonce': 971814714}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 971814714}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'i', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 32, 'addr': '172.21.15.146:6839/3770312555', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6838', 'nonce': 3770312555}, {'type': 'v1', 'addr': '172.21.15.146:6839', 'nonce': 3770312555}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34400': {'gid': 34400, 'name': 'k', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 39, 'addr': '172.21.15.134:6833/749392804', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6832', 'nonce': 749392804}, {'type': 'v1', 'addr': '172.21.15.134:6833', 'nonce': 749392804}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34418': {'gid': 34418, 'name': 'e', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 36, 'addr': '172.21.15.134:6835/3681203129', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 3681203129}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 3681203129}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34439': {'gid': 34439, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 32, 'addr': '172.21.15.134:6837/2915415754', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6836', 'nonce': 2915415754}, {'type': 'v1', 'addr': '172.21.15.134:6837', 'nonce': 2915415754}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34466': {'gid': 34466, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.134:6839/2061491127', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6838', 'nonce': 2061491127}, {'type': 'v1', 'addr': '172.21.15.134:6839', 'nonce': 2061491127}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34466, 'qdb_cluster': [24481, 34400, 34466, 34439, 34418]} 2024-05-03T16:48:55.778 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-03T16:48:55.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell mds.i status 2024-05-03T16:48:55.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:55 smithi081 ceph-mon[28640]: pgmap v526: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T16:48:56.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:55 smithi134 ceph-mon[31708]: pgmap v526: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T16:48:56.222 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:48:56.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:55 smithi146 ceph-mon[32357]: pgmap v526: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T16:48:57.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:57 smithi081 ceph-mon[28640]: pgmap v527: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:48:58.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:57 smithi134 ceph-mon[31708]: pgmap v527: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:48:58.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:57 smithi146 ceph-mon[32357]: pgmap v527: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:48:58.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.546+0000 7f7583e00700 1 -- 172.21.15.81:0/2357674240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f758406ba10 msgr2=0x7f758406be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:58.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.546+0000 7f7583e00700 1 --2- 172.21.15.81:0/2357674240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f758406ba10 0x7f758406be90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7570009990 tx=0x7f7570009ca0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.546+0000 7f7583e00700 1 -- 172.21.15.81:0/2357674240 shutdown_connections 2024-05-03T16:48:58.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.546+0000 7f7583e00700 1 --2- 172.21.15.81:0/2357674240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7584109510 0x7f75841098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.546+0000 7f7583e00700 1 --2- 172.21.15.81:0/2357674240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f758406c3d0 0x7f75841102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.546+0000 7f7583e00700 1 --2- 172.21.15.81:0/2357674240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f758406ba10 0x7f758406be90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.546+0000 7f7583e00700 1 -- 172.21.15.81:0/2357674240 >> 172.21.15.81:0/2357674240 conn(0x7f75840791e0 msgr2=0x7f75840795f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:58.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.546+0000 7f7583e00700 1 -- 172.21.15.81:0/2357674240 shutdown_connections 2024-05-03T16:48:58.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.546+0000 7f7583e00700 1 -- 172.21.15.81:0/2357674240 wait complete. 2024-05-03T16:48:58.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.547+0000 7f7583e00700 1 Processor -- start 2024-05-03T16:48:58.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.548+0000 7f7583e00700 1 -- start start 2024-05-03T16:48:58.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.548+0000 7f7583e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f758406ba10 0x7f7584102630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:58.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.548+0000 7f7583e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f758406c3d0 0x7f7584102b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:58.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.548+0000 7f7583e00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7584109510 0x7f75841030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:58.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.548+0000 7f7583e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7584113560 con 0x7f758406ba10 2024-05-03T16:48:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.548+0000 7f7583e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f75841133e0 con 0x7f758406c3d0 2024-05-03T16:48:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.548+0000 7f7583e00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f75841136e0 con 0x7f7584109510 2024-05-03T16:48:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.548+0000 7f7582a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f758406ba10 0x7f7584102630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.548+0000 7f7582a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f758406ba10 0x7f7584102630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49228/0 (socket says 172.21.15.81:49228) 2024-05-03T16:48:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.548+0000 7f7582a00700 1 -- 172.21.15.81:0/3176802917 learned_addr learned my addr 172.21.15.81:0/3176802917 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.549+0000 7f7582000700 1 --2- 172.21.15.81:0/3176802917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f758406c3d0 0x7f7584102b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.549+0000 7f7583400700 1 --2- 172.21.15.81:0/3176802917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7584109510 0x7f75841030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.549+0000 7f7582a00700 1 -- 172.21.15.81:0/3176802917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7584109510 msgr2=0x7f75841030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.549+0000 7f7582a00700 1 --2- 172.21.15.81:0/3176802917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7584109510 0x7f75841030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.549+0000 7f7582a00700 1 -- 172.21.15.81:0/3176802917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f758406c3d0 msgr2=0x7f7584102b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.549+0000 7f7582a00700 1 --2- 172.21.15.81:0/3176802917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f758406c3d0 0x7f7584102b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.549+0000 7f7582a00700 1 -- 172.21.15.81:0/3176802917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75841a8060 con 0x7f758406ba10 2024-05-03T16:48:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.549+0000 7f7583400700 1 --2- 172.21.15.81:0/3176802917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7584109510 0x7f75841030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:48:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.549+0000 7f7582a00700 1 --2- 172.21.15.81:0/3176802917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f758406ba10 0x7f7584102630 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f757400b530 tx=0x7f757400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.549+0000 7f757b400700 1 -- 172.21.15.81:0/3176802917 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574015020 con 0x7f758406ba10 2024-05-03T16:48:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.549+0000 7f757b400700 1 -- 172.21.15.81:0/3176802917 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7574011cc0 con 0x7f758406ba10 2024-05-03T16:48:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.550+0000 7f7583e00700 1 -- 172.21.15.81:0/3176802917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75841a8350 con 0x7f758406ba10 2024-05-03T16:48:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.550+0000 7f757b400700 1 -- 172.21.15.81:0/3176802917 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574010d30 con 0x7f758406ba10 2024-05-03T16:48:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.550+0000 7f7583e00700 1 -- 172.21.15.81:0/3176802917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75841a8890 con 0x7f758406ba10 2024-05-03T16:48:58.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.553+0000 7f757b400700 1 -- 172.21.15.81:0/3176802917 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f7574018020 con 0x7f758406ba10 2024-05-03T16:48:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.554+0000 7f75943dab80 1 Processor -- start 2024-05-03T16:48:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.555+0000 7f75943dab80 1 -- start start 2024-05-03T16:48:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.555+0000 7f757b400700 1 --2- 172.21.15.81:0/3176802917 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f75680b2910 0x7f75680b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.555+0000 7f75943dab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 0x562dfb783dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.555+0000 7f75943dab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb784310 0x562dfb77df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.555+0000 7f75943dab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb77e580 0x562dfb77e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.555+0000 7f75943dab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562dfb6d09d0 con 0x562dfb7839f0 2024-05-03T16:48:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.555+0000 7f75943dab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562dfb66e710 con 0x562dfb784310 2024-05-03T16:48:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.555+0000 7f75943dab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562dfb6cc990 con 0x562dfb77e580 2024-05-03T16:48:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.555+0000 7f757b400700 1 -- 172.21.15.81:0/3176802917 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f75740e1f50 con 0x7f758406ba10 2024-05-03T16:48:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.555+0000 7f7582a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 0x562dfb783dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.555+0000 7f7583400700 1 --2- 172.21.15.81:0/3176802917 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f75680b2910 0x7f75680b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.556+0000 7f7582a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 0x562dfb783dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49238/0 (socket says 172.21.15.81:49238) 2024-05-03T16:48:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.556+0000 7f7582a00700 1 -- 172.21.15.81:0/2205164219 learned_addr learned my addr 172.21.15.81:0/2205164219 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.556+0000 7f7582000700 1 --2- 172.21.15.81:0/2205164219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb784310 0x562dfb77df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.556+0000 7f7583400700 1 --2- 172.21.15.81:0/2205164219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb77e580 0x562dfb77e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.556+0000 7f7582a00700 1 -- 172.21.15.81:0/2205164219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb77e580 msgr2=0x562dfb77e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.556+0000 7f7582a00700 1 --2- 172.21.15.81:0/2205164219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb77e580 0x562dfb77e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.556+0000 7f7582a00700 1 -- 172.21.15.81:0/2205164219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb784310 msgr2=0x562dfb77df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.556+0000 7f7582a00700 1 --2- 172.21.15.81:0/2205164219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb784310 0x562dfb77df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.556+0000 7f7582a00700 1 -- 172.21.15.81:0/2205164219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dfb61d880 con 0x562dfb7839f0 2024-05-03T16:48:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.556+0000 7f7583400700 1 --2- 172.21.15.81:0/3176802917 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f75680b2910 0x7f75680b4dd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f757c0107d0 tx=0x7f757c010ae0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.556+0000 7f7582a00700 1 --2- 172.21.15.81:0/2205164219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 0x562dfb783dd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7574019040 tx=0x7f75740a8900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f833e77bce792e93 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.557+0000 7f756fe00700 1 -- 172.21.15.81:0/2205164219 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75740a8c20 con 0x562dfb7839f0 2024-05-03T16:48:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.557+0000 7f756fe00700 1 -- 172.21.15.81:0/2205164219 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75740a9810 con 0x562dfb7839f0 2024-05-03T16:48:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.557+0000 7f756fe00700 1 -- 172.21.15.81:0/2205164219 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75740a95d0 con 0x562dfb7839f0 2024-05-03T16:48:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.557+0000 7f75943dab80 1 -- 172.21.15.81:0/2205164219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 msgr2=0x562dfb783dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.557+0000 7f75943dab80 1 --2- 172.21.15.81:0/2205164219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 0x562dfb783dd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7574019040 tx=0x7f75740a8900 comp rx=0 tx=0).stop 2024-05-03T16:48:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.558+0000 7f75943dab80 1 -- 172.21.15.81:0/2205164219 shutdown_connections 2024-05-03T16:48:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.558+0000 7f75943dab80 1 --2- 172.21.15.81:0/2205164219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb77e580 0x562dfb77e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.558+0000 7f75943dab80 1 --2- 172.21.15.81:0/2205164219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 0x562dfb783dd0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.558+0000 7f75943dab80 1 --2- 172.21.15.81:0/2205164219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb784310 0x562dfb77df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.558+0000 7f75943dab80 1 -- 172.21.15.81:0/2205164219 >> 172.21.15.81:0/2205164219 conn(0x562dfb6acb10 msgr2=0x562dfb778980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.558+0000 7f75943dab80 1 -- 172.21.15.81:0/2205164219 shutdown_connections 2024-05-03T16:48:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.558+0000 7f75943dab80 1 -- 172.21.15.81:0/2205164219 wait complete. 2024-05-03T16:48:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.558+0000 7f75943dab80 1 -- start start 2024-05-03T16:48:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.559+0000 7f75943dab80 1 Processor -- start 2024-05-03T16:48:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.559+0000 7f75943dab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb77e580 0x562dfb789ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.559+0000 7f75943dab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 0x562dfb787280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.559+0000 7f75943dab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb784310 0x562dfb7877c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.559+0000 7f75943dab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562dfb78ad80 con 0x562dfb7839f0 2024-05-03T16:48:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.559+0000 7f75943dab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562dfb636ad0 con 0x562dfb77e580 2024-05-03T16:48:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.559+0000 7f75943dab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562dfb78af00 con 0x562dfb784310 2024-05-03T16:48:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.559+0000 7f75943dab80 10 client.0 _ll_register_callbacks cb 0x562dfb677c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:48:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.559+0000 7f7582000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 0x562dfb787280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.559+0000 7f7582000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 0x562dfb787280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49252/0 (socket says 172.21.15.81:49252) 2024-05-03T16:48:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.559+0000 7f7582000700 1 -- 172.21.15.81:0/1839049118 learned_addr learned my addr 172.21.15.81:0/1839049118 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.560+0000 7f7583400700 1 --2- 172.21.15.81:0/1839049118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb784310 0x562dfb7877c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.560+0000 7f7582a00700 1 --2- 172.21.15.81:0/1839049118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb77e580 0x562dfb789ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.560+0000 7f7582000700 1 -- 172.21.15.81:0/1839049118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb784310 msgr2=0x562dfb7877c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.560+0000 7f7582000700 1 --2- 172.21.15.81:0/1839049118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb784310 0x562dfb7877c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.560+0000 7f7582000700 1 -- 172.21.15.81:0/1839049118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb77e580 msgr2=0x562dfb789ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.560+0000 7f7582000700 1 --2- 172.21.15.81:0/1839049118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb77e580 0x562dfb789ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.560+0000 7f7582000700 1 -- 172.21.15.81:0/1839049118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dfb6963d0 con 0x562dfb7839f0 2024-05-03T16:48:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.560+0000 7f7582000700 1 --2- 172.21.15.81:0/1839049118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 0x562dfb787280 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f75700098e0 tx=0x7f7570005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57240d692349fb55 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.560+0000 7f756cc00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:48:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.561+0000 7f756cc00700 1 -- 172.21.15.81:0/1839049118 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75700054e0 con 0x562dfb7839f0 2024-05-03T16:48:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.561+0000 7f756cc00700 1 -- 172.21.15.81:0/1839049118 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f7570005680 con 0x562dfb7839f0 2024-05-03T16:48:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.561+0000 7f75943dab80 1 -- 172.21.15.81:0/1839049118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75740a9810 con 0x562dfb7839f0 2024-05-03T16:48:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.561+0000 7f756cc00700 1 -- 172.21.15.81:0/1839049118 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7570031050 con 0x562dfb7839f0 2024-05-03T16:48:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.561+0000 7f75943dab80 10 client.15198 fetch_fsmap learned FSMap version 29 2024-05-03T16:48:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.561+0000 7f75943dab80 1 -- 172.21.15.81:0/1839049118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562dfb7954b0 con 0x562dfb7839f0 2024-05-03T16:48:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.561+0000 7f756cc00700 1 -- 172.21.15.81:0/1839049118 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75740a9810 con 0x562dfb7839f0 2024-05-03T16:48:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.561+0000 7f756cc00700 1 -- 172.21.15.81:0/1839049118 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7570023650 con 0x562dfb7839f0 2024-05-03T16:48:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.562+0000 7f75943dab80 10 client.15198 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:48:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.562+0000 7f75943dab80 10 client.15198 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-03T16:48:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.562+0000 7f75943dab80 20 client.15198 populate_metadata read hostname 'smithi081' 2024-05-03T16:48:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.562+0000 7f75943dab80 1 --2- 172.21.15.81:0/1839049118 >> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] conn(0x562dfb797b40 0x562dfb798fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.562+0000 7f75943dab80 4 client.15198 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T16:48:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.562+0000 7f75943dab80 1 -- 172.21.15.81:0/1839049118 --> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562dfb74b180 con 0x562dfb797b40 2024-05-03T16:48:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.562+0000 7f7582a00700 1 --2- 172.21.15.81:0/1839049118 >> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] conn(0x562dfb797b40 0x562dfb798fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.563+0000 7f7582a00700 1 --2- 172.21.15.81:0/1839049118 >> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] conn(0x562dfb797b40 0x562dfb798fb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cca7d5c10ae8ef34 server_cookie=e276d0a4431ff5d6 in_seq=0 out_seq=0 2024-05-03T16:48:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.563+0000 7f756cc00700 10 client.15198 ms_handle_connect on v2:172.21.15.146:6838/3770312555 2024-05-03T16:48:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.565+0000 7f756cc00700 1 -- 172.21.15.81:0/1839049118 <== mds.4 v2:172.21.15.146:6838/3770312555 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562dfb74b180 con 0x562dfb797b40 2024-05-03T16:48:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.565+0000 7f756cc00700 10 client.15198 handle_command_reply: tid=0 2024-05-03T16:48:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.566+0000 7f75943dab80 1 client.15198 shutdown 2024-05-03T16:48:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.566+0000 7f75943dab80 1 -- 172.21.15.81:0/1839049118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 msgr2=0x562dfb787280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.566+0000 7f75943dab80 1 --2- 172.21.15.81:0/1839049118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 0x562dfb787280 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f75700098e0 tx=0x7f7570005c00 comp rx=0 tx=0).stop 2024-05-03T16:48:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.566+0000 7f75943dab80 1 -- 172.21.15.81:0/1839049118 shutdown_connections 2024-05-03T16:48:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.566+0000 7f75943dab80 1 --2- 172.21.15.81:0/1839049118 >> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] conn(0x562dfb797b40 0x562dfb798fb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.566+0000 7f75943dab80 1 --2- 172.21.15.81:0/1839049118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb784310 0x562dfb7877c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.566+0000 7f75943dab80 1 --2- 172.21.15.81:0/1839049118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb77e580 0x562dfb789ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.566+0000 7f75943dab80 1 --2- 172.21.15.81:0/1839049118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 0x562dfb787280 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.566+0000 7f75943dab80 1 -- 172.21.15.81:0/1839049118 >> 172.21.15.81:0/1839049118 conn(0x562dfb6acb10 msgr2=0x562dfb778030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.566+0000 7f756cc00700 0 client.15198 ms_handle_reset on v2:172.21.15.146:6838/3770312555 2024-05-03T16:48:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.566+0000 7f75943dab80 1 -- 172.21.15.81:0/1839049118 shutdown_connections 2024-05-03T16:48:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.566+0000 7f75943dab80 1 -- 172.21.15.81:0/1839049118 wait complete. 2024-05-03T16:48:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.566+0000 7f75943dab80 20 client.15198 trim_cache size 0 max 16384 2024-05-03T16:48:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.589+0000 7f75943dab80 1 Processor -- start 2024-05-03T16:48:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.589+0000 7f75943dab80 1 -- start start 2024-05-03T16:48:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.589+0000 7f75943dab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb77e580 0x562dfb77a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.589+0000 7f75943dab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 0x562dfb785b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.589+0000 7f75943dab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb784310 0x562dfb7860b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.589+0000 7f75943dab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562dfb7972f0 con 0x562dfb7839f0 2024-05-03T16:48:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.589+0000 7f75943dab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562dfb7979c0 con 0x562dfb784310 2024-05-03T16:48:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.589+0000 7f75943dab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562dfb798090 con 0x562dfb77e580 2024-05-03T16:48:58.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.590+0000 7f7582000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 0x562dfb785b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:58.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.590+0000 7f7582000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 0x562dfb785b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49256/0 (socket says 172.21.15.81:49256) 2024-05-03T16:48:58.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.590+0000 7f7582000700 1 -- 172.21.15.81:0/3924893669 learned_addr learned my addr 172.21.15.81:0/3924893669 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:58.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.590+0000 7f7583400700 1 --2- 172.21.15.81:0/3924893669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb784310 0x562dfb7860b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.590+0000 7f7582a00700 1 --2- 172.21.15.81:0/3924893669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb77e580 0x562dfb77a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.590+0000 7f7582000700 1 -- 172.21.15.81:0/3924893669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb77e580 msgr2=0x562dfb77a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.590+0000 7f7582000700 1 --2- 172.21.15.81:0/3924893669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb77e580 0x562dfb77a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.590+0000 7f7582000700 1 -- 172.21.15.81:0/3924893669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb784310 msgr2=0x562dfb7860b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.590+0000 7f7582000700 1 --2- 172.21.15.81:0/3924893669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb784310 0x562dfb7860b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.590+0000 7f7582000700 1 -- 172.21.15.81:0/3924893669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dfb773720 con 0x562dfb7839f0 2024-05-03T16:48:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.590+0000 7f7583400700 1 --2- 172.21.15.81:0/3924893669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb784310 0x562dfb7860b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:48:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.591+0000 7f7582000700 1 --2- 172.21.15.81:0/3924893669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 0x562dfb785b70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7570005f50 tx=0x7f7570009fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2e2722a161ae89 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.591+0000 7f756f400700 1 -- 172.21.15.81:0/3924893669 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570023670 con 0x562dfb7839f0 2024-05-03T16:48:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.591+0000 7f756f400700 1 -- 172.21.15.81:0/3924893669 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7570028070 con 0x562dfb7839f0 2024-05-03T16:48:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.591+0000 7f756f400700 1 -- 172.21.15.81:0/3924893669 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570003dc0 con 0x562dfb7839f0 2024-05-03T16:48:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.592+0000 7f75943dab80 1 -- 172.21.15.81:0/3924893669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 msgr2=0x562dfb785b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.592+0000 7f75943dab80 1 --2- 172.21.15.81:0/3924893669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 0x562dfb785b70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7570005f50 tx=0x7f7570009fc0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.592+0000 7f75943dab80 1 -- 172.21.15.81:0/3924893669 shutdown_connections 2024-05-03T16:48:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.592+0000 7f75943dab80 1 --2- 172.21.15.81:0/3924893669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb77e580 0x562dfb77a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.592+0000 7f75943dab80 1 --2- 172.21.15.81:0/3924893669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb784310 0x562dfb7860b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.592+0000 7f75943dab80 1 --2- 172.21.15.81:0/3924893669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb7839f0 0x562dfb785b70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.592+0000 7f75943dab80 1 -- 172.21.15.81:0/3924893669 >> 172.21.15.81:0/3924893669 conn(0x562dfb6acb10 msgr2=0x562dfb781570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.592+0000 7f75943dab80 1 -- 172.21.15.81:0/3924893669 shutdown_connections 2024-05-03T16:48:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.592+0000 7f75943dab80 1 -- 172.21.15.81:0/3924893669 wait complete. 2024-05-03T16:48:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.592+0000 7f75943dab80 1 -- start start 2024-05-03T16:48:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.592+0000 7f75943dab80 1 Processor -- start 2024-05-03T16:48:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.593+0000 7f75943dab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb77e580 0x562dfb7a2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.593+0000 7f75943dab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb7839f0 0x562dfb7931c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.593+0000 7f75943dab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb784310 0x562dfb793740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.593+0000 7f75943dab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562dfb798e30 con 0x562dfb77e580 2024-05-03T16:48:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.593+0000 7f75943dab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562dfb798760 con 0x562dfb784310 2024-05-03T16:48:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.593+0000 7f75943dab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562dfb799500 con 0x562dfb7839f0 2024-05-03T16:48:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.593+0000 7f75943dab80 10 client.0 _ll_register_callbacks cb 0x562dfb677c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:48:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.593+0000 7f7582a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb77e580 0x562dfb7a2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.593+0000 7f7582a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb77e580 0x562dfb7a2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49260/0 (socket says 172.21.15.81:49260) 2024-05-03T16:48:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.593+0000 7f7582a00700 1 -- 172.21.15.81:0/2269361604 learned_addr learned my addr 172.21.15.81:0/2269361604 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:48:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.594+0000 7f7582000700 1 --2- 172.21.15.81:0/2269361604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb7839f0 0x562dfb7931c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.594+0000 7f7582a00700 1 -- 172.21.15.81:0/2269361604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb7839f0 msgr2=0x562dfb7931c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.594+0000 7f7582a00700 1 --2- 172.21.15.81:0/2269361604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb7839f0 0x562dfb7931c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.594+0000 7f7582a00700 1 -- 172.21.15.81:0/2269361604 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb784310 msgr2=0x562dfb793740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:48:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.594+0000 7f7583400700 1 --2- 172.21.15.81:0/2269361604 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb784310 0x562dfb793740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.594+0000 7f7582a00700 1 --2- 172.21.15.81:0/2269361604 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb784310 0x562dfb793740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.594+0000 7f7582a00700 1 -- 172.21.15.81:0/2269361604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dfb793f80 con 0x562dfb77e580 2024-05-03T16:48:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.594+0000 7f7582000700 1 --2- 172.21.15.81:0/2269361604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb7839f0 0x562dfb7931c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:48:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.594+0000 7f7583400700 1 --2- 172.21.15.81:0/2269361604 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb784310 0x562dfb793740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:48:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.594+0000 7f7582a00700 1 --2- 172.21.15.81:0/2269361604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb77e580 0x562dfb7a2a10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f75740a6380 tx=0x7f75740106d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669d4b1c26e8bb98 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:48:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.594+0000 7f756cc00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:48:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.594+0000 7f756cc00700 1 -- 172.21.15.81:0/2269361604 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75740a9810 con 0x562dfb77e580 2024-05-03T16:48:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.594+0000 7f756cc00700 1 -- 172.21.15.81:0/2269361604 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f75740a9580 con 0x562dfb77e580 2024-05-03T16:48:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.594+0000 7f75943dab80 1 -- 172.21.15.81:0/2269361604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7570028070 con 0x562dfb77e580 2024-05-03T16:48:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.595+0000 7f756cc00700 1 -- 172.21.15.81:0/2269361604 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f75740ad4c0 con 0x562dfb77e580 2024-05-03T16:48:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.595+0000 7f75943dab80 10 client.15204 fetch_fsmap learned FSMap version 29 2024-05-03T16:48:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.595+0000 7f75943dab80 1 -- 172.21.15.81:0/2269361604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562dfb803010 con 0x562dfb77e580 2024-05-03T16:48:58.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.595+0000 7f756cc00700 1 -- 172.21.15.81:0/2269361604 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7570028070 con 0x562dfb77e580 2024-05-03T16:48:58.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.595+0000 7f756cc00700 1 -- 172.21.15.81:0/2269361604 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f75740b1b70 con 0x562dfb77e580 2024-05-03T16:48:58.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.595+0000 7f75943dab80 10 client.15204 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:48:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.595+0000 7f75943dab80 10 client.15204 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-03T16:48:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.595+0000 7f75943dab80 20 client.15204 populate_metadata read hostname 'smithi081' 2024-05-03T16:48:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.595+0000 7f75943dab80 1 --2- 172.21.15.81:0/2269361604 >> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] conn(0x562dfb807740 0x562dfb806450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:48:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.595+0000 7f75943dab80 4 client.15204 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T16:48:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.595+0000 7f75943dab80 1 -- 172.21.15.81:0/2269361604 --> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] -- command(tid 0: {"prefix": "status"}) -- 0x562dfb6de3b0 con 0x562dfb807740 2024-05-03T16:48:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.596+0000 7f7582000700 1 --2- 172.21.15.81:0/2269361604 >> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] conn(0x562dfb807740 0x562dfb806450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:48:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.597+0000 7f7582000700 1 --2- 172.21.15.81:0/2269361604 >> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] conn(0x562dfb807740 0x562dfb806450 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d6a8ef9cff76070f server_cookie=2f3155da6332545e in_seq=0 out_seq=0 2024-05-03T16:48:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.597+0000 7f756cc00700 10 client.15204 ms_handle_connect on v2:172.21.15.146:6838/3770312555 2024-05-03T16:48:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.597+0000 7f756cc00700 1 -- 172.21.15.81:0/2269361604 <== mds.4 v2:172.21.15.146:6838/3770312555 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562dfb6de3b0 con 0x562dfb807740 2024-05-03T16:48:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.597+0000 7f756cc00700 10 client.15204 handle_command_reply: tid=0 2024-05-03T16:48:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.597+0000 7f75943dab80 1 client.15204 shutdown 2024-05-03T16:48:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.598+0000 7f75943dab80 1 -- 172.21.15.81:0/2269361604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb77e580 msgr2=0x562dfb7a2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.598+0000 7f75943dab80 1 --2- 172.21.15.81:0/2269361604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb77e580 0x562dfb7a2a10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f75740a6380 tx=0x7f75740106d0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.598+0000 7f75943dab80 1 -- 172.21.15.81:0/2269361604 shutdown_connections 2024-05-03T16:48:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.598+0000 7f75943dab80 1 --2- 172.21.15.81:0/2269361604 >> [v2:172.21.15.146:6838/3770312555,v1:172.21.15.146:6839/3770312555] conn(0x562dfb807740 0x562dfb806450 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.598+0000 7f75943dab80 1 --2- 172.21.15.81:0/2269361604 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562dfb784310 0x562dfb793740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.598+0000 7f75943dab80 1 --2- 172.21.15.81:0/2269361604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562dfb77e580 0x562dfb7a2a10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.598+0000 7f75943dab80 1 --2- 172.21.15.81:0/2269361604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562dfb7839f0 0x562dfb7931c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.598+0000 7f756cc00700 0 client.15204 ms_handle_reset on v2:172.21.15.146:6838/3770312555 2024-05-03T16:48:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.598+0000 7f75943dab80 1 -- 172.21.15.81:0/2269361604 >> 172.21.15.81:0/2269361604 conn(0x562dfb6acb10 msgr2=0x562dfb77a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.598+0000 7f75943dab80 1 -- 172.21.15.81:0/2269361604 shutdown_connections 2024-05-03T16:48:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.598+0000 7f75943dab80 1 -- 172.21.15.81:0/2269361604 wait complete. 2024-05-03T16:48:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.598+0000 7f75943dab80 20 client.15204 trim_cache size 0 max 16384 2024-05-03T16:48:58.603 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-03T16:48:58.603 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8988869e-096a-11ef-bc97-c7b262605968", 2024-05-03T16:48:58.603 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 4, 2024-05-03T16:48:58.604 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24481, 2024-05-03T16:48:58.604 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-05-03T16:48:58.604 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-05-03T16:48:58.604 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-05-03T16:48:58.604 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 211.99558329199999, 2024-05-03T16:48:58.604 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 29, 2024-05-03T16:48:58.604 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 91, 2024-05-03T16:48:58.604 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 91, 2024-05-03T16:48:58.604 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 334.03957088599998 2024-05-03T16:48:58.604 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-03T16:48:58.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.599+0000 7f7583e00700 1 -- 172.21.15.81:0/3176802917 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f75680b2910 msgr2=0x7f75680b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:58.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.599+0000 7f7583e00700 1 --2- 172.21.15.81:0/3176802917 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f75680b2910 0x7f75680b4dd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f757c0107d0 tx=0x7f757c010ae0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.599+0000 7f7583e00700 1 -- 172.21.15.81:0/3176802917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f758406ba10 msgr2=0x7f7584102630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:48:58.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.599+0000 7f7583e00700 1 --2- 172.21.15.81:0/3176802917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f758406ba10 0x7f7584102630 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f757400b530 tx=0x7f757400b8f0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.599+0000 7f7583e00700 1 -- 172.21.15.81:0/3176802917 shutdown_connections 2024-05-03T16:48:58.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.599+0000 7f7583e00700 1 --2- 172.21.15.81:0/3176802917 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f75680b2910 0x7f75680b4dd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.599+0000 7f7583e00700 1 --2- 172.21.15.81:0/3176802917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7584109510 0x7f75841030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.599+0000 7f7583e00700 1 --2- 172.21.15.81:0/3176802917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f758406ba10 0x7f7584102630 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.599+0000 7f7583e00700 1 --2- 172.21.15.81:0/3176802917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f758406c3d0 0x7f7584102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:48:58.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.599+0000 7f7583e00700 1 -- 172.21.15.81:0/3176802917 >> 172.21.15.81:0/3176802917 conn(0x7f75840791e0 msgr2=0x7f7584100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:48:58.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.599+0000 7f7583e00700 1 -- 172.21.15.81:0/3176802917 shutdown_connections 2024-05-03T16:48:58.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:48:58.599+0000 7f7583e00700 1 -- 172.21.15.81:0/3176802917 wait complete. 2024-05-03T16:48:59.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell mds.k status 2024-05-03T16:48:59.965 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:49:00.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:48:59 smithi081 ceph-mon[28640]: pgmap v528: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:00.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:48:59 smithi146 ceph-mon[32357]: pgmap v528: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:00.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:48:59 smithi134 ceph-mon[31708]: pgmap v528: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:02.102 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:01 smithi081 ceph-mon[28640]: pgmap v529: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:02.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.264+0000 7f642c600700 1 -- 172.21.15.81:0/2529139357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6424106080 msgr2=0x7f6424112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:02.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.264+0000 7f642c600700 1 --2- 172.21.15.81:0/2529139357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6424106080 0x7f6424112590 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f641c00b0a0 tx=0x7f641c00b3b0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.264+0000 7f642c600700 1 -- 172.21.15.81:0/2529139357 shutdown_connections 2024-05-03T16:49:02.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.264+0000 7f642c600700 1 --2- 172.21.15.81:0/2529139357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6424106080 0x7f6424112590 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.264+0000 7f642c600700 1 --2- 172.21.15.81:0/2529139357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f642410b6c0 0x7f642410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.264+0000 7f642c600700 1 --2- 172.21.15.81:0/2529139357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64241056c0 0x7f6424105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.264+0000 7f642c600700 1 -- 172.21.15.81:0/2529139357 >> 172.21.15.81:0/2529139357 conn(0x7f6424101170 msgr2=0x7f6424103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:02.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.264+0000 7f642c600700 1 -- 172.21.15.81:0/2529139357 shutdown_connections 2024-05-03T16:49:02.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.264+0000 7f642c600700 1 -- 172.21.15.81:0/2529139357 wait complete. 2024-05-03T16:49:02.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.265+0000 7f642c600700 1 Processor -- start 2024-05-03T16:49:02.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.265+0000 7f642c600700 1 -- start start 2024-05-03T16:49:02.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.266+0000 7f642c600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64241056c0 0x7f64241a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:02.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.266+0000 7f642c600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6424106080 0x7f64241a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:02.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.266+0000 7f642c600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f642410b6c0 0x7f642419b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:02.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.266+0000 7f642c600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f64241157b0 con 0x7f64241056c0 2024-05-03T16:49:02.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.266+0000 7f642c600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6424115630 con 0x7f642410b6c0 2024-05-03T16:49:02.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.266+0000 7f642c600700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6424115930 con 0x7f6424106080 2024-05-03T16:49:02.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.266+0000 7f6429c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64241056c0 0x7f64241a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:02.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.266+0000 7f6429c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64241056c0 0x7f64241a1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49282/0 (socket says 172.21.15.81:49282) 2024-05-03T16:49:02.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.266+0000 7f6429c00700 1 -- 172.21.15.81:0/663417800 learned_addr learned my addr 172.21.15.81:0/663417800 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:02.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.266+0000 7f642a600700 1 --2- 172.21.15.81:0/663417800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f642410b6c0 0x7f642419b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:02.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.266+0000 7f6429200700 1 --2- 172.21.15.81:0/663417800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6424106080 0x7f64241a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:02.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.267+0000 7f6429c00700 1 -- 172.21.15.81:0/663417800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6424106080 msgr2=0x7f64241a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.267+0000 7f6429c00700 1 --2- 172.21.15.81:0/663417800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6424106080 0x7f64241a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.267+0000 7f6429c00700 1 -- 172.21.15.81:0/663417800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f642410b6c0 msgr2=0x7f642419b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.267+0000 7f6429c00700 1 --2- 172.21.15.81:0/663417800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f642410b6c0 0x7f642419b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.267+0000 7f6429c00700 1 -- 172.21.15.81:0/663417800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642419c150 con 0x7f64241056c0 2024-05-03T16:49:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.267+0000 7f6429c00700 1 --2- 172.21.15.81:0/663417800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64241056c0 0x7f64241a1830 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f641800c9b0 tx=0x7f641800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.267+0000 7f6422000700 1 -- 172.21.15.81:0/663417800 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418007b00 con 0x7f64241056c0 2024-05-03T16:49:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.267+0000 7f6422000700 1 -- 172.21.15.81:0/663417800 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6418007ca0 con 0x7f64241056c0 2024-05-03T16:49:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.267+0000 7f6422000700 1 -- 172.21.15.81:0/663417800 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418018660 con 0x7f64241056c0 2024-05-03T16:49:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.267+0000 7f642c600700 1 -- 172.21.15.81:0/663417800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f642419c440 con 0x7f64241056c0 2024-05-03T16:49:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.268+0000 7f642c600700 1 -- 172.21.15.81:0/663417800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64241a8700 con 0x7f64241056c0 2024-05-03T16:49:02.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.271+0000 7f6422000700 1 -- 172.21.15.81:0/663417800 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f641800f450 con 0x7f64241056c0 2024-05-03T16:49:02.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.272+0000 7f643707bb80 1 Processor -- start 2024-05-03T16:49:02.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.272+0000 7f643707bb80 1 -- start start 2024-05-03T16:49:02.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.272+0000 7f6422000700 1 --2- 172.21.15.81:0/663417800 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f640c0b2990 0x7f640c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.273+0000 7f6422000700 1 -- 172.21.15.81:0/663417800 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f64180e2760 con 0x7f64241056c0 2024-05-03T16:49:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.273+0000 7f643707bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc927760 0x55e0dc927b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.273+0000 7f643707bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc928080 0x55e0dc922f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.273+0000 7f642a600700 1 --2- 172.21.15.81:0/663417800 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f640c0b2990 0x7f640c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.273+0000 7f643707bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc923580 0x55e0dc9239e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.273+0000 7f643707bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e0dc8759d0 con 0x55e0dc927760 2024-05-03T16:49:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.273+0000 7f643707bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e0dc813710 con 0x55e0dc923580 2024-05-03T16:49:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.273+0000 7f643707bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e0dc871990 con 0x55e0dc928080 2024-05-03T16:49:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.273+0000 7f6429c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc927760 0x55e0dc927b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.273+0000 7f6429c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc927760 0x55e0dc927b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49298/0 (socket says 172.21.15.81:49298) 2024-05-03T16:49:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.273+0000 7f6429c00700 1 -- 172.21.15.81:0/56610657 learned_addr learned my addr 172.21.15.81:0/56610657 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.274+0000 7f6429200700 1 --2- 172.21.15.81:0/56610657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc928080 0x55e0dc922f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.274+0000 7f642a600700 1 --2- 172.21.15.81:0/56610657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc923580 0x55e0dc9239e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.274+0000 7f6429c00700 1 -- 172.21.15.81:0/56610657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc928080 msgr2=0x55e0dc922f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.274+0000 7f6429c00700 1 --2- 172.21.15.81:0/56610657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc928080 0x55e0dc922f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.274+0000 7f6429c00700 1 -- 172.21.15.81:0/56610657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc923580 msgr2=0x55e0dc9239e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.274+0000 7f6429c00700 1 --2- 172.21.15.81:0/56610657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc923580 0x55e0dc9239e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.274+0000 7f6429c00700 1 -- 172.21.15.81:0/56610657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0dc7c2880 con 0x55e0dc927760 2024-05-03T16:49:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.274+0000 7f642a600700 1 --2- 172.21.15.81:0/663417800 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f640c0b2990 0x7f640c0b4e50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f641c00b070 tx=0x7f641c009d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.274+0000 7f6429c00700 1 --2- 172.21.15.81:0/56610657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc927760 0x55e0dc927b40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f64180a5890 tx=0x7f64180a9270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a347e91b0156ec server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.274+0000 7f6416a00700 1 -- 172.21.15.81:0/56610657 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64180b2670 con 0x55e0dc927760 2024-05-03T16:49:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.275+0000 7f6416a00700 1 -- 172.21.15.81:0/56610657 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f64180cc0e0 con 0x55e0dc927760 2024-05-03T16:49:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.275+0000 7f6416a00700 1 -- 172.21.15.81:0/56610657 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64180a9a70 con 0x55e0dc927760 2024-05-03T16:49:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.275+0000 7f643707bb80 1 -- 172.21.15.81:0/56610657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc927760 msgr2=0x55e0dc927b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.275+0000 7f643707bb80 1 --2- 172.21.15.81:0/56610657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc927760 0x55e0dc927b40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f64180a5890 tx=0x7f64180a9270 comp rx=0 tx=0).stop 2024-05-03T16:49:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.275+0000 7f643707bb80 1 -- 172.21.15.81:0/56610657 shutdown_connections 2024-05-03T16:49:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.275+0000 7f643707bb80 1 --2- 172.21.15.81:0/56610657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc923580 0x55e0dc9239e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.275+0000 7f643707bb80 1 --2- 172.21.15.81:0/56610657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc927760 0x55e0dc927b40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.275+0000 7f643707bb80 1 --2- 172.21.15.81:0/56610657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc928080 0x55e0dc922f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.275+0000 7f643707bb80 1 -- 172.21.15.81:0/56610657 >> 172.21.15.81:0/56610657 conn(0x55e0dc851b10 msgr2=0x55e0dc91d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.276+0000 7f643707bb80 1 -- 172.21.15.81:0/56610657 shutdown_connections 2024-05-03T16:49:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.276+0000 7f643707bb80 1 -- 172.21.15.81:0/56610657 wait complete. 2024-05-03T16:49:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.276+0000 7f643707bb80 1 -- start start 2024-05-03T16:49:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.276+0000 7f643707bb80 1 Processor -- start 2024-05-03T16:49:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.277+0000 7f643707bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc923580 0x55e0dc92ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.277+0000 7f643707bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc927760 0x55e0dc92c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.277+0000 7f643707bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc928080 0x55e0dc92c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.277+0000 7f643707bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e0dc92fb90 con 0x55e0dc923580 2024-05-03T16:49:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.277+0000 7f643707bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e0dc7dbad0 con 0x55e0dc928080 2024-05-03T16:49:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.277+0000 7f643707bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e0dc92fd10 con 0x55e0dc927760 2024-05-03T16:49:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.277+0000 7f643707bb80 10 client.0 _ll_register_callbacks cb 0x55e0dc81cc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:49:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.277+0000 7f6429c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc923580 0x55e0dc92ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.277+0000 7f6429c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc923580 0x55e0dc92ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49310/0 (socket says 172.21.15.81:49310) 2024-05-03T16:49:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.277+0000 7f6429c00700 1 -- 172.21.15.81:0/4078690622 learned_addr learned my addr 172.21.15.81:0/4078690622 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.278+0000 7f6429200700 1 --2- 172.21.15.81:0/4078690622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc927760 0x55e0dc92c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.278+0000 7f6429c00700 1 -- 172.21.15.81:0/4078690622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc927760 msgr2=0x55e0dc92c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.278+0000 7f642a600700 1 --2- 172.21.15.81:0/4078690622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc928080 0x55e0dc92c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.278+0000 7f6429c00700 1 --2- 172.21.15.81:0/4078690622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc927760 0x55e0dc92c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.278+0000 7f6429c00700 1 -- 172.21.15.81:0/4078690622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc928080 msgr2=0x55e0dc92c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.278+0000 7f6429c00700 1 --2- 172.21.15.81:0/4078690622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc928080 0x55e0dc92c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.278+0000 7f6429c00700 1 -- 172.21.15.81:0/4078690622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0dc83b3d0 con 0x55e0dc923580 2024-05-03T16:49:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.278+0000 7f6429200700 1 --2- 172.21.15.81:0/4078690622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc927760 0x55e0dc92c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:49:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.278+0000 7f642a600700 1 --2- 172.21.15.81:0/4078690622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc928080 0x55e0dc92c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:49:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.278+0000 7f6429c00700 1 --2- 172.21.15.81:0/4078690622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc923580 0x55e0dc92ef60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f641800cfd0 tx=0x7f641800fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2d5a20843e11d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.278+0000 7f640b400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:49:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.279+0000 7f640b400700 1 -- 172.21.15.81:0/4078690622 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64180e2400 con 0x55e0dc923580 2024-05-03T16:49:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.279+0000 7f640b400700 1 -- 172.21.15.81:0/4078690622 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f64180b21e0 con 0x55e0dc923580 2024-05-03T16:49:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.279+0000 7f643707bb80 1 -- 172.21.15.81:0/4078690622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64180cc0e0 con 0x55e0dc923580 2024-05-03T16:49:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.279+0000 7f640b400700 1 -- 172.21.15.81:0/4078690622 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f64180b23e0 con 0x55e0dc923580 2024-05-03T16:49:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.279+0000 7f643707bb80 10 client.15216 fetch_fsmap learned FSMap version 29 2024-05-03T16:49:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.279+0000 7f643707bb80 1 -- 172.21.15.81:0/4078690622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e0dc93a460 con 0x55e0dc923580 2024-05-03T16:49:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.279+0000 7f640b400700 1 -- 172.21.15.81:0/4078690622 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f64180cc0e0 con 0x55e0dc923580 2024-05-03T16:49:02.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.279+0000 7f640b400700 1 -- 172.21.15.81:0/4078690622 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f64180a5180 con 0x55e0dc923580 2024-05-03T16:49:02.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.280+0000 7f643707bb80 10 client.15216 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:49:02.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.280+0000 7f643707bb80 10 client.15216 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-03T16:49:02.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.280+0000 7f643707bb80 20 client.15216 populate_metadata read hostname 'smithi081' 2024-05-03T16:49:02.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.280+0000 7f643707bb80 1 --2- 172.21.15.81:0/4078690622 >> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] conn(0x55e0dc93c560 0x55e0dc93d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:02.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.280+0000 7f643707bb80 4 client.15216 mds_command: new command op to 34400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T16:49:02.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.280+0000 7f643707bb80 1 -- 172.21.15.81:0/4078690622 --> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0dc8f0180 con 0x55e0dc93c560 2024-05-03T16:49:02.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.280+0000 7f6429200700 1 --2- 172.21.15.81:0/4078690622 >> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] conn(0x55e0dc93c560 0x55e0dc93d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:02.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.281+0000 7f6429200700 1 --2- 172.21.15.81:0/4078690622 >> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] conn(0x55e0dc93c560 0x55e0dc93d9d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=40c1e99d729a2767 server_cookie=2c9a4945d818b149 in_seq=0 out_seq=0 2024-05-03T16:49:02.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.281+0000 7f640b400700 10 client.15216 ms_handle_connect on v2:172.21.15.134:6832/749392804 2024-05-03T16:49:02.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.283+0000 7f640b400700 1 -- 172.21.15.81:0/4078690622 <== mds.3 v2:172.21.15.134:6832/749392804 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e0dc8f0180 con 0x55e0dc93c560 2024-05-03T16:49:02.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.284+0000 7f640b400700 10 client.15216 handle_command_reply: tid=0 2024-05-03T16:49:02.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.284+0000 7f643707bb80 1 client.15216 shutdown 2024-05-03T16:49:02.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.284+0000 7f643707bb80 1 -- 172.21.15.81:0/4078690622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc923580 msgr2=0x55e0dc92ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:02.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.284+0000 7f643707bb80 1 --2- 172.21.15.81:0/4078690622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc923580 0x55e0dc92ef60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f641800cfd0 tx=0x7f641800fba0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.284+0000 7f643707bb80 1 -- 172.21.15.81:0/4078690622 shutdown_connections 2024-05-03T16:49:02.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.284+0000 7f643707bb80 1 --2- 172.21.15.81:0/4078690622 >> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] conn(0x55e0dc93c560 0x55e0dc93d9d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.284+0000 7f643707bb80 1 --2- 172.21.15.81:0/4078690622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc928080 0x55e0dc92c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.284+0000 7f643707bb80 1 --2- 172.21.15.81:0/4078690622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc923580 0x55e0dc92ef60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.284+0000 7f643707bb80 1 --2- 172.21.15.81:0/4078690622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc927760 0x55e0dc92c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.284+0000 7f643707bb80 1 -- 172.21.15.81:0/4078690622 >> 172.21.15.81:0/4078690622 conn(0x55e0dc851b10 msgr2=0x55e0dc91c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:02.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.284+0000 7f640b400700 0 client.15216 ms_handle_reset on v2:172.21.15.134:6832/749392804 2024-05-03T16:49:02.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.284+0000 7f643707bb80 1 -- 172.21.15.81:0/4078690622 shutdown_connections 2024-05-03T16:49:02.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.284+0000 7f643707bb80 1 -- 172.21.15.81:0/4078690622 wait complete. 2024-05-03T16:49:02.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.284+0000 7f643707bb80 20 client.15216 trim_cache size 0 max 16384 2024-05-03T16:49:02.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.307+0000 7f643707bb80 1 Processor -- start 2024-05-03T16:49:02.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.307+0000 7f643707bb80 1 -- start start 2024-05-03T16:49:02.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.308+0000 7f643707bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc923580 0x55e0dc91d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:02.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.308+0000 7f643707bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc927760 0x55e0dc946e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:02.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.308+0000 7f643707bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc928080 0x55e0dc947370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:02.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.308+0000 7f643707bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e0dc93bd10 con 0x55e0dc928080 2024-05-03T16:49:02.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.308+0000 7f643707bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e0dc93c3e0 con 0x55e0dc923580 2024-05-03T16:49:02.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.308+0000 7f643707bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e0dc93cab0 con 0x55e0dc927760 2024-05-03T16:49:02.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.308+0000 7f642a600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc928080 0x55e0dc947370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:02.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.308+0000 7f642a600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc928080 0x55e0dc947370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49322/0 (socket says 172.21.15.81:49322) 2024-05-03T16:49:02.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.308+0000 7f642a600700 1 -- 172.21.15.81:0/1176282430 learned_addr learned my addr 172.21.15.81:0/1176282430 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:02.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.308+0000 7f6429c00700 1 --2- 172.21.15.81:0/1176282430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc923580 0x55e0dc91d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:02.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.308+0000 7f6429200700 1 --2- 172.21.15.81:0/1176282430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc927760 0x55e0dc946e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:02.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.309+0000 7f642a600700 1 -- 172.21.15.81:0/1176282430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc927760 msgr2=0x55e0dc946e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:02.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.309+0000 7f642a600700 1 --2- 172.21.15.81:0/1176282430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc927760 0x55e0dc946e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.309+0000 7f642a600700 1 -- 172.21.15.81:0/1176282430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc923580 msgr2=0x55e0dc91d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:02.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.309+0000 7f642a600700 1 --2- 172.21.15.81:0/1176282430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc923580 0x55e0dc91d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.309+0000 7f642a600700 1 -- 172.21.15.81:0/1176282430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0dc92eba0 con 0x55e0dc928080 2024-05-03T16:49:02.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.309+0000 7f6429c00700 1 --2- 172.21.15.81:0/1176282430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc923580 0x55e0dc91d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:49:02.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:01 smithi146 ceph-mon[32357]: pgmap v529: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:02.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.309+0000 7f642a600700 1 --2- 172.21.15.81:0/1176282430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc928080 0x55e0dc947370 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f641c0093d0 tx=0x7f641c020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6da48962e4119d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:02.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.309+0000 7f6416000700 1 -- 172.21.15.81:0/1176282430 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c007ac0 con 0x55e0dc928080 2024-05-03T16:49:02.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.309+0000 7f6416000700 1 -- 172.21.15.81:0/1176282430 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f641c025070 con 0x55e0dc928080 2024-05-03T16:49:02.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.310+0000 7f6416000700 1 -- 172.21.15.81:0/1176282430 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c01e460 con 0x55e0dc928080 2024-05-03T16:49:02.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.310+0000 7f643707bb80 1 -- 172.21.15.81:0/1176282430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc928080 msgr2=0x55e0dc947370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:02.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.310+0000 7f643707bb80 1 --2- 172.21.15.81:0/1176282430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc928080 0x55e0dc947370 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f641c0093d0 tx=0x7f641c020040 comp rx=0 tx=0).stop 2024-05-03T16:49:02.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.310+0000 7f643707bb80 1 -- 172.21.15.81:0/1176282430 shutdown_connections 2024-05-03T16:49:02.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.310+0000 7f643707bb80 1 --2- 172.21.15.81:0/1176282430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc928080 0x55e0dc947370 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.310+0000 7f643707bb80 1 --2- 172.21.15.81:0/1176282430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc923580 0x55e0dc91d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.310+0000 7f643707bb80 1 --2- 172.21.15.81:0/1176282430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc927760 0x55e0dc946e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.310+0000 7f643707bb80 1 -- 172.21.15.81:0/1176282430 >> 172.21.15.81:0/1176282430 conn(0x55e0dc851b10 msgr2=0x55e0dc922ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:02.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.310+0000 7f643707bb80 1 -- 172.21.15.81:0/1176282430 shutdown_connections 2024-05-03T16:49:02.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.311+0000 7f643707bb80 1 -- 172.21.15.81:0/1176282430 wait complete. 2024-05-03T16:49:02.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.311+0000 7f643707bb80 1 -- start start 2024-05-03T16:49:02.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.311+0000 7f643707bb80 1 Processor -- start 2024-05-03T16:49:02.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.312+0000 7f643707bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc923580 0x55e0dc942a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:02.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.312+0000 7f643707bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc927760 0x55e0dc942f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:02.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.312+0000 7f643707bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc928080 0x55e0dc9434a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:02.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.312+0000 7f643707bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e0dc93d850 con 0x55e0dc928080 2024-05-03T16:49:02.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.312+0000 7f643707bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e0dc93d180 con 0x55e0dc923580 2024-05-03T16:49:02.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.312+0000 7f643707bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e0dc93df20 con 0x55e0dc927760 2024-05-03T16:49:02.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.312+0000 7f643707bb80 10 client.0 _ll_register_callbacks cb 0x55e0dc81cc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:49:02.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.312+0000 7f642a600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc928080 0x55e0dc9434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:02.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.312+0000 7f642a600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc928080 0x55e0dc9434a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49336/0 (socket says 172.21.15.81:49336) 2024-05-03T16:49:02.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.312+0000 7f642a600700 1 -- 172.21.15.81:0/2783088 learned_addr learned my addr 172.21.15.81:0/2783088 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:02.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.312+0000 7f6429c00700 1 --2- 172.21.15.81:0/2783088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc923580 0x55e0dc942a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:02.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.312+0000 7f6429200700 1 --2- 172.21.15.81:0/2783088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc927760 0x55e0dc942f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:02.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.313+0000 7f642a600700 1 -- 172.21.15.81:0/2783088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc927760 msgr2=0x55e0dc942f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:02.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.313+0000 7f642a600700 1 --2- 172.21.15.81:0/2783088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc927760 0x55e0dc942f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.313+0000 7f642a600700 1 -- 172.21.15.81:0/2783088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc923580 msgr2=0x55e0dc942a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:02.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.313+0000 7f642a600700 1 --2- 172.21.15.81:0/2783088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc923580 0x55e0dc942a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.313+0000 7f642a600700 1 -- 172.21.15.81:0/2783088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0dc9a6a80 con 0x55e0dc928080 2024-05-03T16:49:02.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.313+0000 7f6429c00700 1 --2- 172.21.15.81:0/2783088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc923580 0x55e0dc942a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:49:02.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.313+0000 7f642a600700 1 --2- 172.21.15.81:0/2783088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc928080 0x55e0dc9434a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f641c00d010 tx=0x7f641c005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f891d17a785c0e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:02.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.313+0000 7f640b400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:49:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.313+0000 7f640b400700 1 -- 172.21.15.81:0/2783088 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c039030 con 0x55e0dc928080 2024-05-03T16:49:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.313+0000 7f643707bb80 1 -- 172.21.15.81:0/2783088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f641c025070 con 0x55e0dc928080 2024-05-03T16:49:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.313+0000 7f640b400700 1 -- 172.21.15.81:0/2783088 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f641c005490 con 0x55e0dc928080 2024-05-03T16:49:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.313+0000 7f640b400700 1 -- 172.21.15.81:0/2783088 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f641c046050 con 0x55e0dc928080 2024-05-03T16:49:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.313+0000 7f643707bb80 10 client.15222 fetch_fsmap learned FSMap version 29 2024-05-03T16:49:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.313+0000 7f643707bb80 1 -- 172.21.15.81:0/2783088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e0dc9a7d40 con 0x55e0dc928080 2024-05-03T16:49:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.314+0000 7f640b400700 1 -- 172.21.15.81:0/2783088 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f641c025070 con 0x55e0dc928080 2024-05-03T16:49:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.314+0000 7f640b400700 1 -- 172.21.15.81:0/2783088 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f641c011070 con 0x55e0dc928080 2024-05-03T16:49:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.314+0000 7f643707bb80 10 client.15222 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:49:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.314+0000 7f643707bb80 10 client.15222 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-03T16:49:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.314+0000 7f643707bb80 20 client.15222 populate_metadata read hostname 'smithi081' 2024-05-03T16:49:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.314+0000 7f643707bb80 1 --2- 172.21.15.81:0/2783088 >> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] conn(0x55e0dc9ac440 0x55e0dc9ab150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.314+0000 7f643707bb80 4 client.15222 mds_command: new command op to 34400 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T16:49:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.314+0000 7f643707bb80 1 -- 172.21.15.81:0/2783088 --> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] -- command(tid 0: {"prefix": "status"}) -- 0x55e0dc8833b0 con 0x55e0dc9ac440 2024-05-03T16:49:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.315+0000 7f6429c00700 1 --2- 172.21.15.81:0/2783088 >> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] conn(0x55e0dc9ac440 0x55e0dc9ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.316+0000 7f6429c00700 1 --2- 172.21.15.81:0/2783088 >> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] conn(0x55e0dc9ac440 0x55e0dc9ab150 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=80f5deef18290de9 server_cookie=db7888ed1eec8ec4 in_seq=0 out_seq=0 2024-05-03T16:49:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.316+0000 7f640b400700 10 client.15222 ms_handle_connect on v2:172.21.15.134:6832/749392804 2024-05-03T16:49:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.316+0000 7f640b400700 1 -- 172.21.15.81:0/2783088 <== mds.3 v2:172.21.15.134:6832/749392804 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55e0dc8833b0 con 0x55e0dc9ac440 2024-05-03T16:49:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.316+0000 7f640b400700 10 client.15222 handle_command_reply: tid=0 2024-05-03T16:49:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.316+0000 7f643707bb80 1 client.15222 shutdown 2024-05-03T16:49:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.317+0000 7f643707bb80 1 -- 172.21.15.81:0/2783088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc928080 msgr2=0x55e0dc9434a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.317+0000 7f643707bb80 1 --2- 172.21.15.81:0/2783088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc928080 0x55e0dc9434a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f641c00d010 tx=0x7f641c005ae0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.317+0000 7f643707bb80 1 -- 172.21.15.81:0/2783088 shutdown_connections 2024-05-03T16:49:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.317+0000 7f643707bb80 1 --2- 172.21.15.81:0/2783088 >> [v2:172.21.15.134:6832/749392804,v1:172.21.15.134:6833/749392804] conn(0x55e0dc9ac440 0x55e0dc9ab150 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.317+0000 7f643707bb80 1 --2- 172.21.15.81:0/2783088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0dc928080 0x55e0dc9434a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.317+0000 7f643707bb80 1 --2- 172.21.15.81:0/2783088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e0dc923580 0x55e0dc942a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.317+0000 7f643707bb80 1 --2- 172.21.15.81:0/2783088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0dc927760 0x55e0dc942f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.317+0000 7f640b400700 0 client.15222 ms_handle_reset on v2:172.21.15.134:6832/749392804 2024-05-03T16:49:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.317+0000 7f643707bb80 1 -- 172.21.15.81:0/2783088 >> 172.21.15.81:0/2783088 conn(0x55e0dc851b10 msgr2=0x55e0dc92b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.317+0000 7f643707bb80 1 -- 172.21.15.81:0/2783088 shutdown_connections 2024-05-03T16:49:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.317+0000 7f643707bb80 1 -- 172.21.15.81:0/2783088 wait complete. 2024-05-03T16:49:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.317+0000 7f643707bb80 20 client.15222 trim_cache size 0 max 16384 2024-05-03T16:49:02.323 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-03T16:49:02.323 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8988869e-096a-11ef-bc97-c7b262605968", 2024-05-03T16:49:02.323 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 3, 2024-05-03T16:49:02.323 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 34400, 2024-05-03T16:49:02.323 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-05-03T16:49:02.323 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-05-03T16:49:02.323 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-05-03T16:49:02.323 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 216.737988917, 2024-05-03T16:49:02.323 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 29, 2024-05-03T16:49:02.323 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 91, 2024-05-03T16:49:02.323 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 91, 2024-05-03T16:49:02.323 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 367.886031043 2024-05-03T16:49:02.323 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-03T16:49:02.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.318+0000 7f642c600700 1 -- 172.21.15.81:0/663417800 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f640c0b2990 msgr2=0x7f640c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:02.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.318+0000 7f642c600700 1 --2- 172.21.15.81:0/663417800 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f640c0b2990 0x7f640c0b4e50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f641c00b070 tx=0x7f641c009d60 comp rx=0 tx=0).stop 2024-05-03T16:49:02.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.318+0000 7f642c600700 1 -- 172.21.15.81:0/663417800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64241056c0 msgr2=0x7f64241a1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:02.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.318+0000 7f642c600700 1 --2- 172.21.15.81:0/663417800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64241056c0 0x7f64241a1830 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f641800c9b0 tx=0x7f641800cd70 comp rx=0 tx=0).stop 2024-05-03T16:49:02.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.318+0000 7f642c600700 1 -- 172.21.15.81:0/663417800 shutdown_connections 2024-05-03T16:49:02.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.318+0000 7f642c600700 1 --2- 172.21.15.81:0/663417800 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f640c0b2990 0x7f640c0b4e50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.318+0000 7f642c600700 1 --2- 172.21.15.81:0/663417800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f642410b6c0 0x7f642419b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.318+0000 7f642c600700 1 --2- 172.21.15.81:0/663417800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64241056c0 0x7f64241a1830 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.318+0000 7f642c600700 1 --2- 172.21.15.81:0/663417800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6424106080 0x7f64241a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:02.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.318+0000 7f642c600700 1 -- 172.21.15.81:0/663417800 >> 172.21.15.81:0/663417800 conn(0x7f6424101170 msgr2=0x7f64241016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:02.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.318+0000 7f642c600700 1 -- 172.21.15.81:0/663417800 shutdown_connections 2024-05-03T16:49:02.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:02.318+0000 7f642c600700 1 -- 172.21.15.81:0/663417800 wait complete. 2024-05-03T16:49:02.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:01 smithi134 ceph-mon[31708]: pgmap v529: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:03.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell mds.e status 2024-05-03T16:49:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:49:04.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:03 smithi081 ceph-mon[28640]: pgmap v530: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:49:04.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:04 smithi146 ceph-mon[32357]: pgmap v530: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:49:04.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:04 smithi134 ceph-mon[31708]: pgmap v530: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:49:06.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.174+0000 7f5e2b400700 1 -- 172.21.15.81:0/197994564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e24114670 msgr2=0x7f5e24116a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:06.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.174+0000 7f5e2b400700 1 --2- 172.21.15.81:0/197994564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e24114670 0x7f5e24116a60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00b0a0 tx=0x7f5e1c00b3b0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.174+0000 7f5e2b400700 1 -- 172.21.15.81:0/197994564 shutdown_connections 2024-05-03T16:49:06.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.174+0000 7f5e2b400700 1 --2- 172.21.15.81:0/197994564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e24114670 0x7f5e24116a60 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.174+0000 7f5e2b400700 1 --2- 172.21.15.81:0/197994564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e240756d0 0x7f5e24075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.174+0000 7f5e2b400700 1 --2- 172.21.15.81:0/197994564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e24075ff0 0x7f5e24114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.174+0000 7f5e2b400700 1 -- 172.21.15.81:0/197994564 >> 172.21.15.81:0/197994564 conn(0x7f5e2407a600 msgr2=0x7f5e2407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.174+0000 7f5e2b400700 1 -- 172.21.15.81:0/197994564 shutdown_connections 2024-05-03T16:49:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.175+0000 7f5e2b400700 1 -- 172.21.15.81:0/197994564 wait complete. 2024-05-03T16:49:06.180 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:06 smithi081 ceph-mon[28640]: pgmap v531: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:06.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.175+0000 7f5e2b400700 1 Processor -- start 2024-05-03T16:49:06.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.176+0000 7f5e2b400700 1 -- start start 2024-05-03T16:49:06.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.176+0000 7f5e2b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e240756d0 0x7f5e241a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:06.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.176+0000 7f5e2b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e24075ff0 0x7f5e241a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:06.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.176+0000 7f5e2b400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e24114670 0x7f5e241a49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:06.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.176+0000 7f5e2b400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5e24119b60 con 0x7f5e24075ff0 2024-05-03T16:49:06.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.176+0000 7f5e2b400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5e241199e0 con 0x7f5e240756d0 2024-05-03T16:49:06.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.176+0000 7f5e2b400700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5e24119ce0 con 0x7f5e24114670 2024-05-03T16:49:06.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.176+0000 7f5e23e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e24075ff0 0x7f5e241a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:06.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.177+0000 7f5e23e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e24075ff0 0x7f5e241a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41686/0 (socket says 172.21.15.81:41686) 2024-05-03T16:49:06.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.177+0000 7f5e23e00700 1 -- 172.21.15.81:0/1076353033 learned_addr learned my addr 172.21.15.81:0/1076353033 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:06.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.177+0000 7f5e28a00700 1 --2- 172.21.15.81:0/1076353033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e240756d0 0x7f5e241a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:06.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.177+0000 7f5e29400700 1 --2- 172.21.15.81:0/1076353033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e24114670 0x7f5e241a49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:06.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.177+0000 7f5e23e00700 1 -- 172.21.15.81:0/1076353033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e24114670 msgr2=0x7f5e241a49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:06.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.177+0000 7f5e23e00700 1 --2- 172.21.15.81:0/1076353033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e24114670 0x7f5e241a49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.177+0000 7f5e23e00700 1 -- 172.21.15.81:0/1076353033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e240756d0 msgr2=0x7f5e241a00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:06.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.177+0000 7f5e23e00700 1 --2- 172.21.15.81:0/1076353033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e240756d0 0x7f5e241a00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.177+0000 7f5e23e00700 1 -- 172.21.15.81:0/1076353033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e241a5100 con 0x7f5e24075ff0 2024-05-03T16:49:06.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.177+0000 7f5e23e00700 1 --2- 172.21.15.81:0/1076353033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e24075ff0 0x7f5e241a0630 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400d980 tx=0x7f5e1400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:06.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.178+0000 7f5e21600700 1 -- 172.21.15.81:0/1076353033 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e14017070 con 0x7f5e24075ff0 2024-05-03T16:49:06.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.178+0000 7f5e21600700 1 -- 172.21.15.81:0/1076353033 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e14005020 con 0x7f5e24075ff0 2024-05-03T16:49:06.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.178+0000 7f5e2b400700 1 -- 172.21.15.81:0/1076353033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e241a5390 con 0x7f5e24075ff0 2024-05-03T16:49:06.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.178+0000 7f5e21600700 1 -- 172.21.15.81:0/1076353033 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e14009ab0 con 0x7f5e24075ff0 2024-05-03T16:49:06.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.178+0000 7f5e2b400700 1 -- 172.21.15.81:0/1076353033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e241acc70 con 0x7f5e24075ff0 2024-05-03T16:49:06.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.183+0000 7f5e21600700 1 -- 172.21.15.81:0/1076353033 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5e140051d0 con 0x7f5e24075ff0 2024-05-03T16:49:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.184+0000 7f5e35e28b80 1 Processor -- start 2024-05-03T16:49:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.184+0000 7f5e35e28b80 1 -- start start 2024-05-03T16:49:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.184+0000 7f5e35e28b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109307760 0x55a109307b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.184+0000 7f5e35e28b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109308080 0x55a109302f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.184+0000 7f5e35e28b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109303580 0x55a1093039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.184+0000 7f5e35e28b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a1092559d0 con 0x55a109308080 2024-05-03T16:49:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.184+0000 7f5e35e28b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a1091f3710 con 0x55a109307760 2024-05-03T16:49:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.184+0000 7f5e35e28b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a109251990 con 0x55a109303580 2024-05-03T16:49:06.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.185+0000 7f5e28a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109308080 0x55a109302f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:06.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.185+0000 7f5e28a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109308080 0x55a109302f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41702/0 (socket says 172.21.15.81:41702) 2024-05-03T16:49:06.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.185+0000 7f5e28a00700 1 -- 172.21.15.81:0/2156851969 learned_addr learned my addr 172.21.15.81:0/2156851969 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:06.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.185+0000 7f5e21600700 1 --2- 172.21.15.81:0/1076353033 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5e0c0b2910 0x7f5e0c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.185+0000 7f5e29400700 1 --2- 172.21.15.81:0/2156851969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109307760 0x55a109307b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.185+0000 7f5e21600700 1 -- 172.21.15.81:0/1076353033 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f5e140e25a0 con 0x7f5e24075ff0 2024-05-03T16:49:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.185+0000 7f5e23e00700 1 --2- 172.21.15.81:0/2156851969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109303580 0x55a1093039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.185+0000 7f5e28a00700 1 -- 172.21.15.81:0/2156851969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109303580 msgr2=0x55a1093039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.185+0000 7f5e28a00700 1 --2- 172.21.15.81:0/2156851969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109303580 0x55a1093039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.185+0000 7f5e28a00700 1 -- 172.21.15.81:0/2156851969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109307760 msgr2=0x55a109307b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.185+0000 7f5e28a00700 1 --2- 172.21.15.81:0/2156851969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109307760 0x55a109307b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.185+0000 7f5e28a00700 1 -- 172.21.15.81:0/2156851969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1091a2880 con 0x55a109308080 2024-05-03T16:49:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.186+0000 7f5e29400700 1 --2- 172.21.15.81:0/1076353033 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5e0c0b2910 0x7f5e0c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.186+0000 7f5e28a00700 1 --2- 172.21.15.81:0/2156851969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109308080 0x55a109302f60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800bd70 tx=0x7f5e1800f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be359646678afff server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.186+0000 7f5e12000700 1 -- 172.21.15.81:0/2156851969 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18015070 con 0x55a109308080 2024-05-03T16:49:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.186+0000 7f5e12000700 1 -- 172.21.15.81:0/2156851969 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e1800fe50 con 0x55a109308080 2024-05-03T16:49:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.186+0000 7f5e12000700 1 -- 172.21.15.81:0/2156851969 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e180116a0 con 0x55a109308080 2024-05-03T16:49:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.187+0000 7f5e35e28b80 1 -- 172.21.15.81:0/2156851969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109308080 msgr2=0x55a109302f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.187+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/2156851969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109308080 0x55a109302f60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800bd70 tx=0x7f5e1800f640 comp rx=0 tx=0).stop 2024-05-03T16:49:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.187+0000 7f5e29400700 1 --2- 172.21.15.81:0/1076353033 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5e0c0b2910 0x7f5e0c0b4dd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00b830 tx=0x7f5e1c0099e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.187+0000 7f5e35e28b80 1 -- 172.21.15.81:0/2156851969 shutdown_connections 2024-05-03T16:49:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.187+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/2156851969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109303580 0x55a1093039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.187+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/2156851969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109307760 0x55a109307b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.187+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/2156851969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109308080 0x55a109302f60 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.187+0000 7f5e35e28b80 1 -- 172.21.15.81:0/2156851969 >> 172.21.15.81:0/2156851969 conn(0x55a109231b10 msgr2=0x55a1092fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.187+0000 7f5e35e28b80 1 -- 172.21.15.81:0/2156851969 shutdown_connections 2024-05-03T16:49:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.187+0000 7f5e35e28b80 1 -- 172.21.15.81:0/2156851969 wait complete. 2024-05-03T16:49:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.188+0000 7f5e35e28b80 1 -- start start 2024-05-03T16:49:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.188+0000 7f5e35e28b80 1 Processor -- start 2024-05-03T16:49:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.188+0000 7f5e35e28b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109303580 0x55a10930edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.189+0000 7f5e35e28b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 0x55a10930c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.189+0000 7f5e35e28b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109308080 0x55a10930c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.189+0000 7f5e35e28b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a10930fc50 con 0x55a109307760 2024-05-03T16:49:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.189+0000 7f5e35e28b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a1091bbad0 con 0x55a109308080 2024-05-03T16:49:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.189+0000 7f5e35e28b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a10930fdd0 con 0x55a109303580 2024-05-03T16:49:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.189+0000 7f5e35e28b80 10 client.0 _ll_register_callbacks cb 0x55a1091fcc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:49:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.189+0000 7f5e23e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 0x55a10930c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.189+0000 7f5e23e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 0x55a10930c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41714/0 (socket says 172.21.15.81:41714) 2024-05-03T16:49:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.189+0000 7f5e23e00700 1 -- 172.21.15.81:0/1495552391 learned_addr learned my addr 172.21.15.81:0/1495552391 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:06.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.189+0000 7f5e29400700 1 --2- 172.21.15.81:0/1495552391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109308080 0x55a10930c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:06.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.189+0000 7f5e28a00700 1 --2- 172.21.15.81:0/1495552391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109303580 0x55a10930edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:06.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.189+0000 7f5e23e00700 1 -- 172.21.15.81:0/1495552391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109303580 msgr2=0x55a10930edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:06.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.189+0000 7f5e23e00700 1 --2- 172.21.15.81:0/1495552391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109303580 0x55a10930edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.189+0000 7f5e23e00700 1 -- 172.21.15.81:0/1495552391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109308080 msgr2=0x55a10930c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:06.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.189+0000 7f5e23e00700 1 --2- 172.21.15.81:0/1495552391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109308080 0x55a10930c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.189+0000 7f5e23e00700 1 -- 172.21.15.81:0/1495552391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a10921b3d0 con 0x55a109307760 2024-05-03T16:49:06.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.190+0000 7f5e23e00700 1 --2- 172.21.15.81:0/1495552391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 0x55a10930c1e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5e140a6920 tx=0x7f5e14005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7dcd6b127f37ae server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:06.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.190+0000 7f5e06a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:49:06.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.190+0000 7f5e06a00700 1 -- 172.21.15.81:0/1495552391 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e140ada60 con 0x55a109307760 2024-05-03T16:49:06.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.190+0000 7f5e06a00700 1 -- 172.21.15.81:0/1495552391 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f5e140910c0 con 0x55a109307760 2024-05-03T16:49:06.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.190+0000 7f5e35e28b80 1 -- 172.21.15.81:0/1495552391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e1800fe50 con 0x55a109307760 2024-05-03T16:49:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.190+0000 7f5e06a00700 1 -- 172.21.15.81:0/1495552391 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5e140912c0 con 0x55a109307760 2024-05-03T16:49:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.190+0000 7f5e35e28b80 10 client.15234 fetch_fsmap learned FSMap version 29 2024-05-03T16:49:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.190+0000 7f5e35e28b80 1 -- 172.21.15.81:0/1495552391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a10931a430 con 0x55a109307760 2024-05-03T16:49:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.191+0000 7f5e06a00700 1 -- 172.21.15.81:0/1495552391 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e1800fe50 con 0x55a109307760 2024-05-03T16:49:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.191+0000 7f5e06a00700 1 -- 172.21.15.81:0/1495552391 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5e140b2080 con 0x55a109307760 2024-05-03T16:49:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.191+0000 7f5e35e28b80 10 client.15234 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:49:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.191+0000 7f5e35e28b80 10 client.15234 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-03T16:49:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.191+0000 7f5e35e28b80 20 client.15234 populate_metadata read hostname 'smithi081' 2024-05-03T16:49:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.191+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/1495552391 >> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] conn(0x55a10931ca10 0x55a10931de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.191+0000 7f5e35e28b80 4 client.15234 mds_command: new command op to 34418 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T16:49:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.191+0000 7f5e35e28b80 1 -- 172.21.15.81:0/1495552391 --> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1092d0180 con 0x55a10931ca10 2024-05-03T16:49:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.192+0000 7f5e28a00700 1 --2- 172.21.15.81:0/1495552391 >> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] conn(0x55a10931ca10 0x55a10931de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:06.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.193+0000 7f5e28a00700 1 --2- 172.21.15.81:0/1495552391 >> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] conn(0x55a10931ca10 0x55a10931de80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=42eaddc0075ea4bd server_cookie=4ae0eb263d59be63 in_seq=0 out_seq=0 2024-05-03T16:49:06.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.193+0000 7f5e06a00700 10 client.15234 ms_handle_connect on v2:172.21.15.134:6834/3681203129 2024-05-03T16:49:06.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.195+0000 7f5e06a00700 1 -- 172.21.15.81:0/1495552391 <== mds.2 v2:172.21.15.134:6834/3681203129 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a1092d0180 con 0x55a10931ca10 2024-05-03T16:49:06.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.195+0000 7f5e06a00700 10 client.15234 handle_command_reply: tid=0 2024-05-03T16:49:06.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.195+0000 7f5e35e28b80 1 client.15234 shutdown 2024-05-03T16:49:06.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.195+0000 7f5e35e28b80 1 -- 172.21.15.81:0/1495552391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 msgr2=0x55a10930c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:06.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.195+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/1495552391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 0x55a10930c1e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5e140a6920 tx=0x7f5e14005720 comp rx=0 tx=0).stop 2024-05-03T16:49:06.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.195+0000 7f5e35e28b80 1 -- 172.21.15.81:0/1495552391 shutdown_connections 2024-05-03T16:49:06.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.195+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/1495552391 >> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] conn(0x55a10931ca10 0x55a10931de80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.196+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/1495552391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109303580 0x55a10930edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.196+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/1495552391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109308080 0x55a10930c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.196+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/1495552391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 0x55a10930c1e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.196+0000 7f5e06a00700 0 client.15234 ms_handle_reset on v2:172.21.15.134:6834/3681203129 2024-05-03T16:49:06.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.196+0000 7f5e35e28b80 1 -- 172.21.15.81:0/1495552391 >> 172.21.15.81:0/1495552391 conn(0x55a109231b10 msgr2=0x55a109308db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:06.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.196+0000 7f5e35e28b80 1 -- 172.21.15.81:0/1495552391 shutdown_connections 2024-05-03T16:49:06.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.196+0000 7f5e35e28b80 1 -- 172.21.15.81:0/1495552391 wait complete. 2024-05-03T16:49:06.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.196+0000 7f5e35e28b80 20 client.15234 trim_cache size 0 max 16384 2024-05-03T16:49:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.218+0000 7f5e35e28b80 1 Processor -- start 2024-05-03T16:49:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.219+0000 7f5e35e28b80 1 -- start start 2024-05-03T16:49:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.219+0000 7f5e35e28b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109303580 0x55a1092ff4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.219+0000 7f5e35e28b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 0x55a10930ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.219+0000 7f5e35e28b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109308080 0x55a10930b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.219+0000 7f5e35e28b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a10931c1c0 con 0x55a109307760 2024-05-03T16:49:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.219+0000 7f5e35e28b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a10931c890 con 0x55a109303580 2024-05-03T16:49:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.219+0000 7f5e35e28b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a10931cf60 con 0x55a109308080 2024-05-03T16:49:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.219+0000 7f5e23e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 0x55a10930ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.219+0000 7f5e23e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 0x55a10930ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41730/0 (socket says 172.21.15.81:41730) 2024-05-03T16:49:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.219+0000 7f5e23e00700 1 -- 172.21.15.81:0/1085557269 learned_addr learned my addr 172.21.15.81:0/1085557269 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.220+0000 7f5e28a00700 1 --2- 172.21.15.81:0/1085557269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109303580 0x55a1092ff4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.220+0000 7f5e29400700 1 --2- 172.21.15.81:0/1085557269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109308080 0x55a10930b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.220+0000 7f5e23e00700 1 -- 172.21.15.81:0/1085557269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109308080 msgr2=0x55a10930b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.220+0000 7f5e23e00700 1 --2- 172.21.15.81:0/1085557269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109308080 0x55a10930b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.220+0000 7f5e23e00700 1 -- 172.21.15.81:0/1085557269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109303580 msgr2=0x55a1092ff4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.220+0000 7f5e23e00700 1 --2- 172.21.15.81:0/1085557269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109303580 0x55a1092ff4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.220+0000 7f5e23e00700 1 -- 172.21.15.81:0/1085557269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1093190d0 con 0x55a109307760 2024-05-03T16:49:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.220+0000 7f5e29400700 1 --2- 172.21.15.81:0/1085557269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109308080 0x55a10930b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T16:49:06.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.220+0000 7f5e23e00700 1 --2- 172.21.15.81:0/1085557269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 0x55a10930ab30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5e14004ff0 tx=0x7f5e140057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef1b6f86280d132 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:06.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.220+0000 7f5e11600700 1 -- 172.21.15.81:0/1085557269 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e14014070 con 0x55a109307760 2024-05-03T16:49:06.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.220+0000 7f5e11600700 1 -- 172.21.15.81:0/1085557269 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e140b2510 con 0x55a109307760 2024-05-03T16:49:06.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.220+0000 7f5e11600700 1 -- 172.21.15.81:0/1085557269 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e140b21f0 con 0x55a109307760 2024-05-03T16:49:06.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.221+0000 7f5e35e28b80 1 -- 172.21.15.81:0/1085557269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 msgr2=0x55a10930ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:06.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.221+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/1085557269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 0x55a10930ab30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5e14004ff0 tx=0x7f5e140057c0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.221+0000 7f5e35e28b80 1 -- 172.21.15.81:0/1085557269 shutdown_connections 2024-05-03T16:49:06.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.221+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/1085557269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109308080 0x55a10930b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.221+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/1085557269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109303580 0x55a1092ff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.221+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/1085557269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 0x55a10930ab30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.221+0000 7f5e35e28b80 1 -- 172.21.15.81:0/1085557269 >> 172.21.15.81:0/1085557269 conn(0x55a109231b10 msgr2=0x55a10930c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:06.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.221+0000 7f5e35e28b80 1 -- 172.21.15.81:0/1085557269 shutdown_connections 2024-05-03T16:49:06.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.221+0000 7f5e35e28b80 1 -- 172.21.15.81:0/1085557269 wait complete. 2024-05-03T16:49:06.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.222+0000 7f5e35e28b80 1 -- start start 2024-05-03T16:49:06.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.222+0000 7f5e35e28b80 1 Processor -- start 2024-05-03T16:49:06.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.222+0000 7f5e35e28b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109303580 0x55a109327300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:06.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.222+0000 7f5e35e28b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 0x55a109327840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:06.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.223+0000 7f5e35e28b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109308080 0x55a1093222b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:06.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.223+0000 7f5e35e28b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a10931dd00 con 0x55a109307760 2024-05-03T16:49:06.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.223+0000 7f5e35e28b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a10931d630 con 0x55a109303580 2024-05-03T16:49:06.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.223+0000 7f5e35e28b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a10931e3d0 con 0x55a109308080 2024-05-03T16:49:06.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.223+0000 7f5e35e28b80 10 client.0 _ll_register_callbacks cb 0x55a1091fcc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:49:06.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.223+0000 7f5e23e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 0x55a109327840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:06.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.223+0000 7f5e23e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 0x55a109327840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41746/0 (socket says 172.21.15.81:41746) 2024-05-03T16:49:06.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.223+0000 7f5e23e00700 1 -- 172.21.15.81:0/3061089445 learned_addr learned my addr 172.21.15.81:0/3061089445 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.223+0000 7f5e28a00700 1 --2- 172.21.15.81:0/3061089445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109303580 0x55a109327300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.223+0000 7f5e29400700 1 --2- 172.21.15.81:0/3061089445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109308080 0x55a1093222b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.223+0000 7f5e23e00700 1 -- 172.21.15.81:0/3061089445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109308080 msgr2=0x55a1093222b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.223+0000 7f5e23e00700 1 --2- 172.21.15.81:0/3061089445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109308080 0x55a1093222b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.223+0000 7f5e23e00700 1 -- 172.21.15.81:0/3061089445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109303580 msgr2=0x55a109327300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.223+0000 7f5e23e00700 1 --2- 172.21.15.81:0/3061089445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109303580 0x55a109327300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.223+0000 7f5e23e00700 1 -- 172.21.15.81:0/3061089445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1093228f0 con 0x55a109307760 2024-05-03T16:49:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.223+0000 7f5e28a00700 1 --2- 172.21.15.81:0/3061089445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109303580 0x55a109327300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:49:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.224+0000 7f5e23e00700 1 --2- 172.21.15.81:0/3061089445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 0x55a109327840 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5e140a8f50 tx=0x7f5e140b2330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e448a8d62b6a0c28 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.224+0000 7f5e06a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:49:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.224+0000 7f5e06a00700 1 -- 172.21.15.81:0/3061089445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e14014070 con 0x55a109307760 2024-05-03T16:49:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.224+0000 7f5e35e28b80 1 -- 172.21.15.81:0/3061089445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e140b2510 con 0x55a109307760 2024-05-03T16:49:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.224+0000 7f5e06a00700 1 -- 172.21.15.81:0/3061089445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f5e140a9b10 con 0x55a109307760 2024-05-03T16:49:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.224+0000 7f5e06a00700 1 -- 172.21.15.81:0/3061089445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5e140912c0 con 0x55a109307760 2024-05-03T16:49:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.224+0000 7f5e35e28b80 10 client.15240 fetch_fsmap learned FSMap version 29 2024-05-03T16:49:06.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.224+0000 7f5e35e28b80 1 -- 172.21.15.81:0/3061089445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a1093228f0 con 0x55a109307760 2024-05-03T16:49:06.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.225+0000 7f5e06a00700 1 -- 172.21.15.81:0/3061089445 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e140b2510 con 0x55a109307760 2024-05-03T16:49:06.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.225+0000 7f5e06a00700 1 -- 172.21.15.81:0/3061089445 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5e1408b030 con 0x55a109307760 2024-05-03T16:49:06.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.225+0000 7f5e35e28b80 10 client.15240 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:49:06.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.225+0000 7f5e35e28b80 10 client.15240 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-03T16:49:06.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.225+0000 7f5e35e28b80 20 client.15240 populate_metadata read hostname 'smithi081' 2024-05-03T16:49:06.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.225+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/3061089445 >> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] conn(0x55a10938cd90 0x55a10938baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:06.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.225+0000 7f5e35e28b80 4 client.15240 mds_command: new command op to 34418 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T16:49:06.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.225+0000 7f5e35e28b80 1 -- 172.21.15.81:0/3061089445 --> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] -- command(tid 0: {"prefix": "status"}) -- 0x55a1092633b0 con 0x55a10938cd90 2024-05-03T16:49:06.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.226+0000 7f5e28a00700 1 --2- 172.21.15.81:0/3061089445 >> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] conn(0x55a10938cd90 0x55a10938baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:06.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.227+0000 7f5e28a00700 1 --2- 172.21.15.81:0/3061089445 >> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] conn(0x55a10938cd90 0x55a10938baa0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bd930e260cc29a47 server_cookie=68d257f06fcf30c9 in_seq=0 out_seq=0 2024-05-03T16:49:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.227+0000 7f5e06a00700 10 client.15240 ms_handle_connect on v2:172.21.15.134:6834/3681203129 2024-05-03T16:49:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.227+0000 7f5e06a00700 1 -- 172.21.15.81:0/3061089445 <== mds.2 v2:172.21.15.134:6834/3681203129 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a1092633b0 con 0x55a10938cd90 2024-05-03T16:49:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.227+0000 7f5e06a00700 10 client.15240 handle_command_reply: tid=0 2024-05-03T16:49:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.227+0000 7f5e35e28b80 1 client.15240 shutdown 2024-05-03T16:49:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.227+0000 7f5e35e28b80 1 -- 172.21.15.81:0/3061089445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 msgr2=0x55a109327840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.227+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/3061089445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 0x55a109327840 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5e140a8f50 tx=0x7f5e140b2330 comp rx=0 tx=0).stop 2024-05-03T16:49:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.228+0000 7f5e35e28b80 1 -- 172.21.15.81:0/3061089445 shutdown_connections 2024-05-03T16:49:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.228+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/3061089445 >> [v2:172.21.15.134:6834/3681203129,v1:172.21.15.134:6835/3681203129] conn(0x55a10938cd90 0x55a10938baa0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.228+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/3061089445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a109308080 0x55a1093222b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.228+0000 7f5e06a00700 0 client.15240 ms_handle_reset on v2:172.21.15.134:6834/3681203129 2024-05-03T16:49:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.228+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/3061089445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a109303580 0x55a109327300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.228+0000 7f5e35e28b80 1 --2- 172.21.15.81:0/3061089445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a109307760 0x55a109327840 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.228+0000 7f5e35e28b80 1 -- 172.21.15.81:0/3061089445 >> 172.21.15.81:0/3061089445 conn(0x55a109231b10 msgr2=0x55a10930aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.228+0000 7f5e35e28b80 1 -- 172.21.15.81:0/3061089445 shutdown_connections 2024-05-03T16:49:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.228+0000 7f5e35e28b80 1 -- 172.21.15.81:0/3061089445 wait complete. 2024-05-03T16:49:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.228+0000 7f5e35e28b80 20 client.15240 trim_cache size 0 max 16384 2024-05-03T16:49:06.233 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-03T16:49:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8988869e-096a-11ef-bc97-c7b262605968", 2024-05-03T16:49:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 2, 2024-05-03T16:49:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 34418, 2024-05-03T16:49:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-05-03T16:49:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-05-03T16:49:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-05-03T16:49:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 221.66381369499999, 2024-05-03T16:49:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 29, 2024-05-03T16:49:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 91, 2024-05-03T16:49:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 91, 2024-05-03T16:49:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 358.19165382800003 2024-05-03T16:49:06.234 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-03T16:49:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.229+0000 7f5e2b400700 1 -- 172.21.15.81:0/1076353033 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5e0c0b2910 msgr2=0x7f5e0c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.229+0000 7f5e2b400700 1 --2- 172.21.15.81:0/1076353033 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5e0c0b2910 0x7f5e0c0b4dd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00b830 tx=0x7f5e1c0099e0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.229+0000 7f5e2b400700 1 -- 172.21.15.81:0/1076353033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e24075ff0 msgr2=0x7f5e241a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.229+0000 7f5e2b400700 1 --2- 172.21.15.81:0/1076353033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e24075ff0 0x7f5e241a0630 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400d980 tx=0x7f5e1400dc90 comp rx=0 tx=0).stop 2024-05-03T16:49:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.229+0000 7f5e2b400700 1 -- 172.21.15.81:0/1076353033 shutdown_connections 2024-05-03T16:49:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.229+0000 7f5e2b400700 1 --2- 172.21.15.81:0/1076353033 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f5e0c0b2910 0x7f5e0c0b4dd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.229+0000 7f5e2b400700 1 --2- 172.21.15.81:0/1076353033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e24114670 0x7f5e241a49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.229+0000 7f5e2b400700 1 --2- 172.21.15.81:0/1076353033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e240756d0 0x7f5e241a00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.229+0000 7f5e2b400700 1 --2- 172.21.15.81:0/1076353033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e24075ff0 0x7f5e241a0630 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.229+0000 7f5e2b400700 1 -- 172.21.15.81:0/1076353033 >> 172.21.15.81:0/1076353033 conn(0x7f5e2407a600 msgr2=0x7f5e24110110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.229+0000 7f5e2b400700 1 -- 172.21.15.81:0/1076353033 shutdown_connections 2024-05-03T16:49:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:06.229+0000 7f5e2b400700 1 -- 172.21.15.81:0/1076353033 wait complete. 2024-05-03T16:49:06.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:06 smithi146 ceph-mon[32357]: pgmap v531: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:06.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:06 smithi134 ceph-mon[31708]: pgmap v531: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:07.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell mds.h status 2024-05-03T16:49:07.648 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:49:08.078 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:08 smithi081 ceph-mon[28640]: pgmap v532: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:49:08.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:08 smithi146 ceph-mon[32357]: pgmap v532: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:49:08.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:08 smithi134 ceph-mon[31708]: pgmap v532: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:49:10.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.062+0000 7fe088200700 1 -- 172.21.15.81:0/4062083775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08010ff50 msgr2=0x7fe080112340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:10.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.062+0000 7fe088200700 1 --2- 172.21.15.81:0/4062083775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08010ff50 0x7fe080112340 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe07800b0a0 tx=0x7fe07800b3b0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.063+0000 7fe088200700 1 -- 172.21.15.81:0/4062083775 shutdown_connections 2024-05-03T16:49:10.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.063+0000 7fe088200700 1 --2- 172.21.15.81:0/4062083775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe08006b1b0 0x7fe08006b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.063+0000 7fe088200700 1 --2- 172.21.15.81:0/4062083775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08010ff50 0x7fe080112340 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.063+0000 7fe088200700 1 --2- 172.21.15.81:0/4062083775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe08006bad0 0x7fe08010fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.063+0000 7fe088200700 1 -- 172.21.15.81:0/4062083775 >> 172.21.15.81:0/4062083775 conn(0x7fe080079350 msgr2=0x7fe080079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:10.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.063+0000 7fe088200700 1 -- 172.21.15.81:0/4062083775 shutdown_connections 2024-05-03T16:49:10.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.063+0000 7fe088200700 1 -- 172.21.15.81:0/4062083775 wait complete. 2024-05-03T16:49:10.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.064+0000 7fe088200700 1 Processor -- start 2024-05-03T16:49:10.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.064+0000 7fe088200700 1 -- start start 2024-05-03T16:49:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.064+0000 7fe088200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08006b1b0 0x7fe0801a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.064+0000 7fe088200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe08006bad0 0x7fe0801a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.064+0000 7fe088200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe08010ff50 0x7fe08019bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.064+0000 7fe088200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe080115770 con 0x7fe08006b1b0 2024-05-03T16:49:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.064+0000 7fe088200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe0801155f0 con 0x7fe08006bad0 2024-05-03T16:49:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.064+0000 7fe088200700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe0801158f0 con 0x7fe08010ff50 2024-05-03T16:49:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.065+0000 7fe085800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08006b1b0 0x7fe0801a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.065+0000 7fe085800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08006b1b0 0x7fe0801a1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41764/0 (socket says 172.21.15.81:41764) 2024-05-03T16:49:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.065+0000 7fe085800700 1 -- 172.21.15.81:0/2701560254 learned_addr learned my addr 172.21.15.81:0/2701560254 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.065+0000 7fe084e00700 1 --2- 172.21.15.81:0/2701560254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe08006bad0 0x7fe0801a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.065+0000 7fe086200700 1 --2- 172.21.15.81:0/2701560254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe08010ff50 0x7fe08019bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.065+0000 7fe085800700 1 -- 172.21.15.81:0/2701560254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe08010ff50 msgr2=0x7fe08019bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.065+0000 7fe085800700 1 --2- 172.21.15.81:0/2701560254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe08010ff50 0x7fe08019bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.065+0000 7fe085800700 1 -- 172.21.15.81:0/2701560254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe08006bad0 msgr2=0x7fe0801a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.065+0000 7fe085800700 1 --2- 172.21.15.81:0/2701560254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe08006bad0 0x7fe0801a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.065+0000 7fe085800700 1 -- 172.21.15.81:0/2701560254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08019c230 con 0x7fe08006b1b0 2024-05-03T16:49:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.065+0000 7fe086200700 1 --2- 172.21.15.81:0/2701560254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe08010ff50 0x7fe08019bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:49:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.066+0000 7fe085800700 1 --2- 172.21.15.81:0/2701560254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08006b1b0 0x7fe0801a1910 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe07400d950 tx=0x7fe07400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.066+0000 7fe07e000700 1 -- 172.21.15.81:0/2701560254 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe074016070 con 0x7fe08006b1b0 2024-05-03T16:49:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.066+0000 7fe07e000700 1 -- 172.21.15.81:0/2701560254 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe074009dd0 con 0x7fe08006b1b0 2024-05-03T16:49:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.066+0000 7fe088200700 1 -- 172.21.15.81:0/2701560254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe08019c520 con 0x7fe08006b1b0 2024-05-03T16:49:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.066+0000 7fe07e000700 1 -- 172.21.15.81:0/2701560254 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07400f3c0 con 0x7fe08006b1b0 2024-05-03T16:49:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.066+0000 7fe088200700 1 -- 172.21.15.81:0/2701560254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0801a87e0 con 0x7fe08006b1b0 2024-05-03T16:49:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.070+0000 7fe07e000700 1 -- 172.21.15.81:0/2701560254 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe074019070 con 0x7fe08006b1b0 2024-05-03T16:49:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.071+0000 7fe092c2fb80 1 Processor -- start 2024-05-03T16:49:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.071+0000 7fe092c2fb80 1 -- start start 2024-05-03T16:49:10.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.072+0000 7fe092c2fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 0x557b63b57cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:10.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.072+0000 7fe092c2fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b58200 0x557b63b51ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:10.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.072+0000 7fe092c2fb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b52500 0x557b63b52980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:10.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.072+0000 7fe092c2fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557b63aa49d0 con 0x557b63b58200 2024-05-03T16:49:10.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.072+0000 7fe092c2fb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557b63a42710 con 0x557b63b52500 2024-05-03T16:49:10.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.072+0000 7fe092c2fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557b63aa0990 con 0x557b63b578e0 2024-05-03T16:49:10.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.072+0000 7fe07e000700 1 --2- 172.21.15.81:0/2701560254 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe0680b2990 0x7fe0680b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:10.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.072+0000 7fe07e000700 1 -- 172.21.15.81:0/2701560254 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fe0740e2390 con 0x7fe08006b1b0 2024-05-03T16:49:10.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.072+0000 7fe086200700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 0x557b63b57cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.072+0000 7fe085800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b58200 0x557b63b51ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.072+0000 7fe086200700 1 --2- 172.21.15.81:0/2701560254 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe0680b2990 0x7fe0680b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.072+0000 7fe084e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b52500 0x557b63b52980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.072+0000 7fe085800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b58200 0x557b63b51ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41780/0 (socket says 172.21.15.81:41780) 2024-05-03T16:49:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.072+0000 7fe085800700 1 -- 172.21.15.81:0/771475747 learned_addr learned my addr 172.21.15.81:0/771475747 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.073+0000 7fe085800700 1 -- 172.21.15.81:0/771475747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 msgr2=0x557b63b57cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.073+0000 7fe085800700 1 --2- 172.21.15.81:0/771475747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 0x557b63b57cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.073+0000 7fe085800700 1 -- 172.21.15.81:0/771475747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b52500 msgr2=0x557b63b52980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.073+0000 7fe085800700 1 --2- 172.21.15.81:0/771475747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b52500 0x557b63b52980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.073+0000 7fe085800700 1 -- 172.21.15.81:0/771475747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b639f1880 con 0x557b63b58200 2024-05-03T16:49:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.073+0000 7fe085800700 1 --2- 172.21.15.81:0/771475747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b58200 0x557b63b51ee0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe074000c00 tx=0x7fe0740a8c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99384df61a636c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.073+0000 7fe086200700 1 --2- 172.21.15.81:0/2701560254 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe0680b2990 0x7fe0680b4e50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe07800b780 tx=0x7fe078009c60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.074+0000 7fe072a00700 1 -- 172.21.15.81:0/771475747 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0740a9b40 con 0x557b63b58200 2024-05-03T16:49:10.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.074+0000 7fe072a00700 1 -- 172.21.15.81:0/771475747 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0740a9440 con 0x557b63b58200 2024-05-03T16:49:10.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.074+0000 7fe072a00700 1 -- 172.21.15.81:0/771475747 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07401ed50 con 0x557b63b58200 2024-05-03T16:49:10.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.075+0000 7fe092c2fb80 1 -- 172.21.15.81:0/771475747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b58200 msgr2=0x557b63b51ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:10.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.075+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/771475747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b58200 0x557b63b51ee0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe074000c00 tx=0x7fe0740a8c30 comp rx=0 tx=0).stop 2024-05-03T16:49:10.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.075+0000 7fe092c2fb80 1 -- 172.21.15.81:0/771475747 shutdown_connections 2024-05-03T16:49:10.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.075+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/771475747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 0x557b63b57cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.075+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/771475747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b52500 0x557b63b52980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.075+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/771475747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b58200 0x557b63b51ee0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.075+0000 7fe092c2fb80 1 -- 172.21.15.81:0/771475747 >> 172.21.15.81:0/771475747 conn(0x557b63aca680 msgr2=0x557b63b4c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:10.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.075+0000 7fe092c2fb80 1 -- 172.21.15.81:0/771475747 shutdown_connections 2024-05-03T16:49:10.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.075+0000 7fe092c2fb80 1 -- 172.21.15.81:0/771475747 wait complete. 2024-05-03T16:49:10.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.076+0000 7fe092c2fb80 1 -- start start 2024-05-03T16:49:10.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.076+0000 7fe092c2fb80 1 Processor -- start 2024-05-03T16:49:10.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.077+0000 7fe092c2fb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b52500 0x557b63b5de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:10.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.077+0000 7fe092c2fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 0x557b63b5b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.077+0000 7fe092c2fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b58200 0x557b63b5b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.077+0000 7fe092c2fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557b63b5ecb0 con 0x557b63b58200 2024-05-03T16:49:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.077+0000 7fe092c2fb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557b63a0aad0 con 0x557b63b52500 2024-05-03T16:49:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.077+0000 7fe092c2fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557b63b5ee30 con 0x557b63b578e0 2024-05-03T16:49:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.077+0000 7fe092c2fb80 10 client.0 _ll_register_callbacks cb 0x557b63a4bc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:49:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.077+0000 7fe085800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b52500 0x557b63b5de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.077+0000 7fe085800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b52500 0x557b63b5de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.81:37034/0 (socket says 172.21.15.81:37034) 2024-05-03T16:49:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.077+0000 7fe085800700 1 -- 172.21.15.81:0/3911718171 learned_addr learned my addr 172.21.15.81:0/3911718171 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.077+0000 7fe084e00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 0x557b63b5b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.077+0000 7fe086200700 1 --2- 172.21.15.81:0/3911718171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b58200 0x557b63b5b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.078+0000 7fe085800700 1 -- 172.21.15.81:0/3911718171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 msgr2=0x557b63b5b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.078+0000 7fe085800700 1 --2- 172.21.15.81:0/3911718171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 0x557b63b5b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.078+0000 7fe085800700 1 -- 172.21.15.81:0/3911718171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b58200 msgr2=0x557b63b5b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.078+0000 7fe085800700 1 --2- 172.21.15.81:0/3911718171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b58200 0x557b63b5b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.078+0000 7fe085800700 1 -- 172.21.15.81:0/3911718171 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b63a6a3d0 con 0x557b63b52500 2024-05-03T16:49:10.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.078+0000 7fe085800700 1 --2- 172.21.15.81:0/3911718171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b52500 0x557b63b5de60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe074005950 tx=0x7fe0740108d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24b27c98f15af82b server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:10.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.078+0000 7fe067400700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-03T16:49:10.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.078+0000 7fe067400700 1 -- 172.21.15.81:0/3911718171 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0740ad7f0 con 0x557b63b52500 2024-05-03T16:49:10.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.079+0000 7fe067400700 1 -- 172.21.15.81:0/3911718171 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fe07407f090 con 0x557b63b52500 2024-05-03T16:49:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.079+0000 7fe092c2fb80 1 -- 172.21.15.81:0/3911718171 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0740a9440 con 0x557b63b52500 2024-05-03T16:49:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.079+0000 7fe067400700 1 -- 172.21.15.81:0/3911718171 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe0740a9b40 con 0x557b63b52500 2024-05-03T16:49:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.079+0000 7fe092c2fb80 10 client.34847 fetch_fsmap learned FSMap version 29 2024-05-03T16:49:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.079+0000 7fe092c2fb80 1 -- 172.21.15.81:0/3911718171 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557b63b69430 con 0x557b63b52500 2024-05-03T16:49:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.079+0000 7fe067400700 1 -- 172.21.15.81:0/3911718171 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0740a9440 con 0x557b63b52500 2024-05-03T16:49:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.079+0000 7fe067400700 1 -- 172.21.15.81:0/3911718171 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe074009940 con 0x557b63b52500 2024-05-03T16:49:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.080+0000 7fe092c2fb80 10 client.34847 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:49:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.080+0000 7fe092c2fb80 10 client.34847 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-03T16:49:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.080+0000 7fe092c2fb80 20 client.34847 populate_metadata read hostname 'smithi081' 2024-05-03T16:49:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.080+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/3911718171 >> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] conn(0x557b63b6a780 0x557b63b6c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.080+0000 7fe092c2fb80 4 client.34847 mds_command: new command op to 34439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T16:49:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.080+0000 7fe092c2fb80 1 -- 172.21.15.81:0/3911718171 --> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b63b1efa0 con 0x557b63b6a780 2024-05-03T16:49:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.080+0000 7fe084e00700 1 --2- 172.21.15.81:0/3911718171 >> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] conn(0x557b63b6a780 0x557b63b6c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:10.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.081+0000 7fe084e00700 1 --2- 172.21.15.81:0/3911718171 >> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] conn(0x557b63b6a780 0x557b63b6c950 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9ccce5fa2cec164b server_cookie=a7925b0354e390f1 in_seq=0 out_seq=0 2024-05-03T16:49:10.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.081+0000 7fe067400700 10 client.34847 ms_handle_connect on v2:172.21.15.134:6836/2915415754 2024-05-03T16:49:10.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.082+0000 7fe067400700 1 -- 172.21.15.81:0/3911718171 <== mds.1 v2:172.21.15.134:6836/2915415754 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557b63b1efa0 con 0x557b63b6a780 2024-05-03T16:49:10.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.082+0000 7fe067400700 10 client.34847 handle_command_reply: tid=0 2024-05-03T16:49:10.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.082+0000 7fe092c2fb80 1 client.34847 shutdown 2024-05-03T16:49:10.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.082+0000 7fe092c2fb80 1 -- 172.21.15.81:0/3911718171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b52500 msgr2=0x557b63b5de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:10.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.082+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/3911718171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b52500 0x557b63b5de60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe074005950 tx=0x7fe0740108d0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.083+0000 7fe092c2fb80 1 -- 172.21.15.81:0/3911718171 shutdown_connections 2024-05-03T16:49:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.083+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/3911718171 >> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] conn(0x557b63b6a780 0x557b63b6c950 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.083+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/3911718171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b58200 0x557b63b5b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.083+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/3911718171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b52500 0x557b63b5de60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.083+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/3911718171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 0x557b63b5b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.083+0000 7fe067400700 0 client.34847 ms_handle_reset on v2:172.21.15.134:6836/2915415754 2024-05-03T16:49:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.083+0000 7fe092c2fb80 1 -- 172.21.15.81:0/3911718171 >> 172.21.15.81:0/3911718171 conn(0x557b63aca680 msgr2=0x557b63b47360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.083+0000 7fe092c2fb80 1 -- 172.21.15.81:0/3911718171 shutdown_connections 2024-05-03T16:49:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.083+0000 7fe092c2fb80 1 -- 172.21.15.81:0/3911718171 wait complete. 2024-05-03T16:49:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.083+0000 7fe092c2fb80 20 client.34847 trim_cache size 0 max 16384 2024-05-03T16:49:10.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.105+0000 7fe092c2fb80 1 Processor -- start 2024-05-03T16:49:10.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.106+0000 7fe092c2fb80 1 -- start start 2024-05-03T16:49:10.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.106+0000 7fe092c2fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b52500 0x557b63b5b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:10.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.106+0000 7fe092c2fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 0x557b63b5b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:10.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.106+0000 7fe092c2fb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b58200 0x557b63b59af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:10.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.106+0000 7fe092c2fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557b63b6ac90 con 0x557b63b52500 2024-05-03T16:49:10.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.106+0000 7fe092c2fb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557b63b6b360 con 0x557b63b58200 2024-05-03T16:49:10.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.106+0000 7fe092c2fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557b63b6ba30 con 0x557b63b578e0 2024-05-03T16:49:10.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.106+0000 7fe085800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b52500 0x557b63b5b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:10.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.106+0000 7fe085800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b52500 0x557b63b5b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41800/0 (socket says 172.21.15.81:41800) 2024-05-03T16:49:10.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.106+0000 7fe085800700 1 -- 172.21.15.81:0/3533434861 learned_addr learned my addr 172.21.15.81:0/3533434861 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:10.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.106+0000 7fe084e00700 1 --2- 172.21.15.81:0/3533434861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 0x557b63b5b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:10.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.106+0000 7fe086200700 1 --2- 172.21.15.81:0/3533434861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b58200 0x557b63b59af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:10.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.107+0000 7fe084e00700 1 -- 172.21.15.81:0/3533434861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b58200 msgr2=0x557b63b59af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:10.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.107+0000 7fe084e00700 1 --2- 172.21.15.81:0/3533434861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b58200 0x557b63b59af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.107+0000 7fe084e00700 1 -- 172.21.15.81:0/3533434861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b52500 msgr2=0x557b63b5b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:10.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.107+0000 7fe084e00700 1 --2- 172.21.15.81:0/3533434861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b52500 0x557b63b5b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.107+0000 7fe084e00700 1 -- 172.21.15.81:0/3533434861 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b63b5daa0 con 0x557b63b578e0 2024-05-03T16:49:10.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.107+0000 7fe085800700 1 --2- 172.21.15.81:0/3533434861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b52500 0x557b63b5b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-03T16:49:10.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.107+0000 7fe084e00700 1 --2- 172.21.15.81:0/3533434861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 0x557b63b5b700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x557b63b6d180 tx=0x7fe06c009b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c20a5d5664c55462 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:10.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.108+0000 7fe072000700 1 -- 172.21.15.81:0/3533434861 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c004830 con 0x557b63b578e0 2024-05-03T16:49:10.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.108+0000 7fe072000700 1 -- 172.21.15.81:0/3533434861 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe06c02a030 con 0x557b63b578e0 2024-05-03T16:49:10.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.108+0000 7fe072000700 1 -- 172.21.15.81:0/3533434861 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c003680 con 0x557b63b578e0 2024-05-03T16:49:10.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.109+0000 7fe092c2fb80 1 -- 172.21.15.81:0/3533434861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 msgr2=0x557b63b5b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:10.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.109+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/3533434861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 0x557b63b5b700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x557b63b6d180 tx=0x7fe06c009b10 comp rx=0 tx=0).stop 2024-05-03T16:49:10.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.109+0000 7fe092c2fb80 1 -- 172.21.15.81:0/3533434861 shutdown_connections 2024-05-03T16:49:10.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.109+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/3533434861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b58200 0x557b63b59af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.109+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/3533434861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b52500 0x557b63b5b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.109+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/3533434861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 0x557b63b5b700 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.109+0000 7fe092c2fb80 1 -- 172.21.15.81:0/3533434861 >> 172.21.15.81:0/3533434861 conn(0x557b63aca680 msgr2=0x557b63b553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:10.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.109+0000 7fe092c2fb80 1 -- 172.21.15.81:0/3533434861 shutdown_connections 2024-05-03T16:49:10.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.109+0000 7fe092c2fb80 1 -- 172.21.15.81:0/3533434861 wait complete. 2024-05-03T16:49:10.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.109+0000 7fe092c2fb80 1 -- start start 2024-05-03T16:49:10.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.110+0000 7fe092c2fb80 1 Processor -- start 2024-05-03T16:49:10.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.110+0000 7fe092c2fb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b52500 0x557b63b75dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:10.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.110+0000 7fe092c2fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 0x557b63b76310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:10.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.111+0000 7fe092c2fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b58200 0x557b63b70d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:10.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.111+0000 7fe092c2fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557b63b6c7d0 con 0x557b63b58200 2024-05-03T16:49:10.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.111+0000 7fe092c2fb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557b63b6c100 con 0x557b63b52500 2024-05-03T16:49:10.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.111+0000 7fe092c2fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557b63b6cea0 con 0x557b63b578e0 2024-05-03T16:49:10.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.111+0000 7fe092c2fb80 10 client.0 _ll_register_callbacks cb 0x557b63a4bc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:49:10.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.111+0000 7fe086200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b58200 0x557b63b70d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:10.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.111+0000 7fe086200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b58200 0x557b63b70d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41804/0 (socket says 172.21.15.81:41804) 2024-05-03T16:49:10.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.111+0000 7fe086200700 1 -- 172.21.15.81:0/2865283235 learned_addr learned my addr 172.21.15.81:0/2865283235 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:10.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.111+0000 7fe084e00700 1 --2- 172.21.15.81:0/2865283235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 0x557b63b76310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:10.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.111+0000 7fe085800700 1 --2- 172.21.15.81:0/2865283235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b52500 0x557b63b75dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:10.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.111+0000 7fe084e00700 1 -- 172.21.15.81:0/2865283235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b52500 msgr2=0x557b63b75dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:10.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.111+0000 7fe084e00700 1 --2- 172.21.15.81:0/2865283235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b52500 0x557b63b75dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.112+0000 7fe084e00700 1 -- 172.21.15.81:0/2865283235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b58200 msgr2=0x557b63b70d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:10.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.112+0000 7fe084e00700 1 --2- 172.21.15.81:0/2865283235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b58200 0x557b63b70d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.112+0000 7fe084e00700 1 -- 172.21.15.81:0/2865283235 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b63b71370 con 0x557b63b578e0 2024-05-03T16:49:10.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.112+0000 7fe086200700 1 --2- 172.21.15.81:0/2865283235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b58200 0x557b63b70d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-03T16:49:10.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.112+0000 7fe084e00700 1 --2- 172.21.15.81:0/2865283235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 0x557b63b76310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x557b63b59a30 tx=0x7fe06c005570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba3715a40401f99b server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:10.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.112+0000 7fe067400700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-05-03T16:49:10.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.112+0000 7fe067400700 1 -- 172.21.15.81:0/2865283235 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c003880 con 0x557b63b578e0 2024-05-03T16:49:10.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.112+0000 7fe092c2fb80 1 -- 172.21.15.81:0/2865283235 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe06c02a030 con 0x557b63b578e0 2024-05-03T16:49:10.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.112+0000 7fe067400700 1 -- 172.21.15.81:0/2865283235 <== mon.1 v2:172.21.15.146:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fe06c003a20 con 0x557b63b578e0 2024-05-03T16:49:10.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.113+0000 7fe067400700 1 -- 172.21.15.81:0/2865283235 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe06c041050 con 0x557b63b578e0 2024-05-03T16:49:10.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.113+0000 7fe092c2fb80 10 client.24892 fetch_fsmap learned FSMap version 29 2024-05-03T16:49:10.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.113+0000 7fe092c2fb80 1 -- 172.21.15.81:0/2865283235 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557b63bd7230 con 0x557b63b578e0 2024-05-03T16:49:10.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.113+0000 7fe067400700 1 -- 172.21.15.81:0/2865283235 <== mon.1 v2:172.21.15.146:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe06c02a030 con 0x557b63b578e0 2024-05-03T16:49:10.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.113+0000 7fe067400700 1 -- 172.21.15.81:0/2865283235 <== mon.1 v2:172.21.15.146:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe06c036020 con 0x557b63b578e0 2024-05-03T16:49:10.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.113+0000 7fe092c2fb80 10 client.24892 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:49:10.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.113+0000 7fe092c2fb80 10 client.24892 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-03T16:49:10.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.113+0000 7fe092c2fb80 20 client.24892 populate_metadata read hostname 'smithi081' 2024-05-03T16:49:10.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.113+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/2865283235 >> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] conn(0x557b63bdbb90 0x557b63bda8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:10.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.113+0000 7fe092c2fb80 4 client.24892 mds_command: new command op to 34439 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T16:49:10.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.113+0000 7fe092c2fb80 1 -- 172.21.15.81:0/2865283235 --> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] -- command(tid 0: {"prefix": "status"}) -- 0x557b63ab23b0 con 0x557b63bdbb90 2024-05-03T16:49:10.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.114+0000 7fe085800700 1 --2- 172.21.15.81:0/2865283235 >> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] conn(0x557b63bdbb90 0x557b63bda8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:10.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.115+0000 7fe085800700 1 --2- 172.21.15.81:0/2865283235 >> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] conn(0x557b63bdbb90 0x557b63bda8a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8144398bc72d54f6 server_cookie=10d716bb6eced7a0 in_seq=0 out_seq=0 2024-05-03T16:49:10.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.115+0000 7fe067400700 10 client.24892 ms_handle_connect on v2:172.21.15.134:6836/2915415754 2024-05-03T16:49:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.115+0000 7fe067400700 1 -- 172.21.15.81:0/2865283235 <== mds.1 v2:172.21.15.134:6836/2915415754 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557b63ab23b0 con 0x557b63bdbb90 2024-05-03T16:49:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.115+0000 7fe067400700 10 client.24892 handle_command_reply: tid=0 2024-05-03T16:49:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.115+0000 7fe092c2fb80 1 client.24892 shutdown 2024-05-03T16:49:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.115+0000 7fe092c2fb80 1 -- 172.21.15.81:0/2865283235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 msgr2=0x557b63b76310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.115+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/2865283235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 0x557b63b76310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x557b63b59a30 tx=0x7fe06c005570 comp rx=0 tx=0).stop 2024-05-03T16:49:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.115+0000 7fe092c2fb80 1 -- 172.21.15.81:0/2865283235 shutdown_connections 2024-05-03T16:49:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.115+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/2865283235 >> [v2:172.21.15.134:6836/2915415754,v1:172.21.15.134:6837/2915415754] conn(0x557b63bdbb90 0x557b63bda8a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.115+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/2865283235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b63b58200 0x557b63b70d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.115+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/2865283235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557b63b52500 0x557b63b75dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.115+0000 7fe067400700 0 client.24892 ms_handle_reset on v2:172.21.15.134:6836/2915415754 2024-05-03T16:49:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.115+0000 7fe092c2fb80 1 --2- 172.21.15.81:0/2865283235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b63b578e0 0x557b63b76310 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.115+0000 7fe092c2fb80 1 -- 172.21.15.81:0/2865283235 >> 172.21.15.81:0/2865283235 conn(0x557b63aca680 msgr2=0x557b63b553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.116+0000 7fe092c2fb80 1 -- 172.21.15.81:0/2865283235 shutdown_connections 2024-05-03T16:49:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.116+0000 7fe092c2fb80 1 -- 172.21.15.81:0/2865283235 wait complete. 2024-05-03T16:49:10.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.116+0000 7fe092c2fb80 20 client.24892 trim_cache size 0 max 16384 2024-05-03T16:49:10.120 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-03T16:49:10.120 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8988869e-096a-11ef-bc97-c7b262605968", 2024-05-03T16:49:10.120 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 1, 2024-05-03T16:49:10.120 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 34439, 2024-05-03T16:49:10.120 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-05-03T16:49:10.120 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-05-03T16:49:10.120 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-05-03T16:49:10.120 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 226.56390041399999, 2024-05-03T16:49:10.120 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 29, 2024-05-03T16:49:10.121 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 91, 2024-05-03T16:49:10.121 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 91, 2024-05-03T16:49:10.121 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 349.66021420099997 2024-05-03T16:49:10.121 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-03T16:49:10.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.117+0000 7fe088200700 1 -- 172.21.15.81:0/2701560254 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe0680b2990 msgr2=0x7fe0680b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:10.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.117+0000 7fe088200700 1 --2- 172.21.15.81:0/2701560254 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe0680b2990 0x7fe0680b4e50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe07800b780 tx=0x7fe078009c60 comp rx=0 tx=0).stop 2024-05-03T16:49:10.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.117+0000 7fe088200700 1 -- 172.21.15.81:0/2701560254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08006b1b0 msgr2=0x7fe0801a1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:10.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.117+0000 7fe088200700 1 --2- 172.21.15.81:0/2701560254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08006b1b0 0x7fe0801a1910 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe07400d950 tx=0x7fe07400dc60 comp rx=0 tx=0).stop 2024-05-03T16:49:10.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.117+0000 7fe088200700 1 -- 172.21.15.81:0/2701560254 shutdown_connections 2024-05-03T16:49:10.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.117+0000 7fe088200700 1 --2- 172.21.15.81:0/2701560254 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe0680b2990 0x7fe0680b4e50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.117+0000 7fe088200700 1 --2- 172.21.15.81:0/2701560254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe08010ff50 0x7fe08019bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.117+0000 7fe088200700 1 --2- 172.21.15.81:0/2701560254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08006b1b0 0x7fe0801a1910 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.117+0000 7fe088200700 1 --2- 172.21.15.81:0/2701560254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe08006bad0 0x7fe0801a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:10.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.117+0000 7fe088200700 1 -- 172.21.15.81:0/2701560254 >> 172.21.15.81:0/2701560254 conn(0x7fe080079350 msgr2=0x7fe080111440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:10.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.117+0000 7fe088200700 1 -- 172.21.15.81:0/2701560254 shutdown_connections 2024-05-03T16:49:10.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:10.117+0000 7fe088200700 1 -- 172.21.15.81:0/2701560254 wait complete. 2024-05-03T16:49:10.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:10 smithi081 ceph-mon[28640]: pgmap v533: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:10.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:10 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:49:10.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:10 smithi146 ceph-mon[32357]: pgmap v533: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:10.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:10 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:49:10.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:10 smithi134 ceph-mon[31708]: pgmap v533: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:10.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:10 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:49:11.068 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-03T16:49:11.501 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:49:12.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:12 smithi146 ceph-mon[32357]: pgmap v534: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:12.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:12 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:49:12.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:12 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:49:12.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:12 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:49:12.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:12 smithi134 ceph-mon[31708]: pgmap v534: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:12.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:12 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:49:12.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:12 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:49:12.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:12 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:49:12.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:12 smithi081 ceph-mon[28640]: pgmap v534: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:12.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:12 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:49:12.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:12 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:49:12.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:12 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:49:13.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.871+0000 7f01b0a00700 1 -- 172.21.15.81:0/2388647908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ac104640 msgr2=0x7f01ac104a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:13.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.871+0000 7f01b0a00700 1 --2- 172.21.15.81:0/2388647908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ac104640 0x7f01ac104a20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f019c00b0a0 tx=0x7f019c00b3b0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.871+0000 7f01b0a00700 1 -- 172.21.15.81:0/2388647908 shutdown_connections 2024-05-03T16:49:13.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.871+0000 7f01b0a00700 1 --2- 172.21.15.81:0/2388647908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01ac10da20 0x7f01ac10fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.871+0000 7f01b0a00700 1 --2- 172.21.15.81:0/2388647908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ac104640 0x7f01ac104a20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.871+0000 7f01b0a00700 1 --2- 172.21.15.81:0/2388647908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01ac104f60 0x7f01ac10d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.871+0000 7f01b0a00700 1 -- 172.21.15.81:0/2388647908 >> 172.21.15.81:0/2388647908 conn(0x7f01ac0fde30 msgr2=0x7f01ac100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:13.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.871+0000 7f01b0a00700 1 -- 172.21.15.81:0/2388647908 shutdown_connections 2024-05-03T16:49:13.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.871+0000 7f01b0a00700 1 -- 172.21.15.81:0/2388647908 wait complete. 2024-05-03T16:49:13.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.872+0000 7f01b0a00700 1 Processor -- start 2024-05-03T16:49:13.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.872+0000 7f01b0a00700 1 -- start start 2024-05-03T16:49:13.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.872+0000 7f01b0a00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01ac104640 0x7f01ac1a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:13.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.872+0000 7f01b0a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01ac104f60 0x7f01ac1a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:13.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.872+0000 7f01b0a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ac10da20 0x7f01ac19ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:13.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.872+0000 7f01b0a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f01ac1134d0 con 0x7f01ac10da20 2024-05-03T16:49:13.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.872+0000 7f01b0a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f01ac113350 con 0x7f01ac104f60 2024-05-03T16:49:13.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.873+0000 7f01b0a00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f01ac113650 con 0x7f01ac104640 2024-05-03T16:49:13.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.873+0000 7f01abe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ac10da20 0x7f01ac19ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:13.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.873+0000 7f01ab400700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01ac104640 0x7f01ac1a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:13.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.873+0000 7f01abe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ac10da20 0x7f01ac19ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41818/0 (socket says 172.21.15.81:41818) 2024-05-03T16:49:13.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.873+0000 7f01abe00700 1 -- 172.21.15.81:0/223357164 learned_addr learned my addr 172.21.15.81:0/223357164 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:13.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.873+0000 7f01a2a00700 1 --2- 172.21.15.81:0/223357164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01ac104f60 0x7f01ac1a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:13.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.873+0000 7f01abe00700 1 -- 172.21.15.81:0/223357164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01ac104640 msgr2=0x7f01ac1a18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:13.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.873+0000 7f01abe00700 1 --2- 172.21.15.81:0/223357164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01ac104640 0x7f01ac1a18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.873+0000 7f01abe00700 1 -- 172.21.15.81:0/223357164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01ac104f60 msgr2=0x7f01ac1a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:13.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.873+0000 7f01abe00700 1 --2- 172.21.15.81:0/223357164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01ac104f60 0x7f01ac1a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.873+0000 7f01abe00700 1 -- 172.21.15.81:0/223357164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ac19c1f0 con 0x7f01ac10da20 2024-05-03T16:49:13.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.874+0000 7f01abe00700 1 --2- 172.21.15.81:0/223357164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ac10da20 0x7f01ac19ba90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f01a400d980 tx=0x7f01a400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:13.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.874+0000 7f01a8c00700 1 -- 172.21.15.81:0/223357164 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a4017070 con 0x7f01ac10da20 2024-05-03T16:49:13.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.874+0000 7f01a8c00700 1 -- 172.21.15.81:0/223357164 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01a4005020 con 0x7f01ac10da20 2024-05-03T16:49:13.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.874+0000 7f01b0a00700 1 -- 172.21.15.81:0/223357164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01ac19c480 con 0x7f01ac10da20 2024-05-03T16:49:13.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.874+0000 7f01a8c00700 1 -- 172.21.15.81:0/223357164 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a400f980 con 0x7f01ac10da20 2024-05-03T16:49:13.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.874+0000 7f01b0a00700 1 -- 172.21.15.81:0/223357164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01ac1a87a0 con 0x7f01ac10da20 2024-05-03T16:49:13.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.878+0000 7f01a8c00700 1 -- 172.21.15.81:0/223357164 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f01a4004a30 con 0x7f01ac10da20 2024-05-03T16:49:13.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.879+0000 7f01bca05b80 1 Processor -- start 2024-05-03T16:49:13.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.879+0000 7f01bca05b80 1 -- start start 2024-05-03T16:49:13.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.880+0000 7f01bca05b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b12bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:13.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.880+0000 7f01bca05b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b125ee0 0x55772b126360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:13.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.880+0000 7f01bca05b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b1268a0 0x55772b132940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:13.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.880+0000 7f01bca05b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55772b0789d0 con 0x55772b12bb80 2024-05-03T16:49:13.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.880+0000 7f01bca05b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55772b016710 con 0x55772b125ee0 2024-05-03T16:49:13.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.880+0000 7f01bca05b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55772b074990 con 0x55772b1268a0 2024-05-03T16:49:13.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.880+0000 7f01a2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b12bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:13.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.880+0000 7f01a2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b12bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41832/0 (socket says 172.21.15.81:41832) 2024-05-03T16:49:13.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.880+0000 7f01a2a00700 1 -- 172.21.15.81:0/2960048055 learned_addr learned my addr 172.21.15.81:0/2960048055 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:13.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.880+0000 7f01a8c00700 1 --2- 172.21.15.81:0/223357164 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f01900b2990 0x7f01900b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:13.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.880+0000 7f01ab400700 1 --2- 172.21.15.81:0/2960048055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b125ee0 0x55772b126360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:13.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.881+0000 7f01a8c00700 1 -- 172.21.15.81:0/223357164 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f01a40e23f0 con 0x7f01ac10da20 2024-05-03T16:49:13.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.881+0000 7f01abe00700 1 --2- 172.21.15.81:0/223357164 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f01900b2990 0x7f01900b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:13.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.881+0000 7f01a2a00700 1 -- 172.21.15.81:0/2960048055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b1268a0 msgr2=0x55772b132940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:13.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.881+0000 7f01a2a00700 1 --2- 172.21.15.81:0/2960048055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b1268a0 0x55772b132940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.881+0000 7f01a2a00700 1 -- 172.21.15.81:0/2960048055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b125ee0 msgr2=0x55772b126360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:13.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.881+0000 7f01a2a00700 1 --2- 172.21.15.81:0/2960048055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b125ee0 0x55772b126360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.881+0000 7f01a2a00700 1 -- 172.21.15.81:0/2960048055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55772afc5880 con 0x55772b12bb80 2024-05-03T16:49:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.881+0000 7f01a2a00700 1 --2- 172.21.15.81:0/2960048055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b12bf60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f019400b750 tx=0x7f019400ba60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee80e3b4e5f920 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.881+0000 7f01abe00700 1 --2- 172.21.15.81:0/223357164 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f01900b2990 0x7f01900b4e50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f01a40dff70 tx=0x7f01a4004750 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.881+0000 7f01a0c00700 1 -- 172.21.15.81:0/2960048055 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194004a30 con 0x55772b12bb80 2024-05-03T16:49:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.881+0000 7f01a0c00700 1 -- 172.21.15.81:0/2960048055 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0194016030 con 0x55772b12bb80 2024-05-03T16:49:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.881+0000 7f01a0c00700 1 -- 172.21.15.81:0/2960048055 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194005310 con 0x55772b12bb80 2024-05-03T16:49:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.882+0000 7f01bca05b80 1 -- 172.21.15.81:0/2960048055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 msgr2=0x55772b12bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.882+0000 7f01bca05b80 1 --2- 172.21.15.81:0/2960048055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b12bf60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f019400b750 tx=0x7f019400ba60 comp rx=0 tx=0).stop 2024-05-03T16:49:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.882+0000 7f01bca05b80 1 -- 172.21.15.81:0/2960048055 shutdown_connections 2024-05-03T16:49:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.882+0000 7f01bca05b80 1 --2- 172.21.15.81:0/2960048055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b1268a0 0x55772b132940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.882+0000 7f01bca05b80 1 --2- 172.21.15.81:0/2960048055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b12bf60 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.882+0000 7f01bca05b80 1 --2- 172.21.15.81:0/2960048055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b125ee0 0x55772b126360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.882+0000 7f01bca05b80 1 -- 172.21.15.81:0/2960048055 >> 172.21.15.81:0/2960048055 conn(0x55772b09e680 msgr2=0x55772b120b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:13.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.882+0000 7f01bca05b80 1 -- 172.21.15.81:0/2960048055 shutdown_connections 2024-05-03T16:49:13.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.883+0000 7f01bca05b80 1 -- 172.21.15.81:0/2960048055 wait complete. 2024-05-03T16:49:13.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.883+0000 7f01bca05b80 1 -- start start 2024-05-03T16:49:13.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.883+0000 7f01bca05b80 1 Processor -- start 2024-05-03T16:49:13.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.884+0000 7f01bca05b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b125ee0 0x55772b132520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:13.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.884+0000 7f01bca05b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b1268a0 0x55772b12f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:13.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.884+0000 7f01bca05b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b12fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:13.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.884+0000 7f01bca05b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55772b132e80 con 0x55772b12bb80 2024-05-03T16:49:13.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.884+0000 7f01bca05b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55772afdead0 con 0x55772b125ee0 2024-05-03T16:49:13.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.884+0000 7f01bca05b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55772b133000 con 0x55772b1268a0 2024-05-03T16:49:13.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.884+0000 7f01bca05b80 10 client.0 _ll_register_callbacks cb 0x55772b01fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:49:13.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.884+0000 7f01a2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b12fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:13.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.884+0000 7f01a2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b12fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41842/0 (socket says 172.21.15.81:41842) 2024-05-03T16:49:13.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.884+0000 7f01a2a00700 1 -- 172.21.15.81:0/1669506406 learned_addr learned my addr 172.21.15.81:0/1669506406 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:13.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.885+0000 7f01ab400700 1 --2- 172.21.15.81:0/1669506406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b1268a0 0x55772b12f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:13.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.885+0000 7f01a2a00700 1 --2- 172.21.15.81:0/1669506406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b125ee0 0x55772b132520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:13.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.885+0000 7f01a2a00700 1 -- 172.21.15.81:0/1669506406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b1268a0 msgr2=0x55772b12f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:13.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.885+0000 7f01a2a00700 1 --2- 172.21.15.81:0/1669506406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b1268a0 0x55772b12f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.885+0000 7f01a2a00700 1 -- 172.21.15.81:0/1669506406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b125ee0 msgr2=0x55772b132520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:13.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.885+0000 7f01a2a00700 1 --2- 172.21.15.81:0/1669506406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b125ee0 0x55772b132520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.885+0000 7f01a2a00700 1 -- 172.21.15.81:0/1669506406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55772b03e3d0 con 0x55772b12bb80 2024-05-03T16:49:13.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.885+0000 7f01ab400700 1 --2- 172.21.15.81:0/1669506406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b1268a0 0x55772b12f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:49:13.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.885+0000 7f01a2a00700 1 --2- 172.21.15.81:0/1669506406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b12fe00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0194004110 tx=0x7f0194004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd39c2e54174f23 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:13.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.885+0000 7f0199600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:49:13.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.885+0000 7f0199600700 1 -- 172.21.15.81:0/1669506406 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194003c10 con 0x55772b12bb80 2024-05-03T16:49:13.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.885+0000 7f0199600700 1 -- 172.21.15.81:0/1669506406 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f0194003db0 con 0x55772b12bb80 2024-05-03T16:49:13.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.885+0000 7f01bca05b80 1 -- 172.21.15.81:0/1669506406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0194016030 con 0x55772b12bb80 2024-05-03T16:49:13.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.886+0000 7f0199600700 1 -- 172.21.15.81:0/1669506406 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f019402f050 con 0x55772b12bb80 2024-05-03T16:49:13.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.886+0000 7f01bca05b80 10 client.15270 fetch_fsmap learned FSMap version 29 2024-05-03T16:49:13.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.886+0000 7f01bca05b80 1 -- 172.21.15.81:0/1669506406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55772b13d620 con 0x55772b12bb80 2024-05-03T16:49:13.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.886+0000 7f0199600700 1 -- 172.21.15.81:0/1669506406 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0194016030 con 0x55772b12bb80 2024-05-03T16:49:13.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.886+0000 7f0199600700 1 -- 172.21.15.81:0/1669506406 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f019401b670 con 0x55772b12bb80 2024-05-03T16:49:13.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.886+0000 7f01bca05b80 10 client.15270 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:49:13.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.886+0000 7f01bca05b80 10 client.15270 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-03T16:49:13.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.887+0000 7f01bca05b80 20 client.15270 populate_metadata read hostname 'smithi081' 2024-05-03T16:49:13.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.887+0000 7f01bca05b80 1 --2- 172.21.15.81:0/1669506406 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55772b13fa60 0x55772b140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:13.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.887+0000 7f01bca05b80 4 client.15270 mds_command: new command op to 34466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T16:49:13.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.887+0000 7f01bca05b80 1 -- 172.21.15.81:0/1669506406 --> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55772b0f2fa0 con 0x55772b13fa60 2024-05-03T16:49:13.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.887+0000 7f01ab400700 1 --2- 172.21.15.81:0/1669506406 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55772b13fa60 0x55772b140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:13.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.888+0000 7f01ab400700 1 --2- 172.21.15.81:0/1669506406 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55772b13fa60 0x55772b140ed0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a2e06f27edd6c49 server_cookie=71b0f8066c14c23e in_seq=0 out_seq=0 2024-05-03T16:49:13.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.888+0000 7f0199600700 10 client.15270 ms_handle_connect on v2:172.21.15.134:6838/2061491127 2024-05-03T16:49:13.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.890+0000 7f0199600700 1 -- 172.21.15.81:0/1669506406 <== mds.0 v2:172.21.15.134:6838/2061491127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55772b0f2fa0 con 0x55772b13fa60 2024-05-03T16:49:13.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.890+0000 7f0199600700 10 client.15270 handle_command_reply: tid=0 2024-05-03T16:49:13.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.890+0000 7f01bca05b80 1 client.15270 shutdown 2024-05-03T16:49:13.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.891+0000 7f01bca05b80 1 -- 172.21.15.81:0/1669506406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 msgr2=0x55772b12fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:13.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.891+0000 7f01bca05b80 1 --2- 172.21.15.81:0/1669506406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b12fe00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0194004110 tx=0x7f0194004060 comp rx=0 tx=0).stop 2024-05-03T16:49:13.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.891+0000 7f01bca05b80 1 -- 172.21.15.81:0/1669506406 shutdown_connections 2024-05-03T16:49:13.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.891+0000 7f01bca05b80 1 --2- 172.21.15.81:0/1669506406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b12fe00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.891+0000 7f01bca05b80 1 --2- 172.21.15.81:0/1669506406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b125ee0 0x55772b132520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.891+0000 7f01bca05b80 1 --2- 172.21.15.81:0/1669506406 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55772b13fa60 0x55772b140ed0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.891+0000 7f01bca05b80 1 --2- 172.21.15.81:0/1669506406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b1268a0 0x55772b12f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.891+0000 7f01bca05b80 1 -- 172.21.15.81:0/1669506406 >> 172.21.15.81:0/1669506406 conn(0x55772b09e680 msgr2=0x55772b124ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:13.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.891+0000 7f0199600700 0 client.15270 ms_handle_reset on v2:172.21.15.134:6838/2061491127 2024-05-03T16:49:13.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.891+0000 7f01bca05b80 1 -- 172.21.15.81:0/1669506406 shutdown_connections 2024-05-03T16:49:13.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.891+0000 7f01bca05b80 1 -- 172.21.15.81:0/1669506406 wait complete. 2024-05-03T16:49:13.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.891+0000 7f01bca05b80 20 client.15270 trim_cache size 0 max 16384 2024-05-03T16:49:13.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.915+0000 7f01bca05b80 1 Processor -- start 2024-05-03T16:49:13.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.915+0000 7f01bca05b80 1 -- start start 2024-05-03T16:49:13.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.915+0000 7f01bca05b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b125ee0 0x55772b131cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:13.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.915+0000 7f01bca05b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b1268a0 0x55772b11aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:13.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.915+0000 7f01bca05b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b120660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:13.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.915+0000 7f01bca05b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55772b13f210 con 0x55772b12bb80 2024-05-03T16:49:13.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.915+0000 7f01bca05b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55772b13f8e0 con 0x55772b125ee0 2024-05-03T16:49:13.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.915+0000 7f01bca05b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55772b13ffb0 con 0x55772b1268a0 2024-05-03T16:49:13.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.916+0000 7f01a2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b120660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:13.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.916+0000 7f01a2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b120660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41856/0 (socket says 172.21.15.81:41856) 2024-05-03T16:49:13.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.916+0000 7f01a2a00700 1 -- 172.21.15.81:0/646588674 learned_addr learned my addr 172.21.15.81:0/646588674 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:13.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.916+0000 7f01a2a00700 1 --2- 172.21.15.81:0/646588674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b125ee0 0x55772b131cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:13.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.916+0000 7f01ab400700 1 --2- 172.21.15.81:0/646588674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b1268a0 0x55772b11aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:13.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.916+0000 7f01a2a00700 1 -- 172.21.15.81:0/646588674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b1268a0 msgr2=0x55772b11aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:13.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.916+0000 7f01a2a00700 1 --2- 172.21.15.81:0/646588674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b1268a0 0x55772b11aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.916+0000 7f01a2a00700 1 -- 172.21.15.81:0/646588674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b125ee0 msgr2=0x55772b131cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:13.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.916+0000 7f01a2a00700 1 --2- 172.21.15.81:0/646588674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b125ee0 0x55772b131cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.916+0000 7f01a2a00700 1 -- 172.21.15.81:0/646588674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55772b0f2f80 con 0x55772b12bb80 2024-05-03T16:49:13.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.916+0000 7f01a2a00700 1 --2- 172.21.15.81:0/646588674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b120660 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f019400b550 tx=0x7f019402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4383d25af8c0ab28 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:13.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.917+0000 7f019be00700 1 -- 172.21.15.81:0/646588674 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194005b00 con 0x55772b12bb80 2024-05-03T16:49:13.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.917+0000 7f019be00700 1 -- 172.21.15.81:0/646588674 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0194016070 con 0x55772b12bb80 2024-05-03T16:49:13.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.917+0000 7f019be00700 1 -- 172.21.15.81:0/646588674 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01940104b0 con 0x55772b12bb80 2024-05-03T16:49:13.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.917+0000 7f01bca05b80 1 -- 172.21.15.81:0/646588674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 msgr2=0x55772b120660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:13.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.917+0000 7f01bca05b80 1 --2- 172.21.15.81:0/646588674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b120660 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f019400b550 tx=0x7f019402c040 comp rx=0 tx=0).stop 2024-05-03T16:49:13.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.918+0000 7f01bca05b80 1 -- 172.21.15.81:0/646588674 shutdown_connections 2024-05-03T16:49:13.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.918+0000 7f01bca05b80 1 --2- 172.21.15.81:0/646588674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b120660 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.918+0000 7f01bca05b80 1 --2- 172.21.15.81:0/646588674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b125ee0 0x55772b131cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.918+0000 7f01bca05b80 1 --2- 172.21.15.81:0/646588674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b1268a0 0x55772b11aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.918+0000 7f01bca05b80 1 -- 172.21.15.81:0/646588674 >> 172.21.15.81:0/646588674 conn(0x55772b09e680 msgr2=0x55772b13ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:13.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.918+0000 7f01bca05b80 1 -- 172.21.15.81:0/646588674 shutdown_connections 2024-05-03T16:49:13.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.918+0000 7f01bca05b80 1 -- 172.21.15.81:0/646588674 wait complete. 2024-05-03T16:49:13.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.918+0000 7f01bca05b80 1 -- start start 2024-05-03T16:49:13.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.918+0000 7f01bca05b80 1 Processor -- start 2024-05-03T16:49:13.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.919+0000 7f01bca05b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b125ee0 0x55772b14aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:13.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.919+0000 7f01bca05b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b1268a0 0x55772b130c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:13.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.919+0000 7f01bca05b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b131380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:13.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.919+0000 7f01bca05b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55772b140d50 con 0x55772b12bb80 2024-05-03T16:49:13.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.919+0000 7f01bca05b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55772b140680 con 0x55772b1268a0 2024-05-03T16:49:13.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.919+0000 7f01bca05b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55772b141420 con 0x55772b125ee0 2024-05-03T16:49:13.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.919+0000 7f01bca05b80 10 client.0 _ll_register_callbacks cb 0x55772b01fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T16:49:13.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.919+0000 7f01a2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b131380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:13.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.919+0000 7f01a2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b131380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41862/0 (socket says 172.21.15.81:41862) 2024-05-03T16:49:13.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.919+0000 7f01a2a00700 1 -- 172.21.15.81:0/3842655881 learned_addr learned my addr 172.21.15.81:0/3842655881 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:13.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.919+0000 7f01ab400700 1 --2- 172.21.15.81:0/3842655881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b1268a0 0x55772b130c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:13.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.920+0000 7f01a2a00700 1 --2- 172.21.15.81:0/3842655881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b125ee0 0x55772b14aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:13.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.920+0000 7f01a2a00700 1 -- 172.21.15.81:0/3842655881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b125ee0 msgr2=0x55772b14aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:13.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.920+0000 7f01a2a00700 1 --2- 172.21.15.81:0/3842655881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b125ee0 0x55772b14aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.920+0000 7f01a2a00700 1 -- 172.21.15.81:0/3842655881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b1268a0 msgr2=0x55772b130c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T16:49:13.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.920+0000 7f01a2a00700 1 --2- 172.21.15.81:0/3842655881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b1268a0 0x55772b130c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.920+0000 7f01a2a00700 1 -- 172.21.15.81:0/3842655881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55772b11d450 con 0x55772b12bb80 2024-05-03T16:49:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.920+0000 7f01ab400700 1 --2- 172.21.15.81:0/3842655881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b1268a0 0x55772b130c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:49:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.920+0000 7f01a2a00700 1 --2- 172.21.15.81:0/3842655881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b131380 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0194004970 tx=0x7f0194014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a915fe3b217668af server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.920+0000 7f0199600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-03T16:49:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.920+0000 7f0199600700 1 -- 172.21.15.81:0/3842655881 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019401b470 con 0x55772b12bb80 2024-05-03T16:49:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.920+0000 7f0199600700 1 -- 172.21.15.81:0/3842655881 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f019401b610 con 0x55772b12bb80 2024-05-03T16:49:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.920+0000 7f01bca05b80 1 -- 172.21.15.81:0/3842655881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0194016070 con 0x55772b12bb80 2024-05-03T16:49:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.921+0000 7f0199600700 1 -- 172.21.15.81:0/3842655881 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f019401b810 con 0x55772b12bb80 2024-05-03T16:49:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.921+0000 7f01bca05b80 10 client.15276 fetch_fsmap learned FSMap version 29 2024-05-03T16:49:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.921+0000 7f01bca05b80 1 -- 172.21.15.81:0/3842655881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55772b1aaed0 con 0x55772b12bb80 2024-05-03T16:49:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.921+0000 7f0199600700 1 -- 172.21.15.81:0/3842655881 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0194016070 con 0x55772b12bb80 2024-05-03T16:49:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.921+0000 7f0199600700 1 -- 172.21.15.81:0/3842655881 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0194033430 con 0x55772b12bb80 2024-05-03T16:49:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.921+0000 7f01bca05b80 10 client.15276 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T16:49:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.921+0000 7f01bca05b80 10 client.15276 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-03T16:49:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.921+0000 7f01bca05b80 20 client.15276 populate_metadata read hostname 'smithi081' 2024-05-03T16:49:13.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.921+0000 7f01bca05b80 1 --2- 172.21.15.81:0/3842655881 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55772b1af540 0x55772b1ae250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:13.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.921+0000 7f01bca05b80 4 client.15276 mds_command: new command op to 34466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T16:49:13.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.921+0000 7f01bca05b80 1 -- 172.21.15.81:0/3842655881 --> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] -- command(tid 0: {"prefix": "status"}) -- 0x55772b0863b0 con 0x55772b1af540 2024-05-03T16:49:13.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.922+0000 7f01ab400700 1 --2- 172.21.15.81:0/3842655881 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55772b1af540 0x55772b1ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:13.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.923+0000 7f0199600700 10 client.15276 ms_handle_connect on v2:172.21.15.134:6838/2061491127 2024-05-03T16:49:13.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.923+0000 7f01ab400700 1 --2- 172.21.15.81:0/3842655881 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55772b1af540 0x55772b1ae250 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae84a26c51773911 server_cookie=49ff2a2ef6599116 in_seq=0 out_seq=0 2024-05-03T16:49:13.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.923+0000 7f0199600700 1 -- 172.21.15.81:0/3842655881 <== mds.0 v2:172.21.15.134:6838/2061491127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55772b0863b0 con 0x55772b1af540 2024-05-03T16:49:13.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.923+0000 7f0199600700 10 client.15276 handle_command_reply: tid=0 2024-05-03T16:49:13.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.923+0000 7f01bca05b80 1 client.15276 shutdown 2024-05-03T16:49:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.924+0000 7f01bca05b80 1 -- 172.21.15.81:0/3842655881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 msgr2=0x55772b131380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.924+0000 7f01bca05b80 1 --2- 172.21.15.81:0/3842655881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b131380 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0194004970 tx=0x7f0194014040 comp rx=0 tx=0).stop 2024-05-03T16:49:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.924+0000 7f01bca05b80 1 -- 172.21.15.81:0/3842655881 shutdown_connections 2024-05-03T16:49:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.924+0000 7f01bca05b80 1 --2- 172.21.15.81:0/3842655881 >> [v2:172.21.15.134:6838/2061491127,v1:172.21.15.134:6839/2061491127] conn(0x55772b1af540 0x55772b1ae250 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.924+0000 7f01bca05b80 1 --2- 172.21.15.81:0/3842655881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55772b125ee0 0x55772b14aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.924+0000 7f01bca05b80 1 --2- 172.21.15.81:0/3842655881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55772b12bb80 0x55772b131380 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.924+0000 7f01bca05b80 1 --2- 172.21.15.81:0/3842655881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55772b1268a0 0x55772b130c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.924+0000 7f01bca05b80 1 -- 172.21.15.81:0/3842655881 >> 172.21.15.81:0/3842655881 conn(0x55772b09e680 msgr2=0x55772b12f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.924+0000 7f0199600700 0 client.15276 ms_handle_reset on v2:172.21.15.134:6838/2061491127 2024-05-03T16:49:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.924+0000 7f01bca05b80 1 -- 172.21.15.81:0/3842655881 shutdown_connections 2024-05-03T16:49:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.924+0000 7f01bca05b80 1 -- 172.21.15.81:0/3842655881 wait complete. 2024-05-03T16:49:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.924+0000 7f01bca05b80 20 client.15276 trim_cache size 0 max 16384 2024-05-03T16:49:13.928 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-03T16:49:13.928 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8988869e-096a-11ef-bc97-c7b262605968", 2024-05-03T16:49:13.928 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-05-03T16:49:13.928 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 34466, 2024-05-03T16:49:13.928 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-05-03T16:49:13.928 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-05-03T16:49:13.928 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-05-03T16:49:13.928 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 314.98484555800002, 2024-05-03T16:49:13.928 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 29, 2024-05-03T16:49:13.928 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 91, 2024-05-03T16:49:13.928 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 91, 2024-05-03T16:49:13.928 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 334.51746050700001 2024-05-03T16:49:13.928 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-03T16:49:13.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.925+0000 7f01b0a00700 1 -- 172.21.15.81:0/223357164 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f01900b2990 msgr2=0x7f01900b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:13.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.925+0000 7f01b0a00700 1 --2- 172.21.15.81:0/223357164 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f01900b2990 0x7f01900b4e50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f01a40dff70 tx=0x7f01a4004750 comp rx=0 tx=0).stop 2024-05-03T16:49:13.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.925+0000 7f01b0a00700 1 -- 172.21.15.81:0/223357164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ac10da20 msgr2=0x7f01ac19ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:13.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.925+0000 7f01b0a00700 1 --2- 172.21.15.81:0/223357164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ac10da20 0x7f01ac19ba90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f01a400d980 tx=0x7f01a400dc90 comp rx=0 tx=0).stop 2024-05-03T16:49:13.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.925+0000 7f01b0a00700 1 -- 172.21.15.81:0/223357164 shutdown_connections 2024-05-03T16:49:13.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.925+0000 7f01b0a00700 1 --2- 172.21.15.81:0/223357164 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f01900b2990 0x7f01900b4e50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.925+0000 7f01b0a00700 1 --2- 172.21.15.81:0/223357164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01ac104640 0x7f01ac1a18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.925+0000 7f01b0a00700 1 --2- 172.21.15.81:0/223357164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ac10da20 0x7f01ac19ba90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.925+0000 7f01b0a00700 1 --2- 172.21.15.81:0/223357164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01ac104f60 0x7f01ac1a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:13.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.925+0000 7f01b0a00700 1 -- 172.21.15.81:0/223357164 >> 172.21.15.81:0/223357164 conn(0x7f01ac0fde30 msgr2=0x7f01ac0feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:13.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.925+0000 7f01b0a00700 1 -- 172.21.15.81:0/223357164 shutdown_connections 2024-05-03T16:49:13.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:13.925+0000 7f01b0a00700 1 -- 172.21.15.81:0/223357164 wait complete. 2024-05-03T16:49:14.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:14 smithi146 ceph-mon[32357]: pgmap v535: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:49:14.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:14 smithi134 ceph-mon[31708]: pgmap v535: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:49:14.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:14 smithi081 ceph-mon[28640]: pgmap v535: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:49:15.021 INFO:teuthology.run_tasks:Running task sequential... 2024-05-03T16:49:15.031 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-03T16:49:15.031 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-03T16:49:15.031 INFO:teuthology.task.print:Enabling mgr modules 2024-05-03T16:49:15.032 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-03T16:49:15.093 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-03T16:49:15.093 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-03T16:49:15.093 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-05-03T16:49:15.093 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-03T16:49:15.093 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-03T16:49:15.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:49:15.094 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-05-03T16:49:15.154 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-03T16:49:15.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:49:15.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T16:49:15.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:49:15.238 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-05-03T16:49:15.353 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-03T16:49:15.353 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-03T16:49:15.773 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T16:49:16.186 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:16 smithi081 ceph-mon[28640]: pgmap v536: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:16.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:16 smithi146 ceph-mon[32357]: pgmap v536: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:16.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:16 smithi134 ceph-mon[31708]: pgmap v536: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:18.237 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:18 smithi081 ceph-mon[28640]: pgmap v537: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:49:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.277+0000 7fb245a00700 1 -- 172.21.15.81:0/4011373472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240103750 msgr2=0x7fb240103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.277+0000 7fb245a00700 1 --2- 172.21.15.81:0/4011373472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240103750 0x7fb240103b30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb23000b0d0 tx=0x7fb23000b3e0 comp rx=0 tx=0).stop 2024-05-03T16:49:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.277+0000 7fb245a00700 1 -- 172.21.15.81:0/4011373472 shutdown_connections 2024-05-03T16:49:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.277+0000 7fb245a00700 1 --2- 172.21.15.81:0/4011373472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb240108850 0x7fb2401103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.277+0000 7fb245a00700 1 --2- 172.21.15.81:0/4011373472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240103750 0x7fb240103b30 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.277+0000 7fb245a00700 1 --2- 172.21.15.81:0/4011373472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb240104100 0x7fb240108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.277+0000 7fb245a00700 1 -- 172.21.15.81:0/4011373472 >> 172.21.15.81:0/4011373472 conn(0x7fb24007a600 msgr2=0x7fb24007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.277+0000 7fb245a00700 1 -- 172.21.15.81:0/4011373472 shutdown_connections 2024-05-03T16:49:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.277+0000 7fb245a00700 1 -- 172.21.15.81:0/4011373472 wait complete. 2024-05-03T16:49:18.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.278+0000 7fb245a00700 1 Processor -- start 2024-05-03T16:49:18.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.278+0000 7fb245a00700 1 -- start start 2024-05-03T16:49:18.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.279+0000 7fb245a00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb240103750 0x7fb2401a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:18.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.279+0000 7fb245a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240104100 0x7fb2401a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:18.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.279+0000 7fb245a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb240108850 0x7fb24019bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:18.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.279+0000 7fb245a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb240113540 con 0x7fb240104100 2024-05-03T16:49:18.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.279+0000 7fb245a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb2401133c0 con 0x7fb240108850 2024-05-03T16:49:18.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.279+0000 7fb245a00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb2401136c0 con 0x7fb240103750 2024-05-03T16:49:18.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.279+0000 7fb236000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240104100 0x7fb2401a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:18.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.279+0000 7fb236000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240104100 0x7fb2401a1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38252/0 (socket says 172.21.15.81:38252) 2024-05-03T16:49:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.279+0000 7fb236000700 1 -- 172.21.15.81:0/1429115897 learned_addr learned my addr 172.21.15.81:0/1429115897 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.280+0000 7fb23ea00700 1 --2- 172.21.15.81:0/1429115897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb240103750 0x7fb2401a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.280+0000 7fb23f400700 1 --2- 172.21.15.81:0/1429115897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb240108850 0x7fb24019bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.280+0000 7fb236000700 1 -- 172.21.15.81:0/1429115897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb240103750 msgr2=0x7fb2401a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.280+0000 7fb236000700 1 --2- 172.21.15.81:0/1429115897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb240103750 0x7fb2401a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:18.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.280+0000 7fb236000700 1 -- 172.21.15.81:0/1429115897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb240108850 msgr2=0x7fb24019bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:18.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.280+0000 7fb236000700 1 --2- 172.21.15.81:0/1429115897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb240108850 0x7fb24019bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:18.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.280+0000 7fb236000700 1 -- 172.21.15.81:0/1429115897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24019c260 con 0x7fb240104100 2024-05-03T16:49:18.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.280+0000 7fb236000700 1 --2- 172.21.15.81:0/1429115897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240104100 0x7fb2401a1e80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb22800d980 tx=0x7fb22800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:18.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.280+0000 7fb237e00700 1 -- 172.21.15.81:0/1429115897 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb228017070 con 0x7fb240104100 2024-05-03T16:49:18.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.280+0000 7fb237e00700 1 -- 172.21.15.81:0/1429115897 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb228004830 con 0x7fb240104100 2024-05-03T16:49:18.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.280+0000 7fb237e00700 1 -- 172.21.15.81:0/1429115897 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2280053a0 con 0x7fb240104100 2024-05-03T16:49:18.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.281+0000 7fb245a00700 1 -- 172.21.15.81:0/1429115897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb24019c550 con 0x7fb240104100 2024-05-03T16:49:18.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.281+0000 7fb245a00700 1 -- 172.21.15.81:0/1429115897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2401a8810 con 0x7fb240104100 2024-05-03T16:49:18.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.282+0000 7fb245a00700 1 -- 172.21.15.81:0/1429115897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb24006a190 con 0x7fb240104100 2024-05-03T16:49:18.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.284+0000 7fb237e00700 1 -- 172.21.15.81:0/1429115897 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb2280049e0 con 0x7fb240104100 2024-05-03T16:49:18.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.286+0000 7fb237e00700 1 --2- 172.21.15.81:0/1429115897 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb2240b2910 0x7fb2240b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:18.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.286+0000 7fb237e00700 1 -- 172.21.15.81:0/1429115897 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fb2280e23c0 con 0x7fb240104100 2024-05-03T16:49:18.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.286+0000 7fb23ea00700 1 --2- 172.21.15.81:0/1429115897 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb2240b2910 0x7fb2240b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:18.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.287+0000 7fb23ea00700 1 --2- 172.21.15.81:0/1429115897 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb2240b2910 0x7fb2240b4dd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb230009fd0 tx=0x7fb23000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:18.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.291+0000 7fb237e00700 1 -- 172.21.15.81:0/1429115897 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb228020020 con 0x7fb240104100 2024-05-03T16:49:18.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:18 smithi146 ceph-mon[32357]: pgmap v537: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:49:18.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:18 smithi134 ceph-mon[31708]: pgmap v537: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:49:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.582+0000 7fb245a00700 1 -- 172.21.15.81:0/1429115897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb2401a89e0 con 0x7fb240104100 2024-05-03T16:49:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.583+0000 7fb237e00700 1 -- 172.21.15.81:0/1429115897 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+88 (secure 0 0 0) 0x7fb2280a9b70 con 0x7fb240104100 2024-05-03T16:49:18.584 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-03T16:49:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.586+0000 7fb245a00700 1 -- 172.21.15.81:0/1429115897 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb2240b2910 msgr2=0x7fb2240b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.586+0000 7fb245a00700 1 --2- 172.21.15.81:0/1429115897 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb2240b2910 0x7fb2240b4dd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb230009fd0 tx=0x7fb23000b040 comp rx=0 tx=0).stop 2024-05-03T16:49:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.586+0000 7fb245a00700 1 -- 172.21.15.81:0/1429115897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240104100 msgr2=0x7fb2401a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.586+0000 7fb245a00700 1 --2- 172.21.15.81:0/1429115897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240104100 0x7fb2401a1e80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb22800d980 tx=0x7fb22800dd40 comp rx=0 tx=0).stop 2024-05-03T16:49:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.586+0000 7fb245a00700 1 -- 172.21.15.81:0/1429115897 shutdown_connections 2024-05-03T16:49:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.586+0000 7fb245a00700 1 --2- 172.21.15.81:0/1429115897 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fb2240b2910 0x7fb2240b4dd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.586+0000 7fb245a00700 1 --2- 172.21.15.81:0/1429115897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb240103750 0x7fb2401a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.586+0000 7fb245a00700 1 --2- 172.21.15.81:0/1429115897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb240108850 0x7fb24019bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.586+0000 7fb245a00700 1 --2- 172.21.15.81:0/1429115897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240104100 0x7fb2401a1e80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.586+0000 7fb245a00700 1 -- 172.21.15.81:0/1429115897 >> 172.21.15.81:0/1429115897 conn(0x7fb24007a600 msgr2=0x7fb240101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.586+0000 7fb245a00700 1 -- 172.21.15.81:0/1429115897 shutdown_connections 2024-05-03T16:49:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:18.586+0000 7fb245a00700 1 -- 172.21.15.81:0/1429115897 wait complete. 2024-05-03T16:49:19.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:19 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/1429115897' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-03T16:49:19.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:19 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/1429115897' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-03T16:49:19.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:19 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1429115897' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-03T16:49:19.576 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-03T16:49:19.576 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-03T16:49:19.576 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-05-03T16:49:19.576 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-03T16:49:19.576 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-03T16:49:19.576 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-03T16:49:19.577 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-03T16:49:19.577 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-03T16:49:19.577 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-03T16:49:19.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:49:19.577 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-05-03T16:49:19.622 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-03T16:49:19.623 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-03T16:49:19.623 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-05-03T16:49:19.623 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-05-03T16:49:19.623 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-05-03T16:49:19.623 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-05-03T16:49:19.623 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-03T16:49:19.623 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-05-03T16:49:19.623 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-05-03T16:49:19.623 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-03T16:49:19.624 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-05-03T16:49:19.624 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-05-03T16:49:19.624 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-03T16:49:19.624 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-05-03T16:49:19.624 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-03T16:49:19.624 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-05-03T16:49:19.624 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-03T16:49:19.624 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 41607sec preferred_lft 41607sec 2024-05-03T16:49:19.624 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2024-05-03T16:49:19.624 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-05-03T16:49:19.625 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-03T16:49:19.625 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T16:49:19.625 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-03T16:49:19.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-05-03T16:49:19.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-05-03T16:49:19.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-05-03T16:49:19.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-03T16:49:19.626 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-03T16:49:19.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T16:49:19.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T16:49:19.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:49:19.904 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-03T16:49:19.963 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-05-03T16:49:19.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:49:19.967 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-05-03T16:49:20.009 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-05-03T16:49:20.009 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-03T16:49:20.010 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-03T16:49:20.010 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-03T16:49:20.010 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-03T16:49:20.010 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T16:49:20.010 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-03T16:49:20.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-03T16:49:20.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-03T16:49:20.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-03T16:49:20.010 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-03T16:49:20.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T16:49:20.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T16:49:20.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:49:20.260 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-05-03T16:49:20.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:49:20.305 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-05-03T16:49:20.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:20 smithi146 ceph-mon[32357]: pgmap v538: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:20.400 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T16:49:20.401 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-03T16:49:20.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T16:49:20.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-03T16:49:20.401 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-03T16:49:20.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:20 smithi134 ceph-mon[31708]: pgmap v538: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:20.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:20 smithi081 ceph-mon[28640]: pgmap v538: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:20.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T16:49:20.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T16:49:20.581 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-03T16:49:20.581 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T16:49:20.581 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-03T16:49:20.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-03T16:49:20.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-03T16:49:20.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-03T16:49:20.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-03T16:49:20.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-03T16:49:20.582 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-03T16:49:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T16:49:20.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T16:49:20.843 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T16:49:20.843 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-03T16:49:20.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-05-03T16:49:20.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-05-03T16:49:20.843 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-03T16:49:20.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T16:49:21.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T16:49:21.041 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-05-03T16:49:21.041 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-03T16:49:21.041 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-03T16:49:21.084 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-03T16:49:21.084 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-03T16:49:21.085 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-03T16:49:21.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-05-03T16:49:21.263 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-05-03T16:49:21.318 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-05-03T16:49:21.319 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-05-03T16:49:21.319 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-05-03T16:49:21.319 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-05-03T16:49:21.319 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-05-03T16:49:21.319 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-05-03T16:49:21.319 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-05-03T16:49:21.319 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-05-03T16:49:21.319 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-05-03T16:49:21.319 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-05-03T16:49:21.319 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-05-03T16:49:21.319 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-05-03T16:49:21.319 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T16:49:21.319 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-05-03T16:49:21.319 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-05-03T16:49:21.320 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-05-03T16:49:21.320 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-05-03T16:49:21.320 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-05-03T16:49:21.320 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-05-03T16:49:21.320 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-05-03T16:49:21.320 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-03T16:49:21.320 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-03T16:49:21.320 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-05-03T16:49:21.320 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-05-03T16:49:21.320 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-05-03T16:49:21.320 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay 2024-05-03T16:49:21.320 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/ef21a1765c814f7b199172b2380c4ab6b7deae0ffb2ec0845a59b930e1ee14eb/merged 2024-05-03T16:49:21.320 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/97623808ebcaa476288032bccd5e0b81feafe3af096f10120979307cad09599f/merged 2024-05-03T16:49:21.320 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/0 2024-05-03T16:49:21.321 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T16:49:21.321 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/59e6e395e56c0dd894fdf1d362da8edec154ba9aa4eec74c6e0ecd5e3618190e/merged 2024-05-03T16:49:21.321 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/f6bcc11df8066728c3695f63db3505216cf09469ed1f476056eba47a2eb2ad77/merged 2024-05-03T16:49:21.321 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/2da88de54e672105906813d0dd30341cd8d2cb89eeb18e1e9b967ebd047dcb65/merged 2024-05-03T16:49:21.321 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/ab038f1f8f511d57f464b8764e91bd422fddf64a83dd5fffc7c280bce71e6c29/merged 2024-05-03T16:49:21.321 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/2641176c9814c14c3705833a66ff67bfd5b1ea4e117b811d2496dda6b26782a4/merged 2024-05-03T16:49:21.321 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/72f4b088b79e7a1ee2706605e7b13d097d09dbbcace9ce15fd83e4ba1e820777/merged 2024-05-03T16:49:21.321 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/c0e43eac94a5dd223e4b4721f5b1a02373c4ac98289402d78b35a57063c7dd59/merged 2024-05-03T16:49:21.321 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/e1da9ee5148cd75d55a64da26cdfe0cb72be42e0be8955cbddfcfe56893cbab6/merged 2024-05-03T16:49:21.321 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-05-03T16:49:21.321 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T16:49:21.321 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T16:49:21.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:49:21.322 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-05-03T16:49:21.366 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-03T16:49:21.366 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/3d1cfc25-1840-433b-9b1c-49134d271492 --client_fs=cephfs) 2024-05-03T16:49:21.413 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-05-03T16:49:21.488 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-05-03T16:49:21.531 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-05-03T16:49:21.532 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-05-03T16:49:21.532 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-05-03T16:49:21.532 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-05-03T16:49:21.532 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-05-03T16:49:21.532 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-05-03T16:49:21.532 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-05-03T16:49:21.532 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-05-03T16:49:21.532 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-05-03T16:49:21.532 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-05-03T16:49:21.532 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-05-03T16:49:21.533 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-05-03T16:49:21.533 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T16:49:21.533 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-05-03T16:49:21.533 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-05-03T16:49:21.533 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-05-03T16:49:21.533 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-05-03T16:49:21.533 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-05-03T16:49:21.533 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-05-03T16:49:21.533 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-05-03T16:49:21.533 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-03T16:49:21.533 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-03T16:49:21.533 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-05-03T16:49:21.533 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-05-03T16:49:21.534 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-05-03T16:49:21.534 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay 2024-05-03T16:49:21.534 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/ef21a1765c814f7b199172b2380c4ab6b7deae0ffb2ec0845a59b930e1ee14eb/merged 2024-05-03T16:49:21.534 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/97623808ebcaa476288032bccd5e0b81feafe3af096f10120979307cad09599f/merged 2024-05-03T16:49:21.534 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/0 2024-05-03T16:49:21.534 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T16:49:21.534 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/59e6e395e56c0dd894fdf1d362da8edec154ba9aa4eec74c6e0ecd5e3618190e/merged 2024-05-03T16:49:21.534 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/f6bcc11df8066728c3695f63db3505216cf09469ed1f476056eba47a2eb2ad77/merged 2024-05-03T16:49:21.534 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/2da88de54e672105906813d0dd30341cd8d2cb89eeb18e1e9b967ebd047dcb65/merged 2024-05-03T16:49:21.535 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/ab038f1f8f511d57f464b8764e91bd422fddf64a83dd5fffc7c280bce71e6c29/merged 2024-05-03T16:49:21.535 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/2641176c9814c14c3705833a66ff67bfd5b1ea4e117b811d2496dda6b26782a4/merged 2024-05-03T16:49:21.535 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/72f4b088b79e7a1ee2706605e7b13d097d09dbbcace9ce15fd83e4ba1e820777/merged 2024-05-03T16:49:21.535 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/c0e43eac94a5dd223e4b4721f5b1a02373c4ac98289402d78b35a57063c7dd59/merged 2024-05-03T16:49:21.535 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/e1da9ee5148cd75d55a64da26cdfe0cb72be42e0be8955cbddfcfe56893cbab6/merged 2024-05-03T16:49:21.535 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-05-03T16:49:21.535 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T16:49:21.535 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T16:49:21.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:49:21.536 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-05-03T16:49:21.596 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2024-05-03T16:49:21.594+0000 7f171f635480 -1 init, newargv = 0x55c420b26410 newargc=15 2024-05-03T16:49:21.596 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[86143]: starting ceph client 2024-05-03T16:49:21.652 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[86143]: starting fuse 2024-05-03T16:49:22.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:22 smithi134 ceph-mon[31708]: pgmap v539: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:22.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:22 smithi081 ceph-mon[28640]: pgmap v539: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:22.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:22 smithi146 ceph-mon[32357]: pgmap v539: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:22.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-05-03T16:49:22.809 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-05-03T16:49:22.863 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-05-03T16:49:22.863 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-05-03T16:49:22.863 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-05-03T16:49:22.864 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-05-03T16:49:22.864 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-05-03T16:49:22.864 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-05-03T16:49:22.864 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-05-03T16:49:22.864 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-05-03T16:49:22.864 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-05-03T16:49:22.864 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-05-03T16:49:22.864 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-05-03T16:49:22.864 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-05-03T16:49:22.864 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T16:49:22.864 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-05-03T16:49:22.864 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-05-03T16:49:22.865 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-05-03T16:49:22.865 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-05-03T16:49:22.865 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-05-03T16:49:22.865 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-05-03T16:49:22.865 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-05-03T16:49:22.865 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-03T16:49:22.865 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-03T16:49:22.865 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-05-03T16:49:22.865 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-05-03T16:49:22.865 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-05-03T16:49:22.865 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay 2024-05-03T16:49:22.866 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/ef21a1765c814f7b199172b2380c4ab6b7deae0ffb2ec0845a59b930e1ee14eb/merged 2024-05-03T16:49:22.866 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/97623808ebcaa476288032bccd5e0b81feafe3af096f10120979307cad09599f/merged 2024-05-03T16:49:22.866 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/0 2024-05-03T16:49:22.866 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T16:49:22.866 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/59e6e395e56c0dd894fdf1d362da8edec154ba9aa4eec74c6e0ecd5e3618190e/merged 2024-05-03T16:49:22.867 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/f6bcc11df8066728c3695f63db3505216cf09469ed1f476056eba47a2eb2ad77/merged 2024-05-03T16:49:22.867 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/2da88de54e672105906813d0dd30341cd8d2cb89eeb18e1e9b967ebd047dcb65/merged 2024-05-03T16:49:22.867 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/ab038f1f8f511d57f464b8764e91bd422fddf64a83dd5fffc7c280bce71e6c29/merged 2024-05-03T16:49:22.867 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/2641176c9814c14c3705833a66ff67bfd5b1ea4e117b811d2496dda6b26782a4/merged 2024-05-03T16:49:22.867 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/72f4b088b79e7a1ee2706605e7b13d097d09dbbcace9ce15fd83e4ba1e820777/merged 2024-05-03T16:49:22.867 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/c0e43eac94a5dd223e4b4721f5b1a02373c4ac98289402d78b35a57063c7dd59/merged 2024-05-03T16:49:22.867 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/e1da9ee5148cd75d55a64da26cdfe0cb72be42e0be8955cbddfcfe56893cbab6/merged 2024-05-03T16:49:22.867 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-05-03T16:49:22.867 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T16:49:22.867 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T16:49:22.867 INFO:teuthology.orchestra.run.smithi081.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-03T16:49:22.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:49:22.868 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-05-03T16:49:22.918 INFO:teuthology.orchestra.run.smithi081.stdout:114 2024-05-03T16:49:22.918 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [114] 2024-05-03T16:49:22.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-05-03T16:49:22.918 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-05-03T16:49:22.918 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-05-03T16:49:22.918 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-05-03T16:49:22.918 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-05-03T16:49:22.919 DEBUG:teuthology.orchestra.run.smithi081:> 2024-05-03T16:49:22.919 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-05-03T16:49:22.919 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-03T16:49:22.919 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-05-03T16:49:22.919 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-03T16:49:22.919 DEBUG:teuthology.orchestra.run.smithi081:> 2024-05-03T16:49:22.919 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-05-03T16:49:22.919 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-05-03T16:49:22.919 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-05-03T16:49:22.919 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-05-03T16:49:22.919 DEBUG:teuthology.orchestra.run.smithi081:> 2024-05-03T16:49:22.919 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-05-03T16:49:22.919 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-03T16:49:22.919 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-03T16:49:22.919 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-03T16:49:22.919 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-05-03T16:49:22.919 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-05-03T16:49:22.920 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-05-03T16:49:22.920 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-03T16:49:22.920 DEBUG:teuthology.orchestra.run.smithi081:> 2024-05-03T16:49:22.920 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2024-05-03T16:49:22.920 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-05-03T16:49:23.084 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.86143.asok 2024-05-03T16:49:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T16:49:23.103 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.86143.asok 2024-05-03T16:49:23.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:49:23.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.86143.asok status 2024-05-03T16:49:23.330 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-03T16:49:23.330 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-05-03T16:49:23.330 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "9a047fe7599a549042d06a3fb5b6813a203eabea", 2024-05-03T16:49:23.331 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev)", 2024-05-03T16:49:23.331 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2024-05-03T16:49:23.331 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-05-03T16:49:23.331 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-03T16:49:23.331 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "86143", 2024-05-03T16:49:23.331 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/volumes/qa/sv_0/3d1cfc25-1840-433b-9b1c-49134d271492" 2024-05-03T16:49:23.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-03T16:49:23.331 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-05-03T16:49:23.331 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-05-03T16:49:23.331 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 15288, 2024-05-03T16:49:23.331 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-05-03T16:49:23.331 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-05-03T16:49:23.331 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-05-03T16:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 15288 2024-05-03T16:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-03T16:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-05-03T16:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-03T16:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-05-03T16:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2182505374 2024-05-03T16:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-03T16:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-03T16:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-05-03T16:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-03T16:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-05-03T16:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2182505374 2024-05-03T16:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-03T16:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.15288 192.168.0.1:0/2182505374", 2024-05-03T16:49:23.332 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/2182505374", 2024-05-03T16:49:23.333 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 5, 2024-05-03T16:49:23.333 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 29, 2024-05-03T16:49:23.333 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 91, 2024-05-03T16:49:23.333 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-05-03T16:49:23.333 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-05-03T16:49:23.333 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-05-03T16:49:23.333 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-03T16:49:23.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:49:23.346 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-05-03T16:49:23.346 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-03T16:49:23.396 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-05-03T16:49:23.397 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-03T16:49:23.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T16:49:23.397 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-03T16:49:23.482 INFO:teuthology.run_tasks:Running task exec... 2024-05-03T16:49:23.493 INFO:teuthology.task.exec:Executing custom commands... 2024-05-03T16:49:23.493 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-05-03T16:49:23.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-05-03T16:49:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.688+0000 7f1a04200640 1 -- 172.21.15.81:0/690489448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19fc06b7e0 msgr2=0x7f19fc109c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.688+0000 7f1a04200640 1 --2- 172.21.15.81:0/690489448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19fc06b7e0 0x7f19fc109c20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009900 tx=0x7f19f002a410 comp rx=0 tx=0).stop 2024-05-03T16:49:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.689+0000 7f1a04200640 1 -- 172.21.15.81:0/690489448 shutdown_connections 2024-05-03T16:49:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.689+0000 7f1a04200640 1 --2- 172.21.15.81:0/690489448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19fc10ff00 0x7f19fc1122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.689+0000 7f1a04200640 1 --2- 172.21.15.81:0/690489448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19fc10d5d0 0x7f19fc10f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.689+0000 7f1a04200640 1 --2- 172.21.15.81:0/690489448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19fc06b7e0 0x7f19fc109c20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.689+0000 7f1a04200640 1 -- 172.21.15.81:0/690489448 >> 172.21.15.81:0/690489448 conn(0x7f19fc06fbe0 msgr2=0x7f19fc072020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.689+0000 7f1a04200640 1 -- 172.21.15.81:0/690489448 shutdown_connections 2024-05-03T16:49:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.689+0000 7f1a04200640 1 -- 172.21.15.81:0/690489448 wait complete. 2024-05-03T16:49:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.690+0000 7f1a04200640 1 Processor -- start 2024-05-03T16:49:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.690+0000 7f1a04200640 1 -- start start 2024-05-03T16:49:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.690+0000 7f1a04200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19fc06b7e0 0x7f19fc1a8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.690+0000 7f1a04200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19fc10d5d0 0x7f19fc1a85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.690+0000 7f1a04200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19fc10ff00 0x7f19fc1aef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.690+0000 7f1a04200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc115b30 con 0x7f19fc10ff00 2024-05-03T16:49:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.690+0000 7f1a04200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc1159b0 con 0x7f19fc06b7e0 2024-05-03T16:49:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.690+0000 7f1a04200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc115cb0 con 0x7f19fc10d5d0 2024-05-03T16:49:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.690+0000 7f1a02200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19fc10ff00 0x7f19fc1aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.691+0000 7f1a02200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19fc10ff00 0x7f19fc1aef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38272/0 (socket says 172.21.15.81:38272) 2024-05-03T16:49:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.691+0000 7f1a02200640 1 -- 172.21.15.81:0/2449090074 learned_addr learned my addr 172.21.15.81:0/2449090074 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.691+0000 7f1a00e00640 1 --2- 172.21.15.81:0/2449090074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19fc10d5d0 0x7f19fc1a85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.691+0000 7f1a01800640 1 --2- 172.21.15.81:0/2449090074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19fc06b7e0 0x7f19fc1a8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.691+0000 7f1a02200640 1 -- 172.21.15.81:0/2449090074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19fc10d5d0 msgr2=0x7f19fc1a85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.691+0000 7f1a02200640 1 --2- 172.21.15.81:0/2449090074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19fc10d5d0 0x7f19fc1a85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.691+0000 7f1a02200640 1 -- 172.21.15.81:0/2449090074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19fc06b7e0 msgr2=0x7f19fc1a8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.691+0000 7f1a02200640 1 --2- 172.21.15.81:0/2449090074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19fc06b7e0 0x7f19fc1a8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.691+0000 7f1a02200640 1 -- 172.21.15.81:0/2449090074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19fc1af5a0 con 0x7f19fc10ff00 2024-05-03T16:49:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.691+0000 7f1a00e00640 1 --2- 172.21.15.81:0/2449090074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19fc10d5d0 0x7f19fc1a85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T16:49:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.691+0000 7f1a02200640 1 --2- 172.21.15.81:0/2449090074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19fc10ff00 0x7f19fc1aef00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009fd0 tx=0x7f19f400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.692+0000 7f19fa000640 1 -- 172.21.15.81:0/2449090074 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4017070 con 0x7f19fc10ff00 2024-05-03T16:49:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.692+0000 7f19fa000640 1 -- 172.21.15.81:0/2449090074 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19f4003e00 con 0x7f19fc10ff00 2024-05-03T16:49:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.692+0000 7f1a04200640 1 -- 172.21.15.81:0/2449090074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19fc1af890 con 0x7f19fc10ff00 2024-05-03T16:49:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.692+0000 7f19fa000640 1 -- 172.21.15.81:0/2449090074 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4010460 con 0x7f19fc10ff00 2024-05-03T16:49:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.692+0000 7f1a04200640 1 -- 172.21.15.81:0/2449090074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19fc1afde0 con 0x7f19fc10ff00 2024-05-03T16:49:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.693+0000 7f1a04200640 1 -- 172.21.15.81:0/2449090074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19fc1affe0 con 0x7f19fc10ff00 2024-05-03T16:49:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.695+0000 7f19fa000640 1 -- 172.21.15.81:0/2449090074 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f19f4003970 con 0x7f19fc10ff00 2024-05-03T16:49:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.697+0000 7f19fa000640 1 --2- 172.21.15.81:0/2449090074 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f19e40b29a0 0x7f19e40b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.697+0000 7f19fa000640 1 -- 172.21.15.81:0/2449090074 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f19f40e2a00 con 0x7f19fc10ff00 2024-05-03T16:49:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.697+0000 7f1a01800640 1 --2- 172.21.15.81:0/2449090074 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f19e40b29a0 0x7f19e40b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.698+0000 7f1a01800640 1 --2- 172.21.15.81:0/2449090074 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f19e40b29a0 0x7f19e40b4e60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f19f00057c0 tx=0x7f19f00095f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.701+0000 7f19fa000640 1 -- 172.21.15.81:0/2449090074 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f19f40aa1b0 con 0x7f19fc10ff00 2024-05-03T16:49:23.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:23.955+0000 7f1a04200640 1 -- 172.21.15.81:0/2449090074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f19fc1b0250 con 0x7f19fc10ff00 2024-05-03T16:49:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.071+0000 7f19fa000640 1 -- 172.21.15.81:0/2449090074 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v30) ==== 118+0+0 (secure 0 0 0) 0x7f19f40a9ab0 con 0x7f19fc10ff00 2024-05-03T16:49:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.075+0000 7f1a04200640 1 -- 172.21.15.81:0/2449090074 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f19e40b29a0 msgr2=0x7f19e40b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.075+0000 7f1a04200640 1 --2- 172.21.15.81:0/2449090074 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f19e40b29a0 0x7f19e40b4e60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f19f00057c0 tx=0x7f19f00095f0 comp rx=0 tx=0).stop 2024-05-03T16:49:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.075+0000 7f1a04200640 1 -- 172.21.15.81:0/2449090074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19fc10ff00 msgr2=0x7f19fc1aef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.075+0000 7f1a04200640 1 --2- 172.21.15.81:0/2449090074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19fc10ff00 0x7f19fc1aef00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009fd0 tx=0x7f19f400b260 comp rx=0 tx=0).stop 2024-05-03T16:49:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.075+0000 7f1a04200640 1 -- 172.21.15.81:0/2449090074 shutdown_connections 2024-05-03T16:49:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.075+0000 7f1a04200640 1 --2- 172.21.15.81:0/2449090074 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f19e40b29a0 0x7f19e40b4e60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.075+0000 7f1a04200640 1 --2- 172.21.15.81:0/2449090074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19fc10ff00 0x7f19fc1aef00 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.075+0000 7f1a04200640 1 --2- 172.21.15.81:0/2449090074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19fc10d5d0 0x7f19fc1a85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.075+0000 7f1a04200640 1 --2- 172.21.15.81:0/2449090074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19fc06b7e0 0x7f19fc1a8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.075+0000 7f1a04200640 1 -- 172.21.15.81:0/2449090074 >> 172.21.15.81:0/2449090074 conn(0x7f19fc06fbe0 msgr2=0x7f19fc10a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.075+0000 7f1a04200640 1 -- 172.21.15.81:0/2449090074 shutdown_connections 2024-05-03T16:49:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.075+0000 7f1a04200640 1 -- 172.21.15.81:0/2449090074 wait complete. 2024-05-03T16:49:24.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-05-03T16:49:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.296+0000 7f25fd600640 1 -- 172.21.15.81:0/824483548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25f8069380 msgr2=0x7f25f8101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.296+0000 7f25fd600640 1 --2- 172.21.15.81:0/824483548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25f8069380 0x7f25f8101e30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009900 tx=0x7f25e802a410 comp rx=0 tx=0).stop 2024-05-03T16:49:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.296+0000 7f25fd600640 1 -- 172.21.15.81:0/824483548 shutdown_connections 2024-05-03T16:49:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.296+0000 7f25fd600640 1 --2- 172.21.15.81:0/824483548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25f8107070 0x7f25f8109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.296+0000 7f25fd600640 1 --2- 172.21.15.81:0/824483548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25f8102370 0x7f25f81027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.296+0000 7f25fd600640 1 --2- 172.21.15.81:0/824483548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25f8069380 0x7f25f8101e30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.296+0000 7f25fd600640 1 -- 172.21.15.81:0/824483548 >> 172.21.15.81:0/824483548 conn(0x7f25f80fc1d0 msgr2=0x7f25f80fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T16:49:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.297+0000 7f25fd600640 1 -- 172.21.15.81:0/824483548 shutdown_connections 2024-05-03T16:49:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.297+0000 7f25fd600640 1 -- 172.21.15.81:0/824483548 wait complete. 2024-05-03T16:49:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.298+0000 7f25fd600640 1 Processor -- start 2024-05-03T16:49:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.298+0000 7f25fd600640 1 -- start start 2024-05-03T16:49:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.298+0000 7f25fd600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25f8069380 0x7f25f810c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.298+0000 7f25fd600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25f8102370 0x7f25f810adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.298+0000 7f25fd600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25f8107070 0x7f25f810b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.298+0000 7f25fd600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25f810e430 con 0x7f25f8107070 2024-05-03T16:49:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.298+0000 7f25fd600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f25f810e2b0 con 0x7f25f8069380 2024-05-03T16:49:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.298+0000 7f25fd600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f25f810e5b0 con 0x7f25f8102370 2024-05-03T16:49:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.299+0000 7f25f7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25f8107070 0x7f25f810b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.299+0000 7f25f7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25f8107070 0x7f25f810b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38300/0 (socket says 172.21.15.81:38300) 2024-05-03T16:49:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.299+0000 7f25f7400640 1 -- 172.21.15.81:0/2476086306 learned_addr learned my addr 172.21.15.81:0/2476086306 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T16:49:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.299+0000 7f25f6a00640 1 --2- 172.21.15.81:0/2476086306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25f8069380 0x7f25f810c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.299+0000 7f25f6000640 1 --2- 172.21.15.81:0/2476086306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25f8102370 0x7f25f810adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.299+0000 7f25f7400640 1 -- 172.21.15.81:0/2476086306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25f8102370 msgr2=0x7f25f810adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.299+0000 7f25f7400640 1 --2- 172.21.15.81:0/2476086306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25f8102370 0x7f25f810adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.299+0000 7f25f7400640 1 -- 172.21.15.81:0/2476086306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25f8069380 msgr2=0x7f25f810c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T16:49:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.299+0000 7f25f7400640 1 --2- 172.21.15.81:0/2476086306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25f8069380 0x7f25f810c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T16:49:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.299+0000 7f25f7400640 1 -- 172.21.15.81:0/2476086306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f810bbc0 con 0x7f25f8107070 2024-05-03T16:49:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.299+0000 7f25f7400640 1 --2- 172.21.15.81:0/2476086306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25f8107070 0x7f25f810b330 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f25f000eaa0 tx=0x7f25f000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.300+0000 7f25ef400640 1 -- 172.21.15.81:0/2476086306 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f000cdb0 con 0x7f25f8107070 2024-05-03T16:49:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.300+0000 7f25fd600640 1 -- 172.21.15.81:0/2476086306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f81a2bd0 con 0x7f25f8107070 2024-05-03T16:49:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.300+0000 7f25ef400640 1 -- 172.21.15.81:0/2476086306 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25f0005020 con 0x7f25f8107070 2024-05-03T16:49:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.300+0000 7f25ef400640 1 -- 172.21.15.81:0/2476086306 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f001f060 con 0x7f25f8107070 2024-05-03T16:49:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.300+0000 7f25fd600640 1 -- 172.21.15.81:0/2476086306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f81a3170 con 0x7f25f8107070 2024-05-03T16:49:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.301+0000 7f25fd600640 1 -- 172.21.15.81:0/2476086306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25f8105e80 con 0x7f25f8107070 2024-05-03T16:49:24.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.304+0000 7f25ef400640 1 -- 172.21.15.81:0/2476086306 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f25f0004a40 con 0x7f25f8107070 2024-05-03T16:49:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.306+0000 7f25ef400640 1 --2- 172.21.15.81:0/2476086306 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f25dc0b2920 0x7f25dc0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T16:49:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.307+0000 7f25ef400640 1 -- 172.21.15.81:0/2476086306 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f25f00e2dd0 con 0x7f25f8107070 2024-05-03T16:49:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.307+0000 7f25f6a00640 1 --2- 172.21.15.81:0/2476086306 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f25dc0b2920 0x7f25dc0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T16:49:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.308+0000 7f25f6a00640 1 --2- 172.21.15.81:0/2476086306 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f25dc0b2920 0x7f25dc0b4de0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f25e8006010 tx=0x7f25e80095f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T16:49:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.309+0000 7f25ef400640 1 -- 172.21.15.81:0/2476086306 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f25f0016030 con 0x7f25f8107070 2024-05-03T16:49:24.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:24 smithi134 ceph-mon[31708]: pgmap v540: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:49:24.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:24 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2449090074' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-03T16:49:24.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:24 smithi081 ceph-mon[28640]: pgmap v540: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:49:24.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:24 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2449090074' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-03T16:49:24.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:49:24.547+0000 7f25fd600640 1 -- 172.21.15.81:0/2476086306 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f25f8062f50 con 0x7f25dc0b2920 2024-05-03T16:49:24.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:24 smithi146 ceph-mon[32357]: pgmap v540: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:49:24.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:24 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2449090074' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-03T16:49:25.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:25 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2449090074' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-03T16:49:25.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:25 smithi134 ceph-mon[31708]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T16:49:25.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:25 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2449090074' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-03T16:49:25.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:25 smithi081 ceph-mon[28640]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T16:49:25.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:25 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2449090074' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-03T16:49:25.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:25 smithi146 ceph-mon[32357]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T16:49:26.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:26 smithi134 ceph-mon[31708]: pgmap v541: 129 pgs: 129 active+clean; 637 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-03T16:49:26.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:26 smithi134 ceph-mon[31708]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:49:26.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:26 smithi081 ceph-mon[28640]: pgmap v541: 129 pgs: 129 active+clean; 637 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-03T16:49:26.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:26 smithi081 ceph-mon[28640]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:49:26.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:26 smithi146 ceph-mon[32357]: pgmap v541: 129 pgs: 129 active+clean; 637 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-03T16:49:26.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:26 smithi146 ceph-mon[32357]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T16:49:28.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:28 smithi134 ceph-mon[31708]: pgmap v542: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-05-03T16:49:28.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:28 smithi081 ceph-mon[28640]: pgmap v542: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-05-03T16:49:28.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:28 smithi146 ceph-mon[32357]: pgmap v542: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-05-03T16:49:30.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:30 smithi134 ceph-mon[31708]: pgmap v543: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-05-03T16:49:30.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:30 smithi081 ceph-mon[28640]: pgmap v543: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-05-03T16:49:30.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:30 smithi146 ceph-mon[32357]: pgmap v543: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-05-03T16:49:32.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:32 smithi134 ceph-mon[31708]: pgmap v544: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-05-03T16:49:32.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:32 smithi081 ceph-mon[28640]: pgmap v544: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-05-03T16:49:32.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:32 smithi146 ceph-mon[32357]: pgmap v544: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-05-03T16:49:34.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:34 smithi081 ceph-mon[28640]: pgmap v545: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-05-03T16:49:34.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:34 smithi134 ceph-mon[31708]: pgmap v545: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-05-03T16:49:34.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:34 smithi146 ceph-mon[32357]: pgmap v545: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-05-03T16:49:36.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:36 smithi134 ceph-mon[31708]: pgmap v546: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-05-03T16:49:36.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:36 smithi081 ceph-mon[28640]: pgmap v546: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-05-03T16:49:36.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:36 smithi146 ceph-mon[32357]: pgmap v546: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-05-03T16:49:38.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:38 smithi134 ceph-mon[31708]: pgmap v547: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-03T16:49:38.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:38 smithi081 ceph-mon[28640]: pgmap v547: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-03T16:49:38.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:38 smithi146 ceph-mon[32357]: pgmap v547: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-03T16:49:40.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:40 smithi134 ceph-mon[31708]: pgmap v548: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:40.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:40 smithi081 ceph-mon[28640]: pgmap v548: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:40.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:40 smithi146 ceph-mon[32357]: pgmap v548: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:41.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:41 smithi134 ceph-mon[31708]: pgmap v549: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:41.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:41 smithi081 ceph-mon[28640]: pgmap v549: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:41.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:41 smithi146 ceph-mon[32357]: pgmap v549: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:43.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:43 smithi081 ceph-mon[28640]: pgmap v550: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:49:43.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:43 smithi146 ceph-mon[32357]: pgmap v550: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:49:43.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:43 smithi134 ceph-mon[31708]: pgmap v550: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:49:45.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:45 smithi146 ceph-mon[32357]: pgmap v551: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:45.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:45 smithi134 ceph-mon[31708]: pgmap v551: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:45.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:45 smithi081 ceph-mon[28640]: pgmap v551: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:47.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:47 smithi146 ceph-mon[32357]: pgmap v552: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:49:47.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:47 smithi134 ceph-mon[31708]: pgmap v552: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:49:47.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:47 smithi081 ceph-mon[28640]: pgmap v552: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:49:49.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:49 smithi146 ceph-mon[32357]: pgmap v553: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:49.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:49 smithi134 ceph-mon[31708]: pgmap v553: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:49.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:49 smithi081 ceph-mon[28640]: pgmap v553: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:51.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:51 smithi146 ceph-mon[32357]: pgmap v554: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:51.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:51 smithi134 ceph-mon[31708]: pgmap v554: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:51.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:51 smithi081 ceph-mon[28640]: pgmap v554: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:53.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:53 smithi146 ceph-mon[32357]: pgmap v555: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:49:53.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:53 smithi134 ceph-mon[31708]: pgmap v555: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:49:53.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:53 smithi081 ceph-mon[28640]: pgmap v555: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:49:55.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:55 smithi146 ceph-mon[32357]: pgmap v556: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:55.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:55 smithi134 ceph-mon[31708]: pgmap v556: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:55.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:55 smithi081 ceph-mon[28640]: pgmap v556: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:57.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:57 smithi146 ceph-mon[32357]: pgmap v557: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:49:57.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:57 smithi134 ceph-mon[31708]: pgmap v557: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:49:57.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:57 smithi081 ceph-mon[28640]: pgmap v557: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:49:59.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:49:59 smithi146 ceph-mon[32357]: pgmap v558: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:59.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:49:59 smithi134 ceph-mon[31708]: pgmap v558: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:49:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:49:59 smithi081 ceph-mon[28640]: pgmap v558: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:00.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:00 smithi134 ceph-mon[31708]: overall HEALTH_OK 2024-05-03T16:50:00.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:00 smithi081 ceph-mon[28640]: overall HEALTH_OK 2024-05-03T16:50:01.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:00 smithi146 ceph-mon[32357]: overall HEALTH_OK 2024-05-03T16:50:01.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:01 smithi134 ceph-mon[31708]: pgmap v559: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:01.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:01 smithi081 ceph-mon[28640]: pgmap v559: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:02.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:01 smithi146 ceph-mon[32357]: pgmap v559: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:03.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:03 smithi134 ceph-mon[31708]: pgmap v560: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:50:03.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:03 smithi081 ceph-mon[28640]: pgmap v560: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:50:04.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:03 smithi146 ceph-mon[32357]: pgmap v560: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:50:05.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:05 smithi134 ceph-mon[31708]: pgmap v561: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:05.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:05 smithi081 ceph-mon[28640]: pgmap v561: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:06.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:05 smithi146 ceph-mon[32357]: pgmap v561: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:07.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:07 smithi134 ceph-mon[31708]: pgmap v562: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:50:07.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:07 smithi081 ceph-mon[28640]: pgmap v562: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:50:08.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:07 smithi146 ceph-mon[32357]: pgmap v562: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:50:09.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:09 smithi134 ceph-mon[31708]: pgmap v563: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:09.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:09 smithi081 ceph-mon[28640]: pgmap v563: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:10.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:09 smithi146 ceph-mon[32357]: pgmap v563: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:11.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:11 smithi134 ceph-mon[31708]: pgmap v564: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:11.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:11 smithi081 ceph-mon[28640]: pgmap v564: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:12.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:11 smithi146 ceph-mon[32357]: pgmap v564: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:12.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:12 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:50:12.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:12 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:50:13.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:12 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:50:13.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:13 smithi134 ceph-mon[31708]: pgmap v565: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:50:13.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:50:13.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:50:13.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:50:13.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:13 smithi081 ceph-mon[28640]: pgmap v565: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:50:13.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:50:13.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:50:13.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:50:14.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:13 smithi146 ceph-mon[32357]: pgmap v565: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:50:14.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:50:14.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:50:14.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:50:15.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:15 smithi134 ceph-mon[31708]: pgmap v566: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:15.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:15 smithi081 ceph-mon[28640]: pgmap v566: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:16.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:15 smithi146 ceph-mon[32357]: pgmap v566: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:17.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:17 smithi134 ceph-mon[31708]: pgmap v567: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:50:17.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:17 smithi081 ceph-mon[28640]: pgmap v567: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:50:18.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:17 smithi146 ceph-mon[32357]: pgmap v567: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:50:19.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:19 smithi134 ceph-mon[31708]: pgmap v568: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:19.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:19 smithi081 ceph-mon[28640]: pgmap v568: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:20.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:19 smithi146 ceph-mon[32357]: pgmap v568: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:21.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:21 smithi134 ceph-mon[31708]: pgmap v569: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:21.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:21 smithi081 ceph-mon[28640]: pgmap v569: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:22.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:21 smithi146 ceph-mon[32357]: pgmap v569: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:23.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:23 smithi134 ceph-mon[31708]: pgmap v570: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:50:23.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:23 smithi081 ceph-mon[28640]: pgmap v570: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:50:24.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:23 smithi146 ceph-mon[32357]: pgmap v570: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:50:25.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:25 smithi134 ceph-mon[31708]: pgmap v571: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:25.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:25 smithi081 ceph-mon[28640]: pgmap v571: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:26.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:25 smithi146 ceph-mon[32357]: pgmap v571: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:27 smithi134 ceph-mon[31708]: pgmap v572: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:50:27.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:27 smithi081 ceph-mon[28640]: pgmap v572: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:50:28.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:27 smithi146 ceph-mon[32357]: pgmap v572: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:50:29.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:29 smithi134 ceph-mon[31708]: pgmap v573: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:29.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:29 smithi081 ceph-mon[28640]: pgmap v573: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:30.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:29 smithi146 ceph-mon[32357]: pgmap v573: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:31 smithi134 ceph-mon[31708]: pgmap v574: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:31.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:31 smithi081 ceph-mon[28640]: pgmap v574: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:32.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:31 smithi146 ceph-mon[32357]: pgmap v574: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:33.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:33 smithi134 ceph-mon[31708]: pgmap v575: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:50:33.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:33 smithi081 ceph-mon[28640]: pgmap v575: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:50:34.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:33 smithi146 ceph-mon[32357]: pgmap v575: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:50:35.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:35 smithi134 ceph-mon[31708]: pgmap v576: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:35.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:35 smithi081 ceph-mon[28640]: pgmap v576: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:36.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:35 smithi146 ceph-mon[32357]: pgmap v576: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:37.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:37 smithi134 ceph-mon[31708]: pgmap v577: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:50:37.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:37 smithi081 ceph-mon[28640]: pgmap v577: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:50:38.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:37 smithi146 ceph-mon[32357]: pgmap v577: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:50:39.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:39 smithi134 ceph-mon[31708]: pgmap v578: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:39.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:39 smithi081 ceph-mon[28640]: pgmap v578: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:40.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:39 smithi146 ceph-mon[32357]: pgmap v578: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:41.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:41 smithi134 ceph-mon[31708]: pgmap v579: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:41.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:41 smithi081 ceph-mon[28640]: pgmap v579: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:42.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:41 smithi146 ceph-mon[32357]: pgmap v579: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:43.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:43 smithi134 ceph-mon[31708]: pgmap v580: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:50:43.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:43 smithi081 ceph-mon[28640]: pgmap v580: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:50:44.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:43 smithi146 ceph-mon[32357]: pgmap v580: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:50:45.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:45 smithi081 ceph-mon[28640]: pgmap v581: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:46.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:45 smithi146 ceph-mon[32357]: pgmap v581: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:46.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:45 smithi134 ceph-mon[31708]: pgmap v581: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:47.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:47 smithi081 ceph-mon[28640]: pgmap v582: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:50:48.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:47 smithi146 ceph-mon[32357]: pgmap v582: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:50:48.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:47 smithi134 ceph-mon[31708]: pgmap v582: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:50:49.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:49 smithi081 ceph-mon[28640]: pgmap v583: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:50.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:49 smithi146 ceph-mon[32357]: pgmap v583: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:50.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:49 smithi134 ceph-mon[31708]: pgmap v583: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:51.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:51 smithi081 ceph-mon[28640]: pgmap v584: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:52.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:51 smithi146 ceph-mon[32357]: pgmap v584: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:52.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:51 smithi134 ceph-mon[31708]: pgmap v584: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:54.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:53 smithi146 ceph-mon[32357]: pgmap v585: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:50:54.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:53 smithi134 ceph-mon[31708]: pgmap v585: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:50:54.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:53 smithi081 ceph-mon[28640]: pgmap v585: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:50:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:55 smithi146 ceph-mon[32357]: pgmap v586: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:56.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:55 smithi134 ceph-mon[31708]: pgmap v586: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:56.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:55 smithi081 ceph-mon[28640]: pgmap v586: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:50:58.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:57 smithi146 ceph-mon[32357]: pgmap v587: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:50:58.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:57 smithi134 ceph-mon[31708]: pgmap v587: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:50:58.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:57 smithi081 ceph-mon[28640]: pgmap v587: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:51:00.020 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:50:59 smithi134 ceph-mon[31708]: pgmap v588: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:00.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:50:59 smithi146 ceph-mon[32357]: pgmap v588: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:00.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:50:59 smithi081 ceph-mon[28640]: pgmap v588: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:02.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:01 smithi146 ceph-mon[32357]: pgmap v589: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:01 smithi134 ceph-mon[31708]: pgmap v589: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:02.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:01 smithi081 ceph-mon[28640]: pgmap v589: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:04.043 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:03 smithi081 ceph-mon[28640]: pgmap v590: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:51:04.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:03 smithi146 ceph-mon[32357]: pgmap v590: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:51:04.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:03 smithi134 ceph-mon[31708]: pgmap v590: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:51:06.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:05 smithi146 ceph-mon[32357]: pgmap v591: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:06.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:05 smithi134 ceph-mon[31708]: pgmap v591: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:06.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:05 smithi081 ceph-mon[28640]: pgmap v591: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:08.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:07 smithi146 ceph-mon[32357]: pgmap v592: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:51:08.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:07 smithi134 ceph-mon[31708]: pgmap v592: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:51:08.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:07 smithi081 ceph-mon[28640]: pgmap v592: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:51:10.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:09 smithi146 ceph-mon[32357]: pgmap v593: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:10.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:09 smithi134 ceph-mon[31708]: pgmap v593: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:10.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:09 smithi081 ceph-mon[28640]: pgmap v593: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:12.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:11 smithi146 ceph-mon[32357]: pgmap v594: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:12.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:11 smithi134 ceph-mon[31708]: pgmap v594: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:11 smithi081 ceph-mon[28640]: pgmap v594: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:14.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:13 smithi134 ceph-mon[31708]: pgmap v595: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:51:14.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:13 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:51:14.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:13 smithi081 ceph-mon[28640]: pgmap v595: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:51:14.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:13 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:51:14.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:13 smithi146 ceph-mon[32357]: pgmap v595: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:51:14.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:13 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:51:15.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:15 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:51:15.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:15 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:51:15.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:15 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:51:15.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:15 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:51:15.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:15 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:51:15.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:15 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:51:15.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:15 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:51:15.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:15 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:51:15.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:15 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:51:16.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:16 smithi146 ceph-mon[32357]: pgmap v596: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:16.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:16 smithi134 ceph-mon[31708]: pgmap v596: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:16.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:16 smithi081 ceph-mon[28640]: pgmap v596: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:18.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:18 smithi146 ceph-mon[32357]: pgmap v597: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:51:18.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:18 smithi134 ceph-mon[31708]: pgmap v597: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:51:18.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:18 smithi081 ceph-mon[28640]: pgmap v597: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:51:20.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:20 smithi134 ceph-mon[31708]: pgmap v598: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:20.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:20 smithi081 ceph-mon[28640]: pgmap v598: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:20.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:20 smithi146 ceph-mon[32357]: pgmap v598: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:22.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:22 smithi134 ceph-mon[31708]: pgmap v599: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:22.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:22 smithi081 ceph-mon[28640]: pgmap v599: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:22.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:22 smithi146 ceph-mon[32357]: pgmap v599: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:24.365 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:24 smithi146 ceph-mon[32357]: pgmap v600: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:51:24.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:24 smithi134 ceph-mon[31708]: pgmap v600: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:51:24.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:24 smithi081 ceph-mon[28640]: pgmap v600: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:51:26.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:26 smithi134 ceph-mon[31708]: pgmap v601: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:26.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:26 smithi081 ceph-mon[28640]: pgmap v601: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:26.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:26 smithi146 ceph-mon[32357]: pgmap v601: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:28.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:28 smithi134 ceph-mon[31708]: pgmap v602: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:51:28.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:28 smithi081 ceph-mon[28640]: pgmap v602: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:51:28.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:28 smithi146 ceph-mon[32357]: pgmap v602: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:51:30.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:30 smithi134 ceph-mon[31708]: pgmap v603: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:30.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:30 smithi081 ceph-mon[28640]: pgmap v603: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:30.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:30 smithi146 ceph-mon[32357]: pgmap v603: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:32.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:32 smithi134 ceph-mon[31708]: pgmap v604: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:32.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:32 smithi081 ceph-mon[28640]: pgmap v604: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:32.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:32 smithi146 ceph-mon[32357]: pgmap v604: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:34.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:34 smithi134 ceph-mon[31708]: pgmap v605: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:51:34.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:34 smithi081 ceph-mon[28640]: pgmap v605: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:51:34.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:34 smithi146 ceph-mon[32357]: pgmap v605: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:51:36.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:36 smithi134 ceph-mon[31708]: pgmap v606: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:36.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:36 smithi081 ceph-mon[28640]: pgmap v606: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:36.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:36 smithi146 ceph-mon[32357]: pgmap v606: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:38.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:38 smithi134 ceph-mon[31708]: pgmap v607: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:51:38.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:38 smithi081 ceph-mon[28640]: pgmap v607: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:51:38.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:38 smithi146 ceph-mon[32357]: pgmap v607: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:51:40.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:40 smithi134 ceph-mon[31708]: pgmap v608: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:40.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:40 smithi081 ceph-mon[28640]: pgmap v608: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:40.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:40 smithi146 ceph-mon[32357]: pgmap v608: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:42.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:42 smithi134 ceph-mon[31708]: pgmap v609: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:42.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:42 smithi081 ceph-mon[28640]: pgmap v609: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:42.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:42 smithi146 ceph-mon[32357]: pgmap v609: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:44.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:44 smithi134 ceph-mon[31708]: pgmap v610: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:51:44.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:44 smithi081 ceph-mon[28640]: pgmap v610: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:51:44.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:44 smithi146 ceph-mon[32357]: pgmap v610: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:51:46.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:46 smithi134 ceph-mon[31708]: pgmap v611: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:51:46.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:46 smithi081 ceph-mon[28640]: pgmap v611: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:51:46.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:46 smithi146 ceph-mon[32357]: pgmap v611: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:51:48.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:48 smithi134 ceph-mon[31708]: pgmap v612: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:51:48.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:48 smithi081 ceph-mon[28640]: pgmap v612: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:51:48.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:48 smithi146 ceph-mon[32357]: pgmap v612: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:51:50.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:50 smithi134 ceph-mon[31708]: pgmap v613: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:51:50.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:50 smithi081 ceph-mon[28640]: pgmap v613: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:51:50.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:50 smithi146 ceph-mon[32357]: pgmap v613: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:51:52.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:52 smithi134 ceph-mon[31708]: pgmap v614: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:51:52.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:52 smithi081 ceph-mon[28640]: pgmap v614: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:51:52.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:52 smithi146 ceph-mon[32357]: pgmap v614: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:51:53.495 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:53 smithi081 ceph-mon[28640]: pgmap v615: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T16:51:55.528 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:53 smithi134 ceph-mon[31708]: pgmap v615: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T16:51:55.528 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:53 smithi146 ceph-mon[32357]: pgmap v615: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T16:51:55.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:55 smithi134 ceph-mon[31708]: pgmap v616: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:51:55.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:55 smithi081 ceph-mon[28640]: pgmap v616: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:51:56.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:55 smithi146 ceph-mon[32357]: pgmap v616: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:51:57.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:57 smithi134 ceph-mon[31708]: pgmap v617: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:51:57.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:57 smithi081 ceph-mon[28640]: pgmap v617: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:51:58.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:57 smithi146 ceph-mon[32357]: pgmap v617: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:51:59.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:51:59 smithi134 ceph-mon[31708]: pgmap v618: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:51:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:51:59 smithi081 ceph-mon[28640]: pgmap v618: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:00.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:51:59 smithi146 ceph-mon[32357]: pgmap v618: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:01.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:01 smithi134 ceph-mon[31708]: pgmap v619: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:01.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:01 smithi081 ceph-mon[28640]: pgmap v619: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:02.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:01 smithi146 ceph-mon[32357]: pgmap v619: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:03.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:03 smithi134 ceph-mon[31708]: pgmap v620: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:52:03.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:03 smithi081 ceph-mon[28640]: pgmap v620: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:52:04.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:03 smithi146 ceph-mon[32357]: pgmap v620: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:52:05.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:05 smithi134 ceph-mon[31708]: pgmap v621: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:05.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:05 smithi081 ceph-mon[28640]: pgmap v621: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:06.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:05 smithi146 ceph-mon[32357]: pgmap v621: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:07.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:07 smithi134 ceph-mon[31708]: pgmap v622: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:52:07.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:07 smithi081 ceph-mon[28640]: pgmap v622: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:52:08.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:07 smithi146 ceph-mon[32357]: pgmap v622: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:52:09.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:09 smithi134 ceph-mon[31708]: pgmap v623: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:09.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:09 smithi081 ceph-mon[28640]: pgmap v623: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:10.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:09 smithi146 ceph-mon[32357]: pgmap v623: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:11.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:11 smithi134 ceph-mon[31708]: pgmap v624: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:11.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:11 smithi081 ceph-mon[28640]: pgmap v624: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:12.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:11 smithi146 ceph-mon[32357]: pgmap v624: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:13.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:13 smithi134 ceph-mon[31708]: pgmap v625: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:52:13.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:13 smithi081 ceph-mon[28640]: pgmap v625: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:52:14.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:13 smithi146 ceph-mon[32357]: pgmap v625: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:52:15.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:15 smithi134 ceph-mon[31708]: pgmap v626: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:15.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:15 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:52:15.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:15 smithi081 ceph-mon[28640]: pgmap v626: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:15.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:15 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:52:16.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:15 smithi146 ceph-mon[32357]: pgmap v626: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:16.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:15 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:52:17.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:17 smithi134 ceph-mon[31708]: pgmap v627: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:52:17.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:17.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:17.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:17.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:17.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:17.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:17.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:17.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:17.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:17 smithi134 ceph-mon[31708]: Adjusting osd_memory_target on smithi081 to 176.4M 2024-05-03T16:52:17.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:17 smithi134 ceph-mon[31708]: Adjusting osd_memory_target on smithi134 to 176.4M 2024-05-03T16:52:17.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:17 smithi134 ceph-mon[31708]: Unable to set osd_memory_target on smithi081 to 185061273: error parsing value: Value '185061273' is below minimum 939524096 2024-05-03T16:52:17.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:17 smithi134 ceph-mon[31708]: Unable to set osd_memory_target on smithi134 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-03T16:52:17.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:52:17.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:52:17.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:52:17.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:17 smithi081 ceph-mon[28640]: pgmap v627: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:52:17.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:17.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:17.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:17.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:17.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:17.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:17.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:17.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:17.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:17 smithi081 ceph-mon[28640]: Adjusting osd_memory_target on smithi081 to 176.4M 2024-05-03T16:52:17.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:17 smithi081 ceph-mon[28640]: Adjusting osd_memory_target on smithi134 to 176.4M 2024-05-03T16:52:17.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:17 smithi081 ceph-mon[28640]: Unable to set osd_memory_target on smithi081 to 185061273: error parsing value: Value '185061273' is below minimum 939524096 2024-05-03T16:52:17.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:17 smithi081 ceph-mon[28640]: Unable to set osd_memory_target on smithi134 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-03T16:52:17.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:52:17.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:52:17.992 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:52:18.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:17 smithi146 ceph-mon[32357]: pgmap v627: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:52:18.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:18.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:18.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:18.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:18.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:18.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:18.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:18.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:52:18.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:17 smithi146 ceph-mon[32357]: Adjusting osd_memory_target on smithi081 to 176.4M 2024-05-03T16:52:18.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:17 smithi146 ceph-mon[32357]: Adjusting osd_memory_target on smithi134 to 176.4M 2024-05-03T16:52:18.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:17 smithi146 ceph-mon[32357]: Unable to set osd_memory_target on smithi081 to 185061273: error parsing value: Value '185061273' is below minimum 939524096 2024-05-03T16:52:18.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:17 smithi146 ceph-mon[32357]: Unable to set osd_memory_target on smithi134 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-03T16:52:18.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:52:18.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:52:18.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:52:19.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:19 smithi134 ceph-mon[31708]: pgmap v628: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:19.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:19 smithi081 ceph-mon[28640]: pgmap v628: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:20.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:19 smithi146 ceph-mon[32357]: pgmap v628: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:21.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:21 smithi134 ceph-mon[31708]: pgmap v629: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:21.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:21 smithi081 ceph-mon[28640]: pgmap v629: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:22.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:21 smithi146 ceph-mon[32357]: pgmap v629: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:23.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:23 smithi134 ceph-mon[31708]: pgmap v630: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:52:23.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:23 smithi081 ceph-mon[28640]: pgmap v630: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:52:24.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:23 smithi146 ceph-mon[32357]: pgmap v630: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:52:24.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:52:24.326+0000 7f25ee000640 1 -- 172.21.15.81:0/2476086306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25d00034c0 con 0x7f25f8107070 2024-05-03T16:52:24.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:52:24.327+0000 7f25ef400640 1 -- 172.21.15.81:0/2476086306 <== mon.0 v2:172.21.15.81:3300/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25d00034c0 con 0x7f25f8107070 2024-05-03T16:52:25.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:25 smithi134 ceph-mon[31708]: pgmap v631: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:25.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:25 smithi081 ceph-mon[28640]: pgmap v631: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:26.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:25 smithi146 ceph-mon[32357]: pgmap v631: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:27 smithi134 ceph-mon[31708]: pgmap v632: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:52:27.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:27 smithi081 ceph-mon[28640]: pgmap v632: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:52:28.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:27 smithi146 ceph-mon[32357]: pgmap v632: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:52:29.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:29 smithi134 ceph-mon[31708]: pgmap v633: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:29.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:29 smithi081 ceph-mon[28640]: pgmap v633: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:30.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:29 smithi146 ceph-mon[32357]: pgmap v633: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:31 smithi134 ceph-mon[31708]: pgmap v634: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:31.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:31 smithi081 ceph-mon[28640]: pgmap v634: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:32.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:31 smithi146 ceph-mon[32357]: pgmap v634: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:33.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:33 smithi134 ceph-mon[31708]: pgmap v635: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:52:33.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:33 smithi081 ceph-mon[28640]: pgmap v635: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:52:34.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:33 smithi146 ceph-mon[32357]: pgmap v635: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:52:35.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:35 smithi134 ceph-mon[31708]: pgmap v636: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:35.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:35 smithi081 ceph-mon[28640]: pgmap v636: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:36.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:35 smithi146 ceph-mon[32357]: pgmap v636: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:37.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:37 smithi134 ceph-mon[31708]: pgmap v637: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:52:37.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:37 smithi081 ceph-mon[28640]: pgmap v637: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:52:38.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:37 smithi146 ceph-mon[32357]: pgmap v637: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:52:40.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:40 smithi134 ceph-mon[31708]: pgmap v638: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:40.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:40 smithi081 ceph-mon[28640]: pgmap v638: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:40.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:40 smithi146 ceph-mon[32357]: pgmap v638: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:42.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:42 smithi134 ceph-mon[31708]: pgmap v639: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:42.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:42 smithi081 ceph-mon[28640]: pgmap v639: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:42.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:42 smithi146 ceph-mon[32357]: pgmap v639: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:44.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:44 smithi134 ceph-mon[31708]: pgmap v640: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:52:44.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:44 smithi081 ceph-mon[28640]: pgmap v640: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:52:44.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:44 smithi146 ceph-mon[32357]: pgmap v640: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:52:46.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:46 smithi134 ceph-mon[31708]: pgmap v641: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:46.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:46 smithi081 ceph-mon[28640]: pgmap v641: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:46.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:46 smithi146 ceph-mon[32357]: pgmap v641: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:48.469 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:48 smithi134 ceph-mon[31708]: pgmap v642: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:52:48.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:48 smithi081 ceph-mon[28640]: pgmap v642: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:52:48.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:48 smithi146 ceph-mon[32357]: pgmap v642: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:52:50.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:50 smithi134 ceph-mon[31708]: pgmap v643: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:50.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:50 smithi081 ceph-mon[28640]: pgmap v643: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:50.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:50 smithi146 ceph-mon[32357]: pgmap v643: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:52.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:52 smithi134 ceph-mon[31708]: pgmap v644: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:52.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:52 smithi081 ceph-mon[28640]: pgmap v644: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:52.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:52 smithi146 ceph-mon[32357]: pgmap v644: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:54.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:54 smithi134 ceph-mon[31708]: pgmap v645: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:52:54.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:54 smithi081 ceph-mon[28640]: pgmap v645: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:52:54.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:54 smithi146 ceph-mon[32357]: pgmap v645: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:52:56.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:56 smithi134 ceph-mon[31708]: pgmap v646: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:56.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:56 smithi081 ceph-mon[28640]: pgmap v646: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:56.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:56 smithi146 ceph-mon[32357]: pgmap v646: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:52:58.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:52:58 smithi134 ceph-mon[31708]: pgmap v647: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:52:58.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:52:58 smithi081 ceph-mon[28640]: pgmap v647: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:52:58.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:52:58 smithi146 ceph-mon[32357]: pgmap v647: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:53:00.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:00 smithi134 ceph-mon[31708]: pgmap v648: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:00.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:00 smithi081 ceph-mon[28640]: pgmap v648: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:00.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:00 smithi146 ceph-mon[32357]: pgmap v648: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:02.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:02 smithi134 ceph-mon[31708]: pgmap v649: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:02.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:02 smithi081 ceph-mon[28640]: pgmap v649: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:02.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:02 smithi146 ceph-mon[32357]: pgmap v649: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:04.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:04 smithi134 ceph-mon[31708]: pgmap v650: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:53:04.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:04 smithi081 ceph-mon[28640]: pgmap v650: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:53:04.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:04 smithi146 ceph-mon[32357]: pgmap v650: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:53:06.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:06 smithi134 ceph-mon[31708]: pgmap v651: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:06.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:06 smithi081 ceph-mon[28640]: pgmap v651: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:06.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:06 smithi146 ceph-mon[32357]: pgmap v651: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:08.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:08 smithi134 ceph-mon[31708]: pgmap v652: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:53:08.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:08 smithi081 ceph-mon[28640]: pgmap v652: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:53:08.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:08 smithi146 ceph-mon[32357]: pgmap v652: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:53:10.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:10 smithi134 ceph-mon[31708]: pgmap v653: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:10.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:10 smithi081 ceph-mon[28640]: pgmap v653: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:10.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:10 smithi146 ceph-mon[32357]: pgmap v653: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:12.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:12 smithi134 ceph-mon[31708]: pgmap v654: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:53:12.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:12 smithi081 ceph-mon[28640]: pgmap v654: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:53:12.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:12 smithi146 ceph-mon[32357]: pgmap v654: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:53:14.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:14 smithi134 ceph-mon[31708]: pgmap v655: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T16:53:14.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:14 smithi081 ceph-mon[28640]: pgmap v655: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T16:53:14.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:14 smithi146 ceph-mon[32357]: pgmap v655: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T16:53:15.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:15 smithi146 ceph-mon[32357]: pgmap v656: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:53:15.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:15 smithi134 ceph-mon[31708]: pgmap v656: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:53:15.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:15 smithi081 ceph-mon[28640]: pgmap v656: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:53:17.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:17 smithi134 ceph-mon[31708]: pgmap v657: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:53:17.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:17 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:53:17.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:17 smithi081 ceph-mon[28640]: pgmap v657: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:53:17.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:17 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:53:18.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:17 smithi146 ceph-mon[32357]: pgmap v657: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:53:18.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:17 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:53:19.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:19 smithi134 ceph-mon[31708]: pgmap v658: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:53:19.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:19 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:53:19.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:19 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:53:19.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:19 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:53:19.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:19 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:53:19.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:19 smithi134 ceph-mon[31708]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-05-03T16:53:19.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:19 smithi134 ceph-mon[31708]: Unable to set osd_memory_target on smithi146 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-03T16:53:19.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:19 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:53:19.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:19 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:53:19.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:19 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:53:19.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:19 smithi081 ceph-mon[28640]: pgmap v658: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:53:19.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:53:19.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:53:19.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:53:19.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:53:19.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:19 smithi081 ceph-mon[28640]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-05-03T16:53:19.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:19 smithi081 ceph-mon[28640]: Unable to set osd_memory_target on smithi146 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-03T16:53:19.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:53:19.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:53:19.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:53:20.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:19 smithi146 ceph-mon[32357]: pgmap v658: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:53:20.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:19 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:53:20.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:19 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:53:20.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:19 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:53:20.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:19 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T16:53:20.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:19 smithi146 ceph-mon[32357]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-05-03T16:53:20.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:19 smithi146 ceph-mon[32357]: Unable to set osd_memory_target on smithi146 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-03T16:53:20.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:19 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:53:20.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:19 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:53:20.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:19 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:53:21.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:21 smithi134 ceph-mon[31708]: pgmap v659: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:53:21.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:21 smithi081 ceph-mon[28640]: pgmap v659: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:53:22.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:21 smithi146 ceph-mon[32357]: pgmap v659: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:53:23.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:23 smithi134 ceph-mon[31708]: pgmap v660: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:53:23.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:23 smithi081 ceph-mon[28640]: pgmap v660: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:53:24.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:23 smithi146 ceph-mon[32357]: pgmap v660: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:53:25.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:25 smithi134 ceph-mon[31708]: pgmap v661: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:25.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:25 smithi081 ceph-mon[28640]: pgmap v661: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:26.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:25 smithi146 ceph-mon[32357]: pgmap v661: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:27 smithi134 ceph-mon[31708]: pgmap v662: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:53:27.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:27 smithi081 ceph-mon[28640]: pgmap v662: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:53:28.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:27 smithi146 ceph-mon[32357]: pgmap v662: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:53:29.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:29 smithi134 ceph-mon[31708]: pgmap v663: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:29.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:29 smithi081 ceph-mon[28640]: pgmap v663: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:30.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:29 smithi146 ceph-mon[32357]: pgmap v663: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:31.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:31 smithi134 ceph-mon[31708]: pgmap v664: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:31.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:31 smithi081 ceph-mon[28640]: pgmap v664: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:32.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:31 smithi146 ceph-mon[32357]: pgmap v664: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:33.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:33 smithi134 ceph-mon[31708]: pgmap v665: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:53:33.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:33 smithi081 ceph-mon[28640]: pgmap v665: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:53:34.063 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:33 smithi146 ceph-mon[32357]: pgmap v665: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:53:35.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:35 smithi134 ceph-mon[31708]: pgmap v666: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:35.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:35 smithi081 ceph-mon[28640]: pgmap v666: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:36.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:35 smithi146 ceph-mon[32357]: pgmap v666: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:37.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:37 smithi134 ceph-mon[31708]: pgmap v667: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:53:37.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:37 smithi081 ceph-mon[28640]: pgmap v667: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:53:38.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:37 smithi146 ceph-mon[32357]: pgmap v667: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:53:39.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:39 smithi134 ceph-mon[31708]: pgmap v668: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:39.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:39 smithi081 ceph-mon[28640]: pgmap v668: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:40.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:39 smithi146 ceph-mon[32357]: pgmap v668: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:41.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:41 smithi134 ceph-mon[31708]: pgmap v669: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:41.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:41 smithi081 ceph-mon[28640]: pgmap v669: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:42.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:41 smithi146 ceph-mon[32357]: pgmap v669: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:43.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:43 smithi134 ceph-mon[31708]: pgmap v670: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:53:43.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:43 smithi081 ceph-mon[28640]: pgmap v670: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:53:44.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:43 smithi146 ceph-mon[32357]: pgmap v670: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:53:45.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:45 smithi134 ceph-mon[31708]: pgmap v671: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:45.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:45 smithi081 ceph-mon[28640]: pgmap v671: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:46.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:45 smithi146 ceph-mon[32357]: pgmap v671: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:47.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:47 smithi134 ceph-mon[31708]: pgmap v672: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:53:47.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:47 smithi081 ceph-mon[28640]: pgmap v672: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:53:48.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:47 smithi146 ceph-mon[32357]: pgmap v672: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:53:49.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:49 smithi081 ceph-mon[28640]: pgmap v673: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:50.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:49 smithi146 ceph-mon[32357]: pgmap v673: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:50.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:49 smithi134 ceph-mon[31708]: pgmap v673: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:51.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:51 smithi081 ceph-mon[28640]: pgmap v674: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:52.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:51 smithi146 ceph-mon[32357]: pgmap v674: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:52.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:51 smithi134 ceph-mon[31708]: pgmap v674: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:53.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:53 smithi081 ceph-mon[28640]: pgmap v675: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:53:54.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:53 smithi146 ceph-mon[32357]: pgmap v675: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:53:54.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:53 smithi134 ceph-mon[31708]: pgmap v675: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:53:55.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:55 smithi081 ceph-mon[28640]: pgmap v676: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:56.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:55 smithi146 ceph-mon[32357]: pgmap v676: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:56.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:55 smithi134 ceph-mon[31708]: pgmap v676: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:53:58.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:57 smithi146 ceph-mon[32357]: pgmap v677: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:53:58.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:57 smithi134 ceph-mon[31708]: pgmap v677: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:53:58.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:57 smithi081 ceph-mon[28640]: pgmap v677: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:54:00.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:53:59 smithi146 ceph-mon[32357]: pgmap v678: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:00.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:53:59 smithi134 ceph-mon[31708]: pgmap v678: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:00.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:53:59 smithi081 ceph-mon[28640]: pgmap v678: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:02.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:01 smithi146 ceph-mon[32357]: pgmap v679: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:02.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:01 smithi134 ceph-mon[31708]: pgmap v679: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:02.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:01 smithi081 ceph-mon[28640]: pgmap v679: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:04.019 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:03 smithi134 ceph-mon[31708]: pgmap v680: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:54:04.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:03 smithi146 ceph-mon[32357]: pgmap v680: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:54:04.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:03 smithi081 ceph-mon[28640]: pgmap v680: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:54:06.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:05 smithi146 ceph-mon[32357]: pgmap v681: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:06.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:05 smithi134 ceph-mon[31708]: pgmap v681: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:06.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:05 smithi081 ceph-mon[28640]: pgmap v681: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:08.043 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:07 smithi081 ceph-mon[28640]: pgmap v682: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:54:08.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:07 smithi146 ceph-mon[32357]: pgmap v682: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:54:08.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:07 smithi134 ceph-mon[31708]: pgmap v682: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:54:10.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:09 smithi146 ceph-mon[32357]: pgmap v683: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:10.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:09 smithi134 ceph-mon[31708]: pgmap v683: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:10.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:09 smithi081 ceph-mon[28640]: pgmap v683: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:12.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:11 smithi146 ceph-mon[32357]: pgmap v684: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:12.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:11 smithi134 ceph-mon[31708]: pgmap v684: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:11 smithi081 ceph-mon[28640]: pgmap v684: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:14.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:13 smithi146 ceph-mon[32357]: pgmap v685: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:54:14.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:13 smithi134 ceph-mon[31708]: pgmap v685: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:54:14.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:13 smithi081 ceph-mon[28640]: pgmap v685: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:54:16.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:15 smithi146 ceph-mon[32357]: pgmap v686: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:16.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:15 smithi134 ceph-mon[31708]: pgmap v686: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:16.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:15 smithi081 ceph-mon[28640]: pgmap v686: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:18.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:17 smithi146 ceph-mon[32357]: pgmap v687: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:54:18.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:17 smithi134 ceph-mon[31708]: pgmap v687: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:54:18.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:17 smithi081 ceph-mon[28640]: pgmap v687: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:54:20.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:19 smithi134 ceph-mon[31708]: pgmap v688: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T16:54:20.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:19 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:54:20.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:19 smithi081 ceph-mon[28640]: pgmap v688: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T16:54:20.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:19 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:54:20.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:19 smithi146 ceph-mon[32357]: pgmap v688: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T16:54:20.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:19 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:54:21.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:54:21.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:54:21.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:20 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:54:21.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:54:21.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:54:21.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:20 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:54:21.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:54:21.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:54:21.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:20 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:54:22.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:21 smithi134 ceph-mon[31708]: pgmap v689: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T16:54:22.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:21 smithi081 ceph-mon[28640]: pgmap v689: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T16:54:22.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:21 smithi146 ceph-mon[32357]: pgmap v689: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T16:54:24.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:23 smithi134 ceph-mon[31708]: pgmap v690: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-03T16:54:24.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:23 smithi081 ceph-mon[28640]: pgmap v690: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-03T16:54:24.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:23 smithi146 ceph-mon[32357]: pgmap v690: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-03T16:54:26.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:25 smithi134 ceph-mon[31708]: pgmap v691: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T16:54:26.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:25 smithi081 ceph-mon[28640]: pgmap v691: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T16:54:26.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:25 smithi146 ceph-mon[32357]: pgmap v691: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T16:54:28.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:27 smithi134 ceph-mon[31708]: pgmap v692: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:54:28.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:27 smithi081 ceph-mon[28640]: pgmap v692: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:54:28.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:27 smithi146 ceph-mon[32357]: pgmap v692: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:54:30.115 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:29 smithi146 ceph-mon[32357]: pgmap v693: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:30.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:29 smithi134 ceph-mon[31708]: pgmap v693: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:30.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:29 smithi081 ceph-mon[28640]: pgmap v693: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:32.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:31 smithi134 ceph-mon[31708]: pgmap v694: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:32.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:31 smithi081 ceph-mon[28640]: pgmap v694: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:32.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:31 smithi146 ceph-mon[32357]: pgmap v694: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:34.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:33 smithi134 ceph-mon[31708]: pgmap v695: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:54:34.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:33 smithi081 ceph-mon[28640]: pgmap v695: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:54:34.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:33 smithi146 ceph-mon[32357]: pgmap v695: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:54:36.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:35 smithi134 ceph-mon[31708]: pgmap v696: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:36.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:35 smithi081 ceph-mon[28640]: pgmap v696: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:36.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:35 smithi146 ceph-mon[32357]: pgmap v696: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:38.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:37 smithi134 ceph-mon[31708]: pgmap v697: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:54:38.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:37 smithi081 ceph-mon[28640]: pgmap v697: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:54:38.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:37 smithi146 ceph-mon[32357]: pgmap v697: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:54:40.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:39 smithi134 ceph-mon[31708]: pgmap v698: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:40.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:39 smithi081 ceph-mon[28640]: pgmap v698: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:40.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:39 smithi146 ceph-mon[32357]: pgmap v698: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:42.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:41 smithi134 ceph-mon[31708]: pgmap v699: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:42.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:41 smithi081 ceph-mon[28640]: pgmap v699: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:42.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:41 smithi146 ceph-mon[32357]: pgmap v699: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:44.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:43 smithi134 ceph-mon[31708]: pgmap v700: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T16:54:44.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:43 smithi081 ceph-mon[28640]: pgmap v700: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T16:54:44.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:43 smithi146 ceph-mon[32357]: pgmap v700: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T16:54:46.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:45 smithi134 ceph-mon[31708]: pgmap v701: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:54:46.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:45 smithi081 ceph-mon[28640]: pgmap v701: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:54:46.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:45 smithi146 ceph-mon[32357]: pgmap v701: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:54:48.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:47 smithi134 ceph-mon[31708]: pgmap v702: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:54:48.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:47 smithi081 ceph-mon[28640]: pgmap v702: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:54:48.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:47 smithi146 ceph-mon[32357]: pgmap v702: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:54:50.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:49 smithi134 ceph-mon[31708]: pgmap v703: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:54:50.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:49 smithi081 ceph-mon[28640]: pgmap v703: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:54:50.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:49 smithi146 ceph-mon[32357]: pgmap v703: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:54:52.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:51 smithi134 ceph-mon[31708]: pgmap v704: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:54:52.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:51 smithi081 ceph-mon[28640]: pgmap v704: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:54:52.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:51 smithi146 ceph-mon[32357]: pgmap v704: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:54:54.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:53 smithi134 ceph-mon[31708]: pgmap v705: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T16:54:54.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:53 smithi081 ceph-mon[28640]: pgmap v705: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T16:54:54.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:53 smithi146 ceph-mon[32357]: pgmap v705: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T16:54:56.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:55 smithi134 ceph-mon[31708]: pgmap v706: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:56.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:55 smithi081 ceph-mon[28640]: pgmap v706: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:56.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:55 smithi146 ceph-mon[32357]: pgmap v706: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:54:58.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:54:57 smithi134 ceph-mon[31708]: pgmap v707: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:54:58.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:54:57 smithi081 ceph-mon[28640]: pgmap v707: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:54:58.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:54:57 smithi146 ceph-mon[32357]: pgmap v707: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:55:00.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:00 smithi134 ceph-mon[31708]: pgmap v708: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:00.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:00 smithi081 ceph-mon[28640]: pgmap v708: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:00.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:00 smithi146 ceph-mon[32357]: pgmap v708: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:02.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:02 smithi134 ceph-mon[31708]: pgmap v709: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:02.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:02 smithi081 ceph-mon[28640]: pgmap v709: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:02.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:02 smithi146 ceph-mon[32357]: pgmap v709: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:04.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:04 smithi134 ceph-mon[31708]: pgmap v710: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:55:04.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:04 smithi081 ceph-mon[28640]: pgmap v710: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:55:04.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:04 smithi146 ceph-mon[32357]: pgmap v710: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:55:06.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:06 smithi134 ceph-mon[31708]: pgmap v711: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:06.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:06 smithi081 ceph-mon[28640]: pgmap v711: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:06.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:06 smithi146 ceph-mon[32357]: pgmap v711: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:08.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:08 smithi134 ceph-mon[31708]: pgmap v712: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:55:08.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:08 smithi081 ceph-mon[28640]: pgmap v712: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:55:08.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:08 smithi146 ceph-mon[32357]: pgmap v712: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:55:10.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:10 smithi134 ceph-mon[31708]: pgmap v713: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:10.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:10 smithi081 ceph-mon[28640]: pgmap v713: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:10.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:10 smithi146 ceph-mon[32357]: pgmap v713: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:12.470 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:12 smithi134 ceph-mon[31708]: pgmap v714: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:12.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:12 smithi081 ceph-mon[28640]: pgmap v714: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:12.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:12 smithi146 ceph-mon[32357]: pgmap v714: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:14.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:14 smithi134 ceph-mon[31708]: pgmap v715: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:55:14.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:14 smithi081 ceph-mon[28640]: pgmap v715: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:55:14.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:14 smithi146 ceph-mon[32357]: pgmap v715: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:55:16.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:16 smithi134 ceph-mon[31708]: pgmap v716: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:16.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:16 smithi081 ceph-mon[28640]: pgmap v716: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:16.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:16 smithi146 ceph-mon[32357]: pgmap v716: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:18.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:18 smithi134 ceph-mon[31708]: pgmap v717: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:55:18.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:18 smithi081 ceph-mon[28640]: pgmap v717: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:55:18.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:18 smithi146 ceph-mon[32357]: pgmap v717: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:55:20.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:20 smithi134 ceph-mon[31708]: pgmap v718: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:20.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:20 smithi081 ceph-mon[28640]: pgmap v718: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:20.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:20 smithi146 ceph-mon[32357]: pgmap v718: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:21.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:21 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:55:21.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:21 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:55:21.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:21 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:55:22.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:22 smithi134 ceph-mon[31708]: pgmap v719: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:22.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:22.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:22.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:22.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:22.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:22.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:22 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:22.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:22 smithi081 ceph-mon[28640]: pgmap v719: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:22.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:22.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:22.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:22.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:22.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:22.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:22 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:22.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:22 smithi146 ceph-mon[32357]: pgmap v719: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:22.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:22.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:22.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:22.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:22.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:22.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:22 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:55:24.356+0000 7f25ee000640 1 -- 172.21.15.81:0/2476086306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25d0005850 con 0x7f25f8107070 2024-05-03T16:55:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:55:24.357+0000 7f25ef400640 1 -- 172.21.15.81:0/2476086306 <== mon.0 v2:172.21.15.81:3300/0 8 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25d0005850 con 0x7f25f8107070 2024-05-03T16:55:24.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:24 smithi134 ceph-mon[31708]: pgmap v720: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:55:24.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:24 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:55:24.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:24 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:55:24.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:24 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:24.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:24 smithi081 ceph-mon[28640]: pgmap v720: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:55:24.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:24 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:55:24.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:24 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:55:24.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:24 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:24.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:24 smithi146 ceph-mon[32357]: pgmap v720: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:55:24.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:24 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:55:24.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:24 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:55:24.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:24 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:55:25.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:25 smithi146 ceph-mon[32357]: pgmap v721: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:25.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:25 smithi134 ceph-mon[31708]: pgmap v721: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:25.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:25 smithi081 ceph-mon[28640]: pgmap v721: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:27 smithi134 ceph-mon[31708]: pgmap v722: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:55:27.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:27 smithi081 ceph-mon[28640]: pgmap v722: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:55:28.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:27 smithi146 ceph-mon[32357]: pgmap v722: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:55:29.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:29 smithi134 ceph-mon[31708]: pgmap v723: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:29.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:29 smithi081 ceph-mon[28640]: pgmap v723: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:30.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:29 smithi146 ceph-mon[32357]: pgmap v723: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:31.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:31 smithi134 ceph-mon[31708]: pgmap v724: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:31.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:31 smithi081 ceph-mon[28640]: pgmap v724: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:32.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:31 smithi146 ceph-mon[32357]: pgmap v724: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:33.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:33 smithi134 ceph-mon[31708]: pgmap v725: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:55:33.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:33 smithi081 ceph-mon[28640]: pgmap v725: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:55:34.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:33 smithi146 ceph-mon[32357]: pgmap v725: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:55:35.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:35 smithi134 ceph-mon[31708]: pgmap v726: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:35.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:35 smithi081 ceph-mon[28640]: pgmap v726: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:36.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:35 smithi146 ceph-mon[32357]: pgmap v726: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:37.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:37 smithi081 ceph-mon[28640]: pgmap v727: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:55:38.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:37 smithi146 ceph-mon[32357]: pgmap v727: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:55:38.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:37 smithi134 ceph-mon[31708]: pgmap v727: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:55:39.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:39 smithi081 ceph-mon[28640]: pgmap v728: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:40.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:39 smithi146 ceph-mon[32357]: pgmap v728: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:40.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:39 smithi134 ceph-mon[31708]: pgmap v728: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:41.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:41 smithi081 ceph-mon[28640]: pgmap v729: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:42.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:41 smithi146 ceph-mon[32357]: pgmap v729: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:42.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:41 smithi134 ceph-mon[31708]: pgmap v729: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:43.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:43 smithi081 ceph-mon[28640]: pgmap v730: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:55:44.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:43 smithi146 ceph-mon[32357]: pgmap v730: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:55:44.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:43 smithi134 ceph-mon[31708]: pgmap v730: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:55:46.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:45 smithi146 ceph-mon[32357]: pgmap v731: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:46.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:45 smithi134 ceph-mon[31708]: pgmap v731: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:46.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:45 smithi081 ceph-mon[28640]: pgmap v731: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:48.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:47 smithi146 ceph-mon[32357]: pgmap v732: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:55:48.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:47 smithi134 ceph-mon[31708]: pgmap v732: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:55:48.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:47 smithi081 ceph-mon[28640]: pgmap v732: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:55:50.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:49 smithi146 ceph-mon[32357]: pgmap v733: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:50.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:49 smithi134 ceph-mon[31708]: pgmap v733: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:50.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:49 smithi081 ceph-mon[28640]: pgmap v733: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:52.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:51 smithi146 ceph-mon[32357]: pgmap v734: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:52.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:51 smithi134 ceph-mon[31708]: pgmap v734: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:52.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:51 smithi081 ceph-mon[28640]: pgmap v734: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:54.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:53 smithi146 ceph-mon[32357]: pgmap v735: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:55:54.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:53 smithi134 ceph-mon[31708]: pgmap v735: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:55:54.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:53 smithi081 ceph-mon[28640]: pgmap v735: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:55:56.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:55 smithi146 ceph-mon[32357]: pgmap v736: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:56.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:55 smithi134 ceph-mon[31708]: pgmap v736: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:56.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:55 smithi081 ceph-mon[28640]: pgmap v736: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:55:58.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:57 smithi146 ceph-mon[32357]: pgmap v737: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:55:58.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:57 smithi134 ceph-mon[31708]: pgmap v737: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:55:58.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:57 smithi081 ceph-mon[28640]: pgmap v737: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:56:00.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:55:59 smithi146 ceph-mon[32357]: pgmap v738: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:00.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:55:59 smithi134 ceph-mon[31708]: pgmap v738: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:00.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:55:59 smithi081 ceph-mon[28640]: pgmap v738: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:02.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:01 smithi146 ceph-mon[32357]: pgmap v739: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:02.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:01 smithi134 ceph-mon[31708]: pgmap v739: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:02.242 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:01 smithi081 ceph-mon[28640]: pgmap v739: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:04.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:03 smithi146 ceph-mon[32357]: pgmap v740: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:56:04.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:03 smithi134 ceph-mon[31708]: pgmap v740: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:56:04.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:03 smithi081 ceph-mon[28640]: pgmap v740: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:56:06.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:05 smithi146 ceph-mon[32357]: pgmap v741: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:06.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:05 smithi134 ceph-mon[31708]: pgmap v741: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:06.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:05 smithi081 ceph-mon[28640]: pgmap v741: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:08.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:07 smithi134 ceph-mon[31708]: pgmap v742: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:56:08.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:07 smithi081 ceph-mon[28640]: pgmap v742: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:56:08.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:07 smithi146 ceph-mon[32357]: pgmap v742: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:56:10.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:09 smithi134 ceph-mon[31708]: pgmap v743: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:10.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:09 smithi081 ceph-mon[28640]: pgmap v743: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:10.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:09 smithi146 ceph-mon[32357]: pgmap v743: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:12.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:11 smithi134 ceph-mon[31708]: pgmap v744: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:11 smithi081 ceph-mon[28640]: pgmap v744: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:12.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:11 smithi146 ceph-mon[32357]: pgmap v744: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:14.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:13 smithi134 ceph-mon[31708]: pgmap v745: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:56:14.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:13 smithi081 ceph-mon[28640]: pgmap v745: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:56:14.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:13 smithi146 ceph-mon[32357]: pgmap v745: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T16:56:16.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:15 smithi134 ceph-mon[31708]: pgmap v746: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:16.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:15 smithi081 ceph-mon[28640]: pgmap v746: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:16.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:15 smithi146 ceph-mon[32357]: pgmap v746: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:18.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:17 smithi134 ceph-mon[31708]: pgmap v747: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:56:18.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:17 smithi081 ceph-mon[28640]: pgmap v747: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:56:18.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:17 smithi146 ceph-mon[32357]: pgmap v747: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:56:20.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:19 smithi134 ceph-mon[31708]: pgmap v748: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:20.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:19 smithi081 ceph-mon[28640]: pgmap v748: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:20.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:19 smithi146 ceph-mon[32357]: pgmap v748: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:22.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:21 smithi134 ceph-mon[31708]: pgmap v749: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:22.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:21 smithi081 ceph-mon[28640]: pgmap v749: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:22.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:21 smithi146 ceph-mon[32357]: pgmap v749: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:24.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:23 smithi134 ceph-mon[31708]: pgmap v750: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:56:24.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:23 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:56:24.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:23 smithi081 ceph-mon[28640]: pgmap v750: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:56:24.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:23 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:56:24.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:23 smithi146 ceph-mon[32357]: pgmap v750: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:56:24.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:23 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:56:26.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:25 smithi134 ceph-mon[31708]: pgmap v751: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:26.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:25 smithi081 ceph-mon[28640]: pgmap v751: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:26.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:25 smithi146 ceph-mon[32357]: pgmap v751: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:27.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:27 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:27.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:27 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:27.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:27 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:27.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:27 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:27.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:27 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:27.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:27 smithi146 ceph-mon[32357]: pgmap v752: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:56:27.813 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:27 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:27 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:27 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:27 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:27 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:27 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:27 smithi134 ceph-mon[31708]: pgmap v752: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:56:27.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:27 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:27.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:27 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:27.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:27 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:27.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:27 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:27.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:27 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:27.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:27 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:27.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:27 smithi081 ceph-mon[28640]: pgmap v752: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:56:27.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:27 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:28.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:28 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:56:28.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:28 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:56:28.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:28 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:28.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:28 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:56:28.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:28 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:56:28.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:28 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:29.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:28 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:56:29.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:28 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:56:29.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:28 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:56:30.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:29 smithi134 ceph-mon[31708]: pgmap v753: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:30.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:29 smithi081 ceph-mon[28640]: pgmap v753: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:30.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:29 smithi146 ceph-mon[32357]: pgmap v753: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:32.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:31 smithi134 ceph-mon[31708]: pgmap v754: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:32.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:31 smithi081 ceph-mon[28640]: pgmap v754: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:32.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:31 smithi146 ceph-mon[32357]: pgmap v754: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:34.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:33 smithi134 ceph-mon[31708]: pgmap v755: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:56:34.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:33 smithi081 ceph-mon[28640]: pgmap v755: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:56:34.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:33 smithi146 ceph-mon[32357]: pgmap v755: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:56:36.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:35 smithi134 ceph-mon[31708]: pgmap v756: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:56:36.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:35 smithi081 ceph-mon[28640]: pgmap v756: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:56:36.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:35 smithi146 ceph-mon[32357]: pgmap v756: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:56:38.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:37 smithi134 ceph-mon[31708]: pgmap v757: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:56:38.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:37 smithi081 ceph-mon[28640]: pgmap v757: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:56:38.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:37 smithi146 ceph-mon[32357]: pgmap v757: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:56:40.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:39 smithi134 ceph-mon[31708]: pgmap v758: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:40.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:39 smithi081 ceph-mon[28640]: pgmap v758: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:40.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:39 smithi146 ceph-mon[32357]: pgmap v758: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:42.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:41 smithi134 ceph-mon[31708]: pgmap v759: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:42.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:41 smithi081 ceph-mon[28640]: pgmap v759: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:42.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:41 smithi146 ceph-mon[32357]: pgmap v759: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:56:44.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:43 smithi081 ceph-mon[28640]: pgmap v760: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T16:56:44.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:43 smithi146 ceph-mon[32357]: pgmap v760: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T16:56:44.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:43 smithi134 ceph-mon[31708]: pgmap v760: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T16:56:46.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:45 smithi081 ceph-mon[28640]: pgmap v761: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T16:56:46.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:45 smithi146 ceph-mon[32357]: pgmap v761: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T16:56:46.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:45 smithi134 ceph-mon[31708]: pgmap v761: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T16:56:48.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:47 smithi081 ceph-mon[28640]: pgmap v762: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:56:48.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:47 smithi146 ceph-mon[32357]: pgmap v762: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:56:48.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:47 smithi134 ceph-mon[31708]: pgmap v762: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:56:50.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:49 smithi146 ceph-mon[32357]: pgmap v763: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:56:50.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:49 smithi134 ceph-mon[31708]: pgmap v763: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:56:50.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:49 smithi081 ceph-mon[28640]: pgmap v763: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:56:52.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:51 smithi146 ceph-mon[32357]: pgmap v764: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:56:52.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:51 smithi134 ceph-mon[31708]: pgmap v764: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:56:52.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:51 smithi081 ceph-mon[28640]: pgmap v764: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:56:54.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:54 smithi146 ceph-mon[32357]: pgmap v765: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T16:56:54.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:54 smithi134 ceph-mon[31708]: pgmap v765: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T16:56:54.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:54 smithi081 ceph-mon[28640]: pgmap v765: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T16:56:56.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:56 smithi146 ceph-mon[32357]: pgmap v766: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:56:56.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:56 smithi134 ceph-mon[31708]: pgmap v766: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:56:56.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:56 smithi081 ceph-mon[28640]: pgmap v766: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:56:58.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:56:58 smithi146 ceph-mon[32357]: pgmap v767: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:56:58.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:56:58 smithi134 ceph-mon[31708]: pgmap v767: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:56:58.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:56:58 smithi081 ceph-mon[28640]: pgmap v767: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:57:00.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:00 smithi134 ceph-mon[31708]: pgmap v768: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:00.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:00 smithi081 ceph-mon[28640]: pgmap v768: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:00.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:00 smithi146 ceph-mon[32357]: pgmap v768: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:02.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:02 smithi134 ceph-mon[31708]: pgmap v769: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:02.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:02 smithi081 ceph-mon[28640]: pgmap v769: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:02.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:02 smithi146 ceph-mon[32357]: pgmap v769: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:04.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:04 smithi134 ceph-mon[31708]: pgmap v770: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:57:04.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:04 smithi081 ceph-mon[28640]: pgmap v770: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:57:04.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:04 smithi146 ceph-mon[32357]: pgmap v770: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:57:06.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:06 smithi134 ceph-mon[31708]: pgmap v771: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:57:06.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:06 smithi081 ceph-mon[28640]: pgmap v771: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:57:06.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:06 smithi146 ceph-mon[32357]: pgmap v771: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:57:08.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:08 smithi134 ceph-mon[31708]: pgmap v772: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:57:08.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:08 smithi081 ceph-mon[28640]: pgmap v772: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:57:08.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:08 smithi146 ceph-mon[32357]: pgmap v772: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:57:10.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:10 smithi134 ceph-mon[31708]: pgmap v773: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:10.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:10 smithi081 ceph-mon[28640]: pgmap v773: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:10.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:10 smithi146 ceph-mon[32357]: pgmap v773: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:12.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:12 smithi134 ceph-mon[31708]: pgmap v774: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:12.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:12 smithi081 ceph-mon[28640]: pgmap v774: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:12.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:12 smithi146 ceph-mon[32357]: pgmap v774: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:14.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:14 smithi081 ceph-mon[28640]: pgmap v775: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:57:14.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:14 smithi146 ceph-mon[32357]: pgmap v775: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:57:14.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:14 smithi134 ceph-mon[31708]: pgmap v775: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:57:16.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:16 smithi081 ceph-mon[28640]: pgmap v776: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:57:16.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:16 smithi146 ceph-mon[32357]: pgmap v776: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:57:16.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:16 smithi134 ceph-mon[31708]: pgmap v776: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:57:18.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:18 smithi081 ceph-mon[28640]: pgmap v777: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:57:18.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:18 smithi146 ceph-mon[32357]: pgmap v777: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:57:18.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:18 smithi134 ceph-mon[31708]: pgmap v777: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:57:20.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:20 smithi081 ceph-mon[28640]: pgmap v778: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:20.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:20 smithi146 ceph-mon[32357]: pgmap v778: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:20.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:20 smithi134 ceph-mon[31708]: pgmap v778: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:21.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:21 smithi146 ceph-mon[32357]: pgmap v779: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:21.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:21 smithi134 ceph-mon[31708]: pgmap v779: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:21.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:21 smithi081 ceph-mon[28640]: pgmap v779: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:24.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:23 smithi146 ceph-mon[32357]: pgmap v780: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:57:24.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:23 smithi134 ceph-mon[31708]: pgmap v780: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:57:24.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:23 smithi081 ceph-mon[28640]: pgmap v780: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:57:26.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:25 smithi146 ceph-mon[32357]: pgmap v781: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:57:26.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:25 smithi134 ceph-mon[31708]: pgmap v781: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:57:26.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:25 smithi081 ceph-mon[28640]: pgmap v781: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:57:28.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:27 smithi146 ceph-mon[32357]: pgmap v782: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:57:28.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:27 smithi134 ceph-mon[31708]: pgmap v782: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:57:28.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:27 smithi081 ceph-mon[28640]: pgmap v782: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:57:29.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:28 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:57:29.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:28 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:57:29.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:28 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:57:30.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:29 smithi146 ceph-mon[32357]: pgmap v783: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:30.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:29 smithi134 ceph-mon[31708]: pgmap v783: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:30.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:29 smithi081 ceph-mon[28640]: pgmap v783: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:31.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:30 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:57:31.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:30 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:57:31.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:30 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:57:31.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:30 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:57:31.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:30 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:57:31.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:30 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:57:31.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:30 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:57:31.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:30 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:57:31.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:30 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:57:32.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:31 smithi146 ceph-mon[32357]: pgmap v784: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:32.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:31 smithi134 ceph-mon[31708]: pgmap v784: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:32.262 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:31 smithi081 ceph-mon[28640]: pgmap v784: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:34.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:33 smithi146 ceph-mon[32357]: pgmap v785: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:57:34.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:33 smithi134 ceph-mon[31708]: pgmap v785: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:57:34.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:33 smithi081 ceph-mon[28640]: pgmap v785: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:57:36.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:35 smithi146 ceph-mon[32357]: pgmap v786: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:57:36.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:35 smithi134 ceph-mon[31708]: pgmap v786: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:57:36.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:35 smithi081 ceph-mon[28640]: pgmap v786: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:57:38.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:37 smithi134 ceph-mon[31708]: pgmap v787: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:57:38.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:37 smithi081 ceph-mon[28640]: pgmap v787: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:57:38.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:37 smithi146 ceph-mon[32357]: pgmap v787: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:57:39.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:57:39.379+0000 7f25ee000640 1 -- 172.21.15.81:0/2476086306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25d0005b90 con 0x7f25f8107070 2024-05-03T16:57:39.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:57:39.380+0000 7f25ef400640 1 -- 172.21.15.81:0/2476086306 <== mon.0 v2:172.21.15.81:3300/0 9 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25d0005b90 con 0x7f25f8107070 2024-05-03T16:57:40.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:39 smithi134 ceph-mon[31708]: pgmap v788: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:40.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:39 smithi081 ceph-mon[28640]: pgmap v788: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:40.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:39 smithi146 ceph-mon[32357]: pgmap v788: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:42.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:41 smithi134 ceph-mon[31708]: pgmap v789: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:42.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:41 smithi081 ceph-mon[28640]: pgmap v789: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:42.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:41 smithi146 ceph-mon[32357]: pgmap v789: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:44.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:43 smithi134 ceph-mon[31708]: pgmap v790: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:57:44.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:43 smithi081 ceph-mon[28640]: pgmap v790: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:57:44.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:43 smithi146 ceph-mon[32357]: pgmap v790: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:57:46.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:45 smithi134 ceph-mon[31708]: pgmap v791: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:57:46.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:45 smithi081 ceph-mon[28640]: pgmap v791: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:57:46.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:45 smithi146 ceph-mon[32357]: pgmap v791: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:57:48.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:47 smithi134 ceph-mon[31708]: pgmap v792: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:57:48.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:47 smithi081 ceph-mon[28640]: pgmap v792: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:57:48.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:47 smithi146 ceph-mon[32357]: pgmap v792: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:57:50.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:49 smithi134 ceph-mon[31708]: pgmap v793: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:50.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:49 smithi081 ceph-mon[28640]: pgmap v793: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:50.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:49 smithi146 ceph-mon[32357]: pgmap v793: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:52.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:51 smithi134 ceph-mon[31708]: pgmap v794: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:52.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:51 smithi081 ceph-mon[28640]: pgmap v794: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:52.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:51 smithi146 ceph-mon[32357]: pgmap v794: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:57:54.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:53 smithi134 ceph-mon[31708]: pgmap v795: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:57:54.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:53 smithi081 ceph-mon[28640]: pgmap v795: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:57:54.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:53 smithi146 ceph-mon[32357]: pgmap v795: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:57:56.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:55 smithi134 ceph-mon[31708]: pgmap v796: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:57:56.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:55 smithi081 ceph-mon[28640]: pgmap v796: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:57:56.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:55 smithi146 ceph-mon[32357]: pgmap v796: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:57:58.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:57 smithi134 ceph-mon[31708]: pgmap v797: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:57:58.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:57 smithi081 ceph-mon[28640]: pgmap v797: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:57:58.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:57 smithi146 ceph-mon[32357]: pgmap v797: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:58:00.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:57:59 smithi134 ceph-mon[31708]: pgmap v798: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:00.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:57:59 smithi081 ceph-mon[28640]: pgmap v798: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:00.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:57:59 smithi146 ceph-mon[32357]: pgmap v798: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:02.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:01 smithi134 ceph-mon[31708]: pgmap v799: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:02.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:01 smithi081 ceph-mon[28640]: pgmap v799: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:02.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:01 smithi146 ceph-mon[32357]: pgmap v799: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:04.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:03 smithi134 ceph-mon[31708]: pgmap v800: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:58:04.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:03 smithi081 ceph-mon[28640]: pgmap v800: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:58:04.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:03 smithi146 ceph-mon[32357]: pgmap v800: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:58:06.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:05 smithi134 ceph-mon[31708]: pgmap v801: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:58:06.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:05 smithi081 ceph-mon[28640]: pgmap v801: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:58:06.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:05 smithi146 ceph-mon[32357]: pgmap v801: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:58:08.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:07 smithi134 ceph-mon[31708]: pgmap v802: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:58:08.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:07 smithi081 ceph-mon[28640]: pgmap v802: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:58:08.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:07 smithi146 ceph-mon[32357]: pgmap v802: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:58:10.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:09 smithi134 ceph-mon[31708]: pgmap v803: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:10.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:09 smithi081 ceph-mon[28640]: pgmap v803: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:10.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:09 smithi146 ceph-mon[32357]: pgmap v803: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:12.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:11 smithi134 ceph-mon[31708]: pgmap v804: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:11 smithi081 ceph-mon[28640]: pgmap v804: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:12.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:11 smithi146 ceph-mon[32357]: pgmap v804: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:14.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:13 smithi134 ceph-mon[31708]: pgmap v805: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:58:14.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:13 smithi081 ceph-mon[28640]: pgmap v805: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:58:14.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:13 smithi146 ceph-mon[32357]: pgmap v805: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:58:16.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:15 smithi134 ceph-mon[31708]: pgmap v806: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:58:16.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:15 smithi081 ceph-mon[28640]: pgmap v806: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:58:16.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:15 smithi146 ceph-mon[32357]: pgmap v806: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:58:18.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:17 smithi134 ceph-mon[31708]: pgmap v807: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:58:18.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:17 smithi081 ceph-mon[28640]: pgmap v807: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:58:18.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:17 smithi146 ceph-mon[32357]: pgmap v807: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:58:20.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:19 smithi134 ceph-mon[31708]: pgmap v808: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:20.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:19 smithi081 ceph-mon[28640]: pgmap v808: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:20.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:19 smithi146 ceph-mon[32357]: pgmap v808: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:22.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:21 smithi134 ceph-mon[31708]: pgmap v809: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:22.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:21 smithi081 ceph-mon[28640]: pgmap v809: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:22.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:21 smithi146 ceph-mon[32357]: pgmap v809: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:24.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:23 smithi134 ceph-mon[31708]: pgmap v810: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:58:24.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:23 smithi081 ceph-mon[28640]: pgmap v810: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:58:24.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:23 smithi146 ceph-mon[32357]: pgmap v810: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:58:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:58:24.386+0000 7f25ee000640 1 -- 172.21.15.81:0/2476086306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25d0005ee0 con 0x7f25f8107070 2024-05-03T16:58:24.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T16:58:24.387+0000 7f25ef400640 1 -- 172.21.15.81:0/2476086306 <== mon.0 v2:172.21.15.81:3300/0 10 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25d0005ee0 con 0x7f25f8107070 2024-05-03T16:58:26.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:25 smithi081 ceph-mon[28640]: pgmap v811: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:58:26.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:25 smithi146 ceph-mon[32357]: pgmap v811: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:58:26.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:25 smithi134 ceph-mon[31708]: pgmap v811: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:58:28.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:27 smithi081 ceph-mon[28640]: pgmap v812: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:58:28.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:27 smithi146 ceph-mon[32357]: pgmap v812: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:58:28.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:27 smithi134 ceph-mon[31708]: pgmap v812: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:58:30.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:29 smithi081 ceph-mon[28640]: pgmap v813: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:30.311 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:29 smithi146 ceph-mon[32357]: pgmap v813: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:30.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:29 smithi134 ceph-mon[31708]: pgmap v813: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:31.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:30 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:58:31.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:30 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:58:31.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:30 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:58:32.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:31 smithi146 ceph-mon[32357]: pgmap v814: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:32.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:58:32.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:58:32.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:31 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:58:32.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:31 smithi134 ceph-mon[31708]: pgmap v814: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:32.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:58:32.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:58:32.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:31 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:58:32.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:31 smithi081 ceph-mon[28640]: pgmap v814: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:32.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:58:32.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:58:32.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:31 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:58:34.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:34 smithi146 ceph-mon[32357]: pgmap v815: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:58:34.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:34 smithi134 ceph-mon[31708]: pgmap v815: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:58:34.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:34 smithi081 ceph-mon[28640]: pgmap v815: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:58:36.269 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:36 smithi134 ceph-mon[31708]: pgmap v816: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:58:36.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:36 smithi146 ceph-mon[32357]: pgmap v816: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:58:36.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:36 smithi081 ceph-mon[28640]: pgmap v816: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:58:38.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:38 smithi146 ceph-mon[32357]: pgmap v817: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:58:38.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:38 smithi134 ceph-mon[31708]: pgmap v817: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:58:38.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:38 smithi081 ceph-mon[28640]: pgmap v817: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:58:40.293 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:40 smithi081 ceph-mon[28640]: pgmap v818: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:40.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:40 smithi146 ceph-mon[32357]: pgmap v818: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:40.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:40 smithi134 ceph-mon[31708]: pgmap v818: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:42.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:42 smithi146 ceph-mon[32357]: pgmap v819: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:42.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:42 smithi134 ceph-mon[31708]: pgmap v819: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:42.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:42 smithi081 ceph-mon[28640]: pgmap v819: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:44.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:44 smithi146 ceph-mon[32357]: pgmap v820: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:58:44.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:44 smithi134 ceph-mon[31708]: pgmap v820: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:58:44.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:44 smithi081 ceph-mon[28640]: pgmap v820: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:58:46.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:46 smithi146 ceph-mon[32357]: pgmap v821: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:58:46.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:46 smithi134 ceph-mon[31708]: pgmap v821: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:58:46.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:46 smithi081 ceph-mon[28640]: pgmap v821: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:58:48.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:48 smithi146 ceph-mon[32357]: pgmap v822: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:58:48.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:48 smithi134 ceph-mon[31708]: pgmap v822: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:58:48.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:48 smithi081 ceph-mon[28640]: pgmap v822: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:58:50.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:50 smithi146 ceph-mon[32357]: pgmap v823: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:50.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:50 smithi134 ceph-mon[31708]: pgmap v823: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:50.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:50 smithi081 ceph-mon[28640]: pgmap v823: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:52.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:52 smithi134 ceph-mon[31708]: pgmap v824: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:52.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:52 smithi081 ceph-mon[28640]: pgmap v824: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:52.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:52 smithi146 ceph-mon[32357]: pgmap v824: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:58:54.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:54 smithi134 ceph-mon[31708]: pgmap v825: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:58:54.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:54 smithi081 ceph-mon[28640]: pgmap v825: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:58:54.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:54 smithi146 ceph-mon[32357]: pgmap v825: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:58:56.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:56 smithi134 ceph-mon[31708]: pgmap v826: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:58:56.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:56 smithi081 ceph-mon[28640]: pgmap v826: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:58:56.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:56 smithi146 ceph-mon[32357]: pgmap v826: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:58:58.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:58:58 smithi134 ceph-mon[31708]: pgmap v827: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:58:58.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:58:58 smithi081 ceph-mon[28640]: pgmap v827: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:58:58.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:58:58 smithi146 ceph-mon[32357]: pgmap v827: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:59:00.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:00 smithi134 ceph-mon[31708]: pgmap v828: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:59:00.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:00 smithi081 ceph-mon[28640]: pgmap v828: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:59:00.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:00 smithi146 ceph-mon[32357]: pgmap v828: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T16:59:02.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:02 smithi134 ceph-mon[31708]: pgmap v829: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:59:02.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:02 smithi081 ceph-mon[28640]: pgmap v829: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:59:02.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:02 smithi146 ceph-mon[32357]: pgmap v829: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T16:59:04.365 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:04 smithi146 ceph-mon[32357]: pgmap v830: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T16:59:04.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:04 smithi134 ceph-mon[31708]: pgmap v830: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T16:59:04.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:04 smithi081 ceph-mon[28640]: pgmap v830: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T16:59:06.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:06 smithi134 ceph-mon[31708]: pgmap v831: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T16:59:06.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:06 smithi081 ceph-mon[28640]: pgmap v831: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T16:59:06.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:06 smithi146 ceph-mon[32357]: pgmap v831: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T16:59:08.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:08 smithi134 ceph-mon[31708]: pgmap v832: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:59:08.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:08 smithi081 ceph-mon[28640]: pgmap v832: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:59:08.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:08 smithi146 ceph-mon[32357]: pgmap v832: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:59:10.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:10 smithi134 ceph-mon[31708]: pgmap v833: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:10.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:10 smithi081 ceph-mon[28640]: pgmap v833: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:10.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:10 smithi146 ceph-mon[32357]: pgmap v833: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:12.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:12 smithi134 ceph-mon[31708]: pgmap v834: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:12.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:12 smithi081 ceph-mon[28640]: pgmap v834: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:12.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:12 smithi146 ceph-mon[32357]: pgmap v834: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:14.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:14 smithi134 ceph-mon[31708]: pgmap v835: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:59:14.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:14 smithi081 ceph-mon[28640]: pgmap v835: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:59:14.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:14 smithi146 ceph-mon[32357]: pgmap v835: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:59:16.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:16 smithi134 ceph-mon[31708]: pgmap v836: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:59:16.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:16 smithi081 ceph-mon[28640]: pgmap v836: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:59:16.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:16 smithi146 ceph-mon[32357]: pgmap v836: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:59:18.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:18 smithi134 ceph-mon[31708]: pgmap v837: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:59:18.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:18 smithi081 ceph-mon[28640]: pgmap v837: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:59:18.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:18 smithi146 ceph-mon[32357]: pgmap v837: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:59:20.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:20 smithi134 ceph-mon[31708]: pgmap v838: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:20.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:20 smithi081 ceph-mon[28640]: pgmap v838: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:20.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:20 smithi146 ceph-mon[32357]: pgmap v838: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:22.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:22 smithi134 ceph-mon[31708]: pgmap v839: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:22.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:22 smithi081 ceph-mon[28640]: pgmap v839: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:22.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:22 smithi146 ceph-mon[32357]: pgmap v839: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:24.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:24 smithi134 ceph-mon[31708]: pgmap v840: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:59:24.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:24 smithi081 ceph-mon[28640]: pgmap v840: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:59:24.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:24 smithi146 ceph-mon[32357]: pgmap v840: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:59:26.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:26 smithi134 ceph-mon[31708]: pgmap v841: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:59:26.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:26 smithi081 ceph-mon[28640]: pgmap v841: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:59:26.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:26 smithi146 ceph-mon[32357]: pgmap v841: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:59:28.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:28 smithi134 ceph-mon[31708]: pgmap v842: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:59:28.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:28 smithi081 ceph-mon[28640]: pgmap v842: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:59:28.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:28 smithi146 ceph-mon[32357]: pgmap v842: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:59:30.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:30 smithi134 ceph-mon[31708]: pgmap v843: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:30.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:30 smithi081 ceph-mon[28640]: pgmap v843: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:30.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:30 smithi146 ceph-mon[32357]: pgmap v843: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:32.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:32 smithi134 ceph-mon[31708]: pgmap v844: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:32.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:32 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:59:32.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:32 smithi081 ceph-mon[28640]: pgmap v844: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:32.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:32 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:59:32.561 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:32 smithi146 ceph-mon[32357]: pgmap v844: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:32.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:32 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T16:59:34.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:34 smithi134 ceph-mon[31708]: pgmap v845: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:59:34.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:34 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:59:34.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:34 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:59:34.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:34 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:59:34.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:34 smithi081 ceph-mon[28640]: pgmap v845: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:59:34.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:34 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:59:34.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:34 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:59:34.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:34 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:59:34.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:34 smithi146 ceph-mon[32357]: pgmap v845: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T16:59:34.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:34 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T16:59:34.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:34 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T16:59:34.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:34 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T16:59:36.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:36 smithi081 ceph-mon[28640]: pgmap v846: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:59:36.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:36 smithi146 ceph-mon[32357]: pgmap v846: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:59:36.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:36 smithi134 ceph-mon[31708]: pgmap v846: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:59:38.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:38 smithi081 ceph-mon[28640]: pgmap v847: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:59:38.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:38 smithi146 ceph-mon[32357]: pgmap v847: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:59:38.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:38 smithi134 ceph-mon[31708]: pgmap v847: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:59:40.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:40 smithi146 ceph-mon[32357]: pgmap v848: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:40.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:40 smithi134 ceph-mon[31708]: pgmap v848: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:40.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:40 smithi081 ceph-mon[28640]: pgmap v848: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:42.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:42 smithi146 ceph-mon[32357]: pgmap v849: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:42.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:42 smithi134 ceph-mon[31708]: pgmap v849: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:42.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:42 smithi081 ceph-mon[28640]: pgmap v849: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T16:59:44.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:44 smithi146 ceph-mon[32357]: pgmap v850: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T16:59:44.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:44 smithi134 ceph-mon[31708]: pgmap v850: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T16:59:44.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:44 smithi081 ceph-mon[28640]: pgmap v850: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T16:59:46.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:46 smithi146 ceph-mon[32357]: pgmap v851: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-05-03T16:59:46.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:46 smithi134 ceph-mon[31708]: pgmap v851: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-05-03T16:59:46.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:46 smithi081 ceph-mon[28640]: pgmap v851: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-05-03T16:59:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:47 smithi134 ceph-mon[31708]: pgmap v852: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:59:47.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:47 smithi081 ceph-mon[28640]: pgmap v852: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:59:47.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:47 smithi146 ceph-mon[32357]: pgmap v852: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T16:59:50.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:49 smithi134 ceph-mon[31708]: pgmap v853: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T16:59:50.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:49 smithi081 ceph-mon[28640]: pgmap v853: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T16:59:50.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:49 smithi146 ceph-mon[32357]: pgmap v853: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T16:59:52.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:51 smithi134 ceph-mon[31708]: pgmap v854: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T16:59:52.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:51 smithi081 ceph-mon[28640]: pgmap v854: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T16:59:52.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:51 smithi146 ceph-mon[32357]: pgmap v854: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T16:59:54.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:53 smithi134 ceph-mon[31708]: pgmap v855: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T16:59:54.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:53 smithi081 ceph-mon[28640]: pgmap v855: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T16:59:54.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:53 smithi146 ceph-mon[32357]: pgmap v855: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T16:59:56.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:55 smithi134 ceph-mon[31708]: pgmap v856: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:59:56.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:55 smithi081 ceph-mon[28640]: pgmap v856: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:59:56.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:55 smithi146 ceph-mon[32357]: pgmap v856: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T16:59:58.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:57 smithi134 ceph-mon[31708]: pgmap v857: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:59:58.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:57 smithi081 ceph-mon[28640]: pgmap v857: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T16:59:58.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:57 smithi146 ceph-mon[32357]: pgmap v857: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:00:00.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 16:59:59 smithi134 ceph-mon[31708]: pgmap v858: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:00.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 16:59:59 smithi081 ceph-mon[28640]: pgmap v858: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:00.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 16:59:59 smithi146 ceph-mon[32357]: pgmap v858: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:01.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:00 smithi134 ceph-mon[31708]: overall HEALTH_OK 2024-05-03T17:00:01.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:00 smithi081 ceph-mon[28640]: overall HEALTH_OK 2024-05-03T17:00:01.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:00 smithi146 ceph-mon[32357]: overall HEALTH_OK 2024-05-03T17:00:02.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:01 smithi134 ceph-mon[31708]: pgmap v859: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:02.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:01 smithi081 ceph-mon[28640]: pgmap v859: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:02.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:01 smithi146 ceph-mon[32357]: pgmap v859: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:04.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:03 smithi134 ceph-mon[31708]: pgmap v860: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:00:04.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:03 smithi081 ceph-mon[28640]: pgmap v860: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:00:04.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:03 smithi146 ceph-mon[32357]: pgmap v860: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:00:06.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:05 smithi134 ceph-mon[31708]: pgmap v861: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:00:06.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:05 smithi081 ceph-mon[28640]: pgmap v861: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:00:06.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:05 smithi146 ceph-mon[32357]: pgmap v861: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:00:08.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:07 smithi134 ceph-mon[31708]: pgmap v862: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:00:08.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:07 smithi081 ceph-mon[28640]: pgmap v862: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:00:08.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:07 smithi146 ceph-mon[32357]: pgmap v862: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:00:10.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:09 smithi134 ceph-mon[31708]: pgmap v863: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:10.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:09 smithi081 ceph-mon[28640]: pgmap v863: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:10.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:09 smithi146 ceph-mon[32357]: pgmap v863: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:12.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:11 smithi134 ceph-mon[31708]: pgmap v864: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:12.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:11 smithi081 ceph-mon[28640]: pgmap v864: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:12.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:11 smithi146 ceph-mon[32357]: pgmap v864: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:14.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:13 smithi134 ceph-mon[31708]: pgmap v865: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:00:14.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:13 smithi081 ceph-mon[28640]: pgmap v865: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:00:14.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:13 smithi146 ceph-mon[32357]: pgmap v865: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:00:16.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:15 smithi134 ceph-mon[31708]: pgmap v866: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:00:16.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:15 smithi081 ceph-mon[28640]: pgmap v866: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:00:16.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:15 smithi146 ceph-mon[32357]: pgmap v866: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:00:18.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:17 smithi134 ceph-mon[31708]: pgmap v867: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:00:18.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:17 smithi081 ceph-mon[28640]: pgmap v867: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:00:18.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:17 smithi146 ceph-mon[32357]: pgmap v867: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:00:20.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:19 smithi134 ceph-mon[31708]: pgmap v868: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:20.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:19 smithi081 ceph-mon[28640]: pgmap v868: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:20.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:19 smithi146 ceph-mon[32357]: pgmap v868: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:22.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:21 smithi134 ceph-mon[31708]: pgmap v869: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:22.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:21 smithi081 ceph-mon[28640]: pgmap v869: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:22.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:21 smithi146 ceph-mon[32357]: pgmap v869: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:24.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:23 smithi134 ceph-mon[31708]: pgmap v870: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:00:24.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:23 smithi081 ceph-mon[28640]: pgmap v870: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:00:24.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:23 smithi146 ceph-mon[32357]: pgmap v870: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:00:26.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:25 smithi134 ceph-mon[31708]: pgmap v871: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:00:26.240 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:25 smithi146 ceph-mon[32357]: pgmap v871: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:00:26.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:25 smithi081 ceph-mon[28640]: pgmap v871: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:00:28.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:27 smithi134 ceph-mon[31708]: pgmap v872: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:00:28.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:27 smithi081 ceph-mon[28640]: pgmap v872: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:00:28.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:27 smithi146 ceph-mon[32357]: pgmap v872: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:00:30.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:29 smithi081 ceph-mon[28640]: pgmap v873: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:30.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:29 smithi146 ceph-mon[32357]: pgmap v873: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:30.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:29 smithi134 ceph-mon[31708]: pgmap v873: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:32.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:31 smithi081 ceph-mon[28640]: pgmap v874: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:32.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:31 smithi146 ceph-mon[32357]: pgmap v874: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:32.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:31 smithi134 ceph-mon[31708]: pgmap v874: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:34.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:33 smithi081 ceph-mon[28640]: pgmap v875: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:00:34.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:33 smithi146 ceph-mon[32357]: pgmap v875: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:00:34.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:33 smithi134 ceph-mon[31708]: pgmap v875: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:00:35.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:34 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T17:00:35.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:34 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T17:00:35.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:34 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T17:00:36.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:36 smithi146 ceph-mon[32357]: pgmap v876: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:00:36.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:36 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T17:00:36.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:36 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T17:00:36.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:36 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:00:36.368 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:36 smithi134 ceph-mon[31708]: pgmap v876: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:00:36.368 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:36 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T17:00:36.368 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:36 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T17:00:36.368 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:36 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:00:36.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:36 smithi081 ceph-mon[28640]: pgmap v876: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:00:36.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:36 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T17:00:36.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:36 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T17:00:36.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:36 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:00:38.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:38 smithi146 ceph-mon[32357]: pgmap v877: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T17:00:38.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:38 smithi134 ceph-mon[31708]: pgmap v877: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T17:00:38.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:38 smithi081 ceph-mon[28640]: pgmap v877: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T17:00:40.293 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:40 smithi081 ceph-mon[28640]: pgmap v878: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T17:00:40.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:40 smithi146 ceph-mon[32357]: pgmap v878: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T17:00:40.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:40 smithi134 ceph-mon[31708]: pgmap v878: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T17:00:42.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:42 smithi146 ceph-mon[32357]: pgmap v879: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T17:00:42.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:42 smithi134 ceph-mon[31708]: pgmap v879: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T17:00:42.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:42 smithi081 ceph-mon[28640]: pgmap v879: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T17:00:44.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:44 smithi146 ceph-mon[32357]: pgmap v880: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T17:00:44.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:44 smithi134 ceph-mon[31708]: pgmap v880: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T17:00:44.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:44 smithi081 ceph-mon[28640]: pgmap v880: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T17:00:46.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:46 smithi146 ceph-mon[32357]: pgmap v881: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T17:00:46.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:46 smithi134 ceph-mon[31708]: pgmap v881: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T17:00:46.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:46 smithi081 ceph-mon[28640]: pgmap v881: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T17:00:48.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:48 smithi146 ceph-mon[32357]: pgmap v882: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T17:00:48.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:48 smithi134 ceph-mon[31708]: pgmap v882: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T17:00:48.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:48 smithi081 ceph-mon[28640]: pgmap v882: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T17:00:50.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:50 smithi146 ceph-mon[32357]: pgmap v883: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:50.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:50 smithi134 ceph-mon[31708]: pgmap v883: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:50.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:50 smithi081 ceph-mon[28640]: pgmap v883: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:52.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:52 smithi146 ceph-mon[32357]: pgmap v884: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:52.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:52 smithi134 ceph-mon[31708]: pgmap v884: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:52.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:52 smithi081 ceph-mon[28640]: pgmap v884: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:00:53.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:53 smithi134 ceph-mon[31708]: pgmap v885: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:00:53.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:53 smithi081 ceph-mon[28640]: pgmap v885: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:00:53.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:53 smithi146 ceph-mon[32357]: pgmap v885: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:00:56.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:55 smithi134 ceph-mon[31708]: pgmap v886: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:00:56.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:55 smithi081 ceph-mon[28640]: pgmap v886: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:00:56.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:55 smithi146 ceph-mon[32357]: pgmap v886: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:00:58.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:00:57 smithi134 ceph-mon[31708]: pgmap v887: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:00:58.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:00:57 smithi081 ceph-mon[28640]: pgmap v887: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:00:58.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:00:57 smithi146 ceph-mon[32357]: pgmap v887: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:00.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:00 smithi146 ceph-mon[32357]: pgmap v888: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:00.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:00 smithi134 ceph-mon[31708]: pgmap v888: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:00.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:00 smithi081 ceph-mon[28640]: pgmap v888: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:02.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:02 smithi146 ceph-mon[32357]: pgmap v889: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:02.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:02 smithi134 ceph-mon[31708]: pgmap v889: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:02.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:02 smithi081 ceph-mon[28640]: pgmap v889: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:04.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:04 smithi146 ceph-mon[32357]: pgmap v890: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:01:04.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:04 smithi134 ceph-mon[31708]: pgmap v890: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:01:04.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:04 smithi081 ceph-mon[28640]: pgmap v890: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:01:06.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:06 smithi146 ceph-mon[32357]: pgmap v891: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:01:06.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:06 smithi134 ceph-mon[31708]: pgmap v891: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:01:06.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:06 smithi081 ceph-mon[28640]: pgmap v891: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:01:07.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:07 smithi146 ceph-mon[32357]: pgmap v892: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:07.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:07 smithi134 ceph-mon[31708]: pgmap v892: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:07.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:07 smithi081 ceph-mon[28640]: pgmap v892: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:10.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:09 smithi134 ceph-mon[31708]: pgmap v893: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:10.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:09 smithi081 ceph-mon[28640]: pgmap v893: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:10.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:09 smithi146 ceph-mon[32357]: pgmap v893: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:12.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:11 smithi134 ceph-mon[31708]: pgmap v894: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:12.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:11 smithi081 ceph-mon[28640]: pgmap v894: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:12.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:11 smithi146 ceph-mon[32357]: pgmap v894: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:14.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:13 smithi134 ceph-mon[31708]: pgmap v895: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:01:14.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:13 smithi081 ceph-mon[28640]: pgmap v895: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:01:14.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:13 smithi146 ceph-mon[32357]: pgmap v895: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:01:16.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:15 smithi134 ceph-mon[31708]: pgmap v896: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:01:16.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:15 smithi081 ceph-mon[28640]: pgmap v896: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:01:16.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:15 smithi146 ceph-mon[32357]: pgmap v896: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:01:18.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:17 smithi134 ceph-mon[31708]: pgmap v897: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:18.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:17 smithi081 ceph-mon[28640]: pgmap v897: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:18.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:17 smithi146 ceph-mon[32357]: pgmap v897: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:20.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:19 smithi134 ceph-mon[31708]: pgmap v898: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:20.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:19 smithi081 ceph-mon[28640]: pgmap v898: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:20.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:19 smithi146 ceph-mon[32357]: pgmap v898: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:22.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:21 smithi134 ceph-mon[31708]: pgmap v899: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:22.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:21 smithi081 ceph-mon[28640]: pgmap v899: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:22.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:21 smithi146 ceph-mon[32357]: pgmap v899: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:24.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:23 smithi134 ceph-mon[31708]: pgmap v900: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:01:24.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:23 smithi081 ceph-mon[28640]: pgmap v900: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:01:24.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:23 smithi146 ceph-mon[32357]: pgmap v900: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:01:24.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:01:24.415+0000 7f25ee000640 1 -- 172.21.15.81:0/2476086306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25d0006120 con 0x7f25f8107070 2024-05-03T17:01:24.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:01:24.416+0000 7f25ef400640 1 -- 172.21.15.81:0/2476086306 <== mon.0 v2:172.21.15.81:3300/0 11 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25d0006120 con 0x7f25f8107070 2024-05-03T17:01:26.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:25 smithi134 ceph-mon[31708]: pgmap v901: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:01:26.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:25 smithi081 ceph-mon[28640]: pgmap v901: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:01:26.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:25 smithi146 ceph-mon[32357]: pgmap v901: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:01:28.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:27 smithi134 ceph-mon[31708]: pgmap v902: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:28.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:27 smithi081 ceph-mon[28640]: pgmap v902: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:28.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:27 smithi146 ceph-mon[32357]: pgmap v902: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:30.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:29 smithi134 ceph-mon[31708]: pgmap v903: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:30.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:29 smithi081 ceph-mon[28640]: pgmap v903: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:30.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:29 smithi146 ceph-mon[32357]: pgmap v903: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:32.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:31 smithi134 ceph-mon[31708]: pgmap v904: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:32.242 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:31 smithi081 ceph-mon[28640]: pgmap v904: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:32.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:31 smithi146 ceph-mon[32357]: pgmap v904: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:34.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:33 smithi134 ceph-mon[31708]: pgmap v905: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:01:34.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:33 smithi081 ceph-mon[28640]: pgmap v905: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:01:34.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:33 smithi146 ceph-mon[32357]: pgmap v905: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:01:36.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:35 smithi134 ceph-mon[31708]: pgmap v906: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:01:36.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:35 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T17:01:36.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:35 smithi081 ceph-mon[28640]: pgmap v906: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:01:36.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:35 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T17:01:36.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:35 smithi146 ceph-mon[32357]: pgmap v906: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:01:36.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:35 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T17:01:38.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:37 smithi134 ceph-mon[31708]: pgmap v907: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:38.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T17:01:38.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T17:01:38.217 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:37 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:01:38.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:37 smithi081 ceph-mon[28640]: pgmap v907: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:38.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T17:01:38.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T17:01:38.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:37 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:01:38.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:37 smithi146 ceph-mon[32357]: pgmap v907: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:38.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T17:01:38.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T17:01:38.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:37 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:01:40.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:39 smithi134 ceph-mon[31708]: pgmap v908: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:40.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:39 smithi081 ceph-mon[28640]: pgmap v908: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:40.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:39 smithi146 ceph-mon[32357]: pgmap v908: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:42.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:41 smithi081 ceph-mon[28640]: pgmap v909: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:42.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:41 smithi146 ceph-mon[32357]: pgmap v909: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:42.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:41 smithi134 ceph-mon[31708]: pgmap v909: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:44.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:43 smithi081 ceph-mon[28640]: pgmap v910: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:01:44.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:43 smithi146 ceph-mon[32357]: pgmap v910: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:01:44.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:43 smithi134 ceph-mon[31708]: pgmap v910: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T17:01:46.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:45 smithi081 ceph-mon[28640]: pgmap v911: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:01:46.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:45 smithi146 ceph-mon[32357]: pgmap v911: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:01:46.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:45 smithi134 ceph-mon[31708]: pgmap v911: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:01:48.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:47 smithi081 ceph-mon[28640]: pgmap v912: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:48.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:47 smithi146 ceph-mon[32357]: pgmap v912: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:48.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:47 smithi134 ceph-mon[31708]: pgmap v912: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:50.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:49 smithi146 ceph-mon[32357]: pgmap v913: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:50.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:49 smithi134 ceph-mon[31708]: pgmap v913: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:50.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:49 smithi081 ceph-mon[28640]: pgmap v913: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:52.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:52 smithi146 ceph-mon[32357]: pgmap v914: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:52.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:52 smithi134 ceph-mon[31708]: pgmap v914: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:52.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:51 smithi081 ceph-mon[28640]: pgmap v914: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:01:54.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:54 smithi146 ceph-mon[32357]: pgmap v915: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:54.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:54 smithi134 ceph-mon[31708]: pgmap v915: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:54.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:54 smithi081 ceph-mon[28640]: pgmap v915: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:56.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:56 smithi146 ceph-mon[32357]: pgmap v916: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:01:56.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:56 smithi134 ceph-mon[31708]: pgmap v916: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:01:56.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:56 smithi081 ceph-mon[28640]: pgmap v916: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T17:01:58.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:01:58 smithi146 ceph-mon[32357]: pgmap v917: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:58.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:01:58 smithi134 ceph-mon[31708]: pgmap v917: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:01:58.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:01:58 smithi081 ceph-mon[28640]: pgmap v917: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:00.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:00 smithi146 ceph-mon[32357]: pgmap v918: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:00.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:00 smithi134 ceph-mon[31708]: pgmap v918: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:00.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:00 smithi081 ceph-mon[28640]: pgmap v918: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:02.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:02 smithi146 ceph-mon[32357]: pgmap v919: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:02.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:02 smithi134 ceph-mon[31708]: pgmap v919: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:02.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:02 smithi081 ceph-mon[28640]: pgmap v919: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:04.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:04 smithi146 ceph-mon[32357]: pgmap v920: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:04.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:04 smithi134 ceph-mon[31708]: pgmap v920: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:04.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:04 smithi081 ceph-mon[28640]: pgmap v920: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:06.304 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:06 smithi134 ceph-mon[31708]: pgmap v921: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:02:06.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:06 smithi146 ceph-mon[32357]: pgmap v921: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:02:06.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:06 smithi081 ceph-mon[28640]: pgmap v921: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:02:08.218 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:08 smithi134 ceph-mon[31708]: pgmap v922: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:08.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:08 smithi146 ceph-mon[32357]: pgmap v922: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:08.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:08 smithi081 ceph-mon[28640]: pgmap v922: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:10.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:10 smithi146 ceph-mon[32357]: pgmap v923: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:10.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:10 smithi134 ceph-mon[31708]: pgmap v923: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:10.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:10 smithi081 ceph-mon[28640]: pgmap v923: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:12.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:12 smithi134 ceph-mon[31708]: pgmap v924: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:12.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:12 smithi081 ceph-mon[28640]: pgmap v924: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:12.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:12 smithi146 ceph-mon[32357]: pgmap v924: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:14.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:14 smithi134 ceph-mon[31708]: pgmap v925: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:14.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:14 smithi081 ceph-mon[28640]: pgmap v925: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:14.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:14 smithi146 ceph-mon[32357]: pgmap v925: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:16.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:16 smithi134 ceph-mon[31708]: pgmap v926: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:02:16.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:16 smithi081 ceph-mon[28640]: pgmap v926: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:02:16.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:16 smithi146 ceph-mon[32357]: pgmap v926: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:02:18.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:18 smithi134 ceph-mon[31708]: pgmap v927: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:18.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:18 smithi081 ceph-mon[28640]: pgmap v927: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:18.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:18 smithi146 ceph-mon[32357]: pgmap v927: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:20.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:20 smithi134 ceph-mon[31708]: pgmap v928: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:20.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:20 smithi081 ceph-mon[28640]: pgmap v928: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:20.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:20 smithi146 ceph-mon[32357]: pgmap v928: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:22.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:22 smithi134 ceph-mon[31708]: pgmap v929: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:22.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:22 smithi081 ceph-mon[28640]: pgmap v929: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:22.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:22 smithi146 ceph-mon[32357]: pgmap v929: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:24.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:24 smithi134 ceph-mon[31708]: pgmap v930: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:24.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:24 smithi081 ceph-mon[28640]: pgmap v930: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:24.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:24 smithi146 ceph-mon[32357]: pgmap v930: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:26.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:26 smithi134 ceph-mon[31708]: pgmap v931: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:02:26.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:26 smithi081 ceph-mon[28640]: pgmap v931: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:02:26.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:26 smithi146 ceph-mon[32357]: pgmap v931: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:02:28.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:28 smithi134 ceph-mon[31708]: pgmap v932: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:28.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:28 smithi081 ceph-mon[28640]: pgmap v932: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:28.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:28 smithi146 ceph-mon[32357]: pgmap v932: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:30.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:30 smithi134 ceph-mon[31708]: pgmap v933: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:30.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:30 smithi081 ceph-mon[28640]: pgmap v933: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:30.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:30 smithi146 ceph-mon[32357]: pgmap v933: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:32.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:32 smithi134 ceph-mon[31708]: pgmap v934: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:32.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:32 smithi081 ceph-mon[28640]: pgmap v934: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:32.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:32 smithi146 ceph-mon[32357]: pgmap v934: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:34.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:34 smithi134 ceph-mon[31708]: pgmap v935: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:34.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:34 smithi081 ceph-mon[28640]: pgmap v935: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:34.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:34 smithi146 ceph-mon[32357]: pgmap v935: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:36.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:36 smithi134 ceph-mon[31708]: pgmap v936: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:02:36.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:36 smithi081 ceph-mon[28640]: pgmap v936: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:02:36.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:36 smithi146 ceph-mon[32357]: pgmap v936: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:02:38.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:38 smithi134 ceph-mon[31708]: pgmap v937: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:38.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:38 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T17:02:38.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:38 smithi081 ceph-mon[28640]: pgmap v937: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:38.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:38 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T17:02:38.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:38 smithi146 ceph-mon[32357]: pgmap v937: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:38.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:38 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T17:02:39.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T17:02:39.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T17:02:39.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T17:02:39.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T17:02:39.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:02:39.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T17:02:39.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T17:02:40.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:40 smithi134 ceph-mon[31708]: pgmap v938: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T17:02:40.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:40 smithi134 ceph-mon[31708]: Adjusting osd_memory_target on smithi081 to 176.4M 2024-05-03T17:02:40.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:40 smithi134 ceph-mon[31708]: Adjusting osd_memory_target on smithi134 to 176.4M 2024-05-03T17:02:40.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:40 smithi134 ceph-mon[31708]: Unable to set osd_memory_target on smithi081 to 185061273: error parsing value: Value '185061273' is below minimum 939524096 2024-05-03T17:02:40.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:40 smithi134 ceph-mon[31708]: Unable to set osd_memory_target on smithi134 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-03T17:02:40.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:40 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:02:40.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:40 smithi081 ceph-mon[28640]: pgmap v938: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T17:02:40.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:40 smithi081 ceph-mon[28640]: Adjusting osd_memory_target on smithi081 to 176.4M 2024-05-03T17:02:40.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:40 smithi081 ceph-mon[28640]: Adjusting osd_memory_target on smithi134 to 176.4M 2024-05-03T17:02:40.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:40 smithi081 ceph-mon[28640]: Unable to set osd_memory_target on smithi081 to 185061273: error parsing value: Value '185061273' is below minimum 939524096 2024-05-03T17:02:40.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:40 smithi081 ceph-mon[28640]: Unable to set osd_memory_target on smithi134 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-03T17:02:40.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:40 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:02:40.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:40 smithi146 ceph-mon[32357]: pgmap v938: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T17:02:40.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:40 smithi146 ceph-mon[32357]: Adjusting osd_memory_target on smithi081 to 176.4M 2024-05-03T17:02:40.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:40 smithi146 ceph-mon[32357]: Adjusting osd_memory_target on smithi134 to 176.4M 2024-05-03T17:02:40.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:40 smithi146 ceph-mon[32357]: Unable to set osd_memory_target on smithi081 to 185061273: error parsing value: Value '185061273' is below minimum 939524096 2024-05-03T17:02:40.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:40 smithi146 ceph-mon[32357]: Unable to set osd_memory_target on smithi134 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-03T17:02:40.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:40 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:02:42.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:42 smithi134 ceph-mon[31708]: pgmap v939: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T17:02:42.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:42 smithi081 ceph-mon[28640]: pgmap v939: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T17:02:42.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:42 smithi146 ceph-mon[32357]: pgmap v939: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T17:02:44.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:44 smithi134 ceph-mon[31708]: pgmap v940: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T17:02:44.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:44 smithi081 ceph-mon[28640]: pgmap v940: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T17:02:44.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:44 smithi146 ceph-mon[32357]: pgmap v940: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T17:02:46.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:46 smithi134 ceph-mon[31708]: pgmap v941: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T17:02:46.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:46 smithi081 ceph-mon[28640]: pgmap v941: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T17:02:46.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:46 smithi146 ceph-mon[32357]: pgmap v941: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T17:02:48.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:48 smithi134 ceph-mon[31708]: pgmap v942: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T17:02:48.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:48 smithi081 ceph-mon[28640]: pgmap v942: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T17:02:48.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:48 smithi146 ceph-mon[32357]: pgmap v942: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T17:02:50.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:50 smithi134 ceph-mon[31708]: pgmap v943: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T17:02:50.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:50 smithi081 ceph-mon[28640]: pgmap v943: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T17:02:50.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:50 smithi146 ceph-mon[32357]: pgmap v943: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T17:02:52.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:52 smithi134 ceph-mon[31708]: pgmap v944: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:52.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:52 smithi081 ceph-mon[28640]: pgmap v944: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:52.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:52 smithi146 ceph-mon[32357]: pgmap v944: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:02:54.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:54 smithi081 ceph-mon[28640]: pgmap v945: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:54.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:54 smithi146 ceph-mon[32357]: pgmap v945: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:54.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:54 smithi134 ceph-mon[31708]: pgmap v945: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:56.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:56 smithi081 ceph-mon[28640]: pgmap v946: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:02:56.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:56 smithi146 ceph-mon[32357]: pgmap v946: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:02:56.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:56 smithi134 ceph-mon[31708]: pgmap v946: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:02:58.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:02:58 smithi081 ceph-mon[28640]: pgmap v947: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:58.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:02:58 smithi146 ceph-mon[32357]: pgmap v947: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:02:58.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:02:58 smithi134 ceph-mon[31708]: pgmap v947: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:00.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:00 smithi081 ceph-mon[28640]: pgmap v948: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:00.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:00 smithi146 ceph-mon[32357]: pgmap v948: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:00.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:00 smithi134 ceph-mon[31708]: pgmap v948: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:02.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:02 smithi146 ceph-mon[32357]: pgmap v949: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:02.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:02 smithi134 ceph-mon[31708]: pgmap v949: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:02.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:02 smithi081 ceph-mon[28640]: pgmap v949: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:04.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:04 smithi146 ceph-mon[32357]: pgmap v950: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:04.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:04 smithi134 ceph-mon[31708]: pgmap v950: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:04.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:04 smithi081 ceph-mon[28640]: pgmap v950: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:06.518 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:06 smithi134 ceph-mon[31708]: pgmap v951: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:03:06.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:06 smithi146 ceph-mon[32357]: pgmap v951: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:03:06.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:06 smithi081 ceph-mon[28640]: pgmap v951: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:03:08.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:08 smithi146 ceph-mon[32357]: pgmap v952: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:08.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:08 smithi134 ceph-mon[31708]: pgmap v952: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:08.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:08 smithi081 ceph-mon[28640]: pgmap v952: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:10.543 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:10 smithi081 ceph-mon[28640]: pgmap v953: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:10.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:10 smithi146 ceph-mon[32357]: pgmap v953: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:10.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:10 smithi134 ceph-mon[31708]: pgmap v953: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:12.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:12 smithi146 ceph-mon[32357]: pgmap v954: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:12.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:12 smithi134 ceph-mon[31708]: pgmap v954: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:12.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:12 smithi081 ceph-mon[28640]: pgmap v954: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:14.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:14 smithi146 ceph-mon[32357]: pgmap v955: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:14.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:14 smithi134 ceph-mon[31708]: pgmap v955: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:14.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:14 smithi081 ceph-mon[28640]: pgmap v955: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:16.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:16 smithi146 ceph-mon[32357]: pgmap v956: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:03:16.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:16 smithi134 ceph-mon[31708]: pgmap v956: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:03:16.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:16 smithi081 ceph-mon[28640]: pgmap v956: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:03:18.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:18 smithi146 ceph-mon[32357]: pgmap v957: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:18.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:18 smithi134 ceph-mon[31708]: pgmap v957: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:18.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:18 smithi081 ceph-mon[28640]: pgmap v957: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:20.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:20 smithi146 ceph-mon[32357]: pgmap v958: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:20.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:20 smithi134 ceph-mon[31708]: pgmap v958: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:20.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:20 smithi081 ceph-mon[28640]: pgmap v958: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:22.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:22 smithi146 ceph-mon[32357]: pgmap v959: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:22.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:22 smithi134 ceph-mon[31708]: pgmap v959: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:22.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:22 smithi081 ceph-mon[28640]: pgmap v959: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:23.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:23 smithi134 ceph-mon[31708]: pgmap v960: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:23.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:23 smithi081 ceph-mon[28640]: pgmap v960: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:23.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:23 smithi146 ceph-mon[32357]: pgmap v960: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:26.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:25 smithi134 ceph-mon[31708]: pgmap v961: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:03:26.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:25 smithi081 ceph-mon[28640]: pgmap v961: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:03:26.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:25 smithi146 ceph-mon[32357]: pgmap v961: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:03:28.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:27 smithi134 ceph-mon[31708]: pgmap v962: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:28.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:27 smithi081 ceph-mon[28640]: pgmap v962: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:28.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:27 smithi146 ceph-mon[32357]: pgmap v962: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:30.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:29 smithi134 ceph-mon[31708]: pgmap v963: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:30.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:29 smithi081 ceph-mon[28640]: pgmap v963: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:30.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:29 smithi146 ceph-mon[32357]: pgmap v963: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:32.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:31 smithi134 ceph-mon[31708]: pgmap v964: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:32.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:31 smithi081 ceph-mon[28640]: pgmap v964: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:32.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:31 smithi146 ceph-mon[32357]: pgmap v964: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:34.216 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:33 smithi134 ceph-mon[31708]: pgmap v965: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:34.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:33 smithi081 ceph-mon[28640]: pgmap v965: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:34.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:33 smithi146 ceph-mon[32357]: pgmap v965: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:36.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:35 smithi081 ceph-mon[28640]: pgmap v966: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:03:36.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:35 smithi146 ceph-mon[32357]: pgmap v966: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:03:36.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:35 smithi134 ceph-mon[31708]: pgmap v966: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:03:38.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:37 smithi081 ceph-mon[28640]: pgmap v967: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:38.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:37 smithi146 ceph-mon[32357]: pgmap v967: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:38.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:37 smithi134 ceph-mon[31708]: pgmap v967: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:40.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:39 smithi081 ceph-mon[28640]: pgmap v968: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:40.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:39 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T17:03:40.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:39 smithi146 ceph-mon[32357]: pgmap v968: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:40.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:39 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T17:03:40.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:39 smithi134 ceph-mon[31708]: pgmap v968: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:40.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:39 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T17:03:42.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:41 smithi081 ceph-mon[28640]: pgmap v969: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:42.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:03:42.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:03:42.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:03:42.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:03:42.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:41 smithi081 ceph-mon[28640]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-05-03T17:03:42.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:41 smithi081 ceph-mon[28640]: Unable to set osd_memory_target on smithi146 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-03T17:03:42.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T17:03:42.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T17:03:42.242 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:41 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:03:42.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:41 smithi146 ceph-mon[32357]: pgmap v969: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:42.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:03:42.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:03:42.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:03:42.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:03:42.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:41 smithi146 ceph-mon[32357]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-05-03T17:03:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:41 smithi146 ceph-mon[32357]: Unable to set osd_memory_target on smithi146 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-03T17:03:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T17:03:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T17:03:42.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:41 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:03:42.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:41 smithi134 ceph-mon[31708]: pgmap v969: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:42.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:03:42.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:03:42.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:03:42.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T17:03:42.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:41 smithi134 ceph-mon[31708]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-05-03T17:03:42.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:41 smithi134 ceph-mon[31708]: Unable to set osd_memory_target on smithi146 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-03T17:03:42.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T17:03:42.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T17:03:42.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:41 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:03:44.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:43 smithi146 ceph-mon[32357]: pgmap v970: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:44.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:43 smithi134 ceph-mon[31708]: pgmap v970: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:44.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:43 smithi081 ceph-mon[28640]: pgmap v970: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:46.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:46 smithi146 ceph-mon[32357]: pgmap v971: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:03:46.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:46 smithi134 ceph-mon[31708]: pgmap v971: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:03:46.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:46 smithi081 ceph-mon[28640]: pgmap v971: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:03:48.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:48 smithi146 ceph-mon[32357]: pgmap v972: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:48.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:48 smithi134 ceph-mon[31708]: pgmap v972: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:48.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:48 smithi081 ceph-mon[28640]: pgmap v972: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:50.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:50 smithi146 ceph-mon[32357]: pgmap v973: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:50.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:50 smithi134 ceph-mon[31708]: pgmap v973: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:50.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:50 smithi081 ceph-mon[28640]: pgmap v973: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:52.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:52 smithi146 ceph-mon[32357]: pgmap v974: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:52.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:52 smithi134 ceph-mon[31708]: pgmap v974: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:52.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:52 smithi081 ceph-mon[28640]: pgmap v974: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:03:54.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:54 smithi146 ceph-mon[32357]: pgmap v975: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:54.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:54 smithi134 ceph-mon[31708]: pgmap v975: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:54.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:54 smithi081 ceph-mon[28640]: pgmap v975: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:56.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:56 smithi146 ceph-mon[32357]: pgmap v976: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:03:56.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:56 smithi134 ceph-mon[31708]: pgmap v976: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:03:56.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:56 smithi081 ceph-mon[28640]: pgmap v976: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:03:58.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:03:58 smithi146 ceph-mon[32357]: pgmap v977: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:58.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:03:58 smithi134 ceph-mon[31708]: pgmap v977: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:03:58.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:03:58 smithi081 ceph-mon[28640]: pgmap v977: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:00.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:00 smithi146 ceph-mon[32357]: pgmap v978: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:00.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:00 smithi134 ceph-mon[31708]: pgmap v978: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:00.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:00 smithi081 ceph-mon[28640]: pgmap v978: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:02.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:02 smithi146 ceph-mon[32357]: pgmap v979: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:02.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:02 smithi134 ceph-mon[31708]: pgmap v979: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:02.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:02 smithi081 ceph-mon[28640]: pgmap v979: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:04.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:04 smithi134 ceph-mon[31708]: pgmap v980: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:04.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:04 smithi081 ceph-mon[28640]: pgmap v980: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:04.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:04 smithi146 ceph-mon[32357]: pgmap v980: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:06.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:06 smithi134 ceph-mon[31708]: pgmap v981: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:04:06.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:06 smithi081 ceph-mon[28640]: pgmap v981: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:04:06.561 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:06 smithi146 ceph-mon[32357]: pgmap v981: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:04:08.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:08 smithi134 ceph-mon[31708]: pgmap v982: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:08.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:08 smithi081 ceph-mon[28640]: pgmap v982: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:08.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:08 smithi146 ceph-mon[32357]: pgmap v982: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:10.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:10 smithi134 ceph-mon[31708]: pgmap v983: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:10.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:10 smithi081 ceph-mon[28640]: pgmap v983: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:10.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:10 smithi146 ceph-mon[32357]: pgmap v983: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:12.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:12 smithi134 ceph-mon[31708]: pgmap v984: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:12.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:12 smithi081 ceph-mon[28640]: pgmap v984: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:12.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:12 smithi146 ceph-mon[32357]: pgmap v984: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:14.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:14 smithi134 ceph-mon[31708]: pgmap v985: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:14.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:14 smithi081 ceph-mon[28640]: pgmap v985: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:14.561 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:14 smithi146 ceph-mon[32357]: pgmap v985: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:16.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:16 smithi134 ceph-mon[31708]: pgmap v986: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:04:16.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:16 smithi081 ceph-mon[28640]: pgmap v986: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:04:16.561 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:16 smithi146 ceph-mon[32357]: pgmap v986: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:04:18.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:18 smithi134 ceph-mon[31708]: pgmap v987: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:18.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:18 smithi081 ceph-mon[28640]: pgmap v987: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:18.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:18 smithi146 ceph-mon[32357]: pgmap v987: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:20.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:20 smithi134 ceph-mon[31708]: pgmap v988: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:20.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:20 smithi081 ceph-mon[28640]: pgmap v988: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:20.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:20 smithi146 ceph-mon[32357]: pgmap v988: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:22.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:22 smithi134 ceph-mon[31708]: pgmap v989: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:22.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:22 smithi081 ceph-mon[28640]: pgmap v989: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:22.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:22 smithi146 ceph-mon[32357]: pgmap v989: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:24.334+0000 7f25f6a00640 1 -- 172.21.15.81:0/2476086306 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f25dc0b2920 msgr2=0x7f25dc0b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900026191) for more than 900000000 us, fault. 2024-05-03T17:04:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:24.334+0000 7f25f6a00640 1 --2- 172.21.15.81:0/2476086306 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f25dc0b2920 0x7f25dc0b4de0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f25e8006010 tx=0x7f25e80095f0 comp rx=0 tx=0).stop 2024-05-03T17:04:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:24.334+0000 7f25ef400640 1 -- 172.21.15.81:0/2476086306 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f25dc0b2920 msgr2=0x7f25dc0b4de0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-03T17:04:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:24.334+0000 7f25ef400640 1 --2- 172.21.15.81:0/2476086306 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f25dc0b2920 0x7f25dc0b4de0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:24.334+0000 7f25ef400640 1 --2- 172.21.15.81:0/2476086306 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f25dc0be050 0x7f25dc0c0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:24.334+0000 7f25ef400640 1 -- 172.21.15.81:0/2476086306 --> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f25dc0c0a20 con 0x7f25dc0be050 2024-05-03T17:04:24.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:24.335+0000 7f25f6a00640 1 --2- 172.21.15.81:0/2476086306 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f25dc0be050 0x7f25dc0c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:24.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:24.336+0000 7f25f6a00640 1 --2- 172.21.15.81:0/2476086306 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f25dc0be050 0x7f25dc0c0440 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f25e8000c00 tx=0x7f25e803f000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:04:24.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:24.445+0000 7f25ee000640 1 -- 172.21.15.81:0/2476086306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25d00063e0 con 0x7f25f8107070 2024-05-03T17:04:24.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:24.446+0000 7f25ef400640 1 -- 172.21.15.81:0/2476086306 <== mon.0 v2:172.21.15.81:3300/0 12 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25d00063e0 con 0x7f25f8107070 2024-05-03T17:04:24.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:24 smithi134 ceph-mon[31708]: pgmap v990: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:24.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:24 smithi081 ceph-mon[28640]: pgmap v990: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:24.548 INFO:teuthology.orchestra.run.smithi081.stderr:Error ETIMEDOUT: Connection timed out. Please check the client's permission and connection. 2024-05-03T17:04:24.561 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:24 smithi146 ceph-mon[32357]: pgmap v990: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:24.563 DEBUG:teuthology.orchestra.run:got remote process result: 110 2024-05-03T17:04:24.564 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/exec.py", line 66, in task remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi081 with status 110: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10'" 2024-05-03T17:04:24.830 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=08ba44f2d7fd446f849e62a54562ba9e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/exec.py", line 66, in task remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi081 with status 110: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10'" 2024-05-03T17:04:24.832 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-03T17:04:24.845 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-03T17:04:24.846 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T17:04:24.846 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-03T17:04:24.907 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T17:04:24.907 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-03T17:04:24.963 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-03T17:04:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T17:04:26.242 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:26 smithi081 ceph-mon[28640]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T17:04:26.242 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:26 smithi081 ceph-mon[28640]: pgmap v991: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:04:26.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:26 smithi134 ceph-mon[31708]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T17:04:26.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:26 smithi134 ceph-mon[31708]: pgmap v991: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:04:26.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:26 smithi146 ceph-mon[32357]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T17:04:26.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:26 smithi146 ceph-mon[32357]: pgmap v991: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T17:04:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.088+0000 7fc675800700 1 -- 172.21.15.81:0/1676940218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc670109460 msgr2=0x7fc670109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.088+0000 7fc675800700 1 --2- 172.21.15.81:0/1676940218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc670109460 0x7fc670109840 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc660009990 tx=0x7fc660009ca0 comp rx=0 tx=0).stop 2024-05-03T17:04:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.088+0000 7fc675800700 1 -- 172.21.15.81:0/1676940218 shutdown_connections 2024-05-03T17:04:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.088+0000 7fc675800700 1 --2- 172.21.15.81:0/1676940218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc670103d90 0x7fc6701102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.088+0000 7fc675800700 1 --2- 172.21.15.81:0/1676940218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc670109460 0x7fc670109840 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.088+0000 7fc675800700 1 --2- 172.21.15.81:0/1676940218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6701033d0 0x7fc670103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.088+0000 7fc675800700 1 -- 172.21.15.81:0/1676940218 >> 172.21.15.81:0/1676940218 conn(0x7fc6700fef20 msgr2=0x7fc670101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:04:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.089+0000 7fc675800700 1 -- 172.21.15.81:0/1676940218 shutdown_connections 2024-05-03T17:04:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.089+0000 7fc675800700 1 -- 172.21.15.81:0/1676940218 wait complete. 2024-05-03T17:04:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.090+0000 7fc675800700 1 Processor -- start 2024-05-03T17:04:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.090+0000 7fc675800700 1 -- start start 2024-05-03T17:04:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.090+0000 7fc675800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6701033d0 0x7fc6701a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.090+0000 7fc675800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc670103d90 0x7fc6701a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.090+0000 7fc675800700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc670109460 0x7fc67019b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.090+0000 7fc675800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc670113420 con 0x7fc6701033d0 2024-05-03T17:04:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.090+0000 7fc675800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc6701132a0 con 0x7fc670103d90 2024-05-03T17:04:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.090+0000 7fc675800700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc6701135a0 con 0x7fc670109460 2024-05-03T17:04:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.091+0000 7fc66fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6701033d0 0x7fc6701a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.091+0000 7fc66fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6701033d0 0x7fc6701a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41858/0 (socket says 172.21.15.81:41858) 2024-05-03T17:04:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.091+0000 7fc66fe00700 1 -- 172.21.15.81:0/2459351425 learned_addr learned my addr 172.21.15.81:0/2459351425 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T17:04:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.091+0000 7fc66f400700 1 --2- 172.21.15.81:0/2459351425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc670103d90 0x7fc6701a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.091+0000 7fc674e00700 1 --2- 172.21.15.81:0/2459351425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc670109460 0x7fc67019b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.091+0000 7fc66fe00700 1 -- 172.21.15.81:0/2459351425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc670109460 msgr2=0x7fc67019b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.091+0000 7fc66fe00700 1 --2- 172.21.15.81:0/2459351425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc670109460 0x7fc67019b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.091+0000 7fc66fe00700 1 -- 172.21.15.81:0/2459351425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc670103d90 msgr2=0x7fc6701a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.091+0000 7fc66fe00700 1 --2- 172.21.15.81:0/2459351425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc670103d90 0x7fc6701a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.091+0000 7fc66fe00700 1 -- 172.21.15.81:0/2459351425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc67019c100 con 0x7fc6701033d0 2024-05-03T17:04:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.092+0000 7fc66fe00700 1 --2- 172.21.15.81:0/2459351425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6701033d0 0x7fc6701a17e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc660000c00 tx=0x7fc6600047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:04:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.092+0000 7fc66cc00700 1 -- 172.21.15.81:0/2459351425 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660027070 con 0x7fc6701033d0 2024-05-03T17:04:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.092+0000 7fc675800700 1 -- 172.21.15.81:0/2459351425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc67019c390 con 0x7fc6701033d0 2024-05-03T17:04:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.092+0000 7fc66cc00700 1 -- 172.21.15.81:0/2459351425 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc66000fd00 con 0x7fc6701033d0 2024-05-03T17:04:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.092+0000 7fc66cc00700 1 -- 172.21.15.81:0/2459351425 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660022e20 con 0x7fc6701033d0 2024-05-03T17:04:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.092+0000 7fc675800700 1 -- 172.21.15.81:0/2459351425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6701a86b0 con 0x7fc6701033d0 2024-05-03T17:04:28.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.093+0000 7fc675800700 1 -- 172.21.15.81:0/2459351425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc67006a190 con 0x7fc6701033d0 2024-05-03T17:04:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.097+0000 7fc66cc00700 1 -- 172.21.15.81:0/2459351425 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc66002a070 con 0x7fc6701033d0 2024-05-03T17:04:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.099+0000 7fc66cc00700 1 --2- 172.21.15.81:0/2459351425 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fc6540b2910 0x7fc6540b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.099+0000 7fc66cc00700 1 -- 172.21.15.81:0/2459351425 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fc6600e3780 con 0x7fc6701033d0 2024-05-03T17:04:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.099+0000 7fc66f400700 1 --2- 172.21.15.81:0/2459351425 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fc6540b2910 0x7fc6540b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.100+0000 7fc66f400700 1 --2- 172.21.15.81:0/2459351425 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fc6540b2910 0x7fc6540b4dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc670110610 tx=0x7fc65c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:04:28.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.103+0000 7fc66cc00700 1 -- 172.21.15.81:0/2459351425 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc660013070 con 0x7fc6701033d0 2024-05-03T17:04:28.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.354+0000 7fc675800700 1 -- 172.21.15.81:0/2459351425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc6701a8880 con 0x7fc6701033d0 2024-05-03T17:04:28.356 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:28 smithi081 ceph-mon[28640]: pgmap v992: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:28.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.355+0000 7fc66cc00700 1 -- 172.21.15.81:0/2459351425 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v91) ==== 81+0+592 (secure 0 0 0) 0x7fc6600ab020 con 0x7fc6701033d0 2024-05-03T17:04:28.356 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/2734678359 2024-05-04T16:34:04.089390+0000 2024-05-03T17:04:28.357 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/2734678359 2024-05-04T16:34:04.089390+0000 2024-05-03T17:04:28.357 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2237510960 2024-05-04T16:34:04.089390+0000 2024-05-03T17:04:28.357 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/2256692598 2024-05-04T16:33:30.274051+0000 2024-05-03T17:04:28.357 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3199433706 2024-05-04T16:33:30.274051+0000 2024-05-03T17:04:28.357 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1689714816 2024-05-04T16:33:30.274051+0000 2024-05-03T17:04:28.357 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2777950369 2024-05-04T16:34:04.089390+0000 2024-05-03T17:04:28.358 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1982866220 2024-05-04T16:34:04.089390+0000 2024-05-03T17:04:28.358 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/2256692598 2024-05-04T16:33:30.274051+0000 2024-05-03T17:04:28.358 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1112375028 2024-05-04T16:33:30.274051+0000 2024-05-03T17:04:28.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.358+0000 7fc675800700 1 -- 172.21.15.81:0/2459351425 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fc6540b2910 msgr2=0x7fc6540b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:28.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.358+0000 7fc675800700 1 --2- 172.21.15.81:0/2459351425 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fc6540b2910 0x7fc6540b4dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc670110610 tx=0x7fc65c00a300 comp rx=0 tx=0).stop 2024-05-03T17:04:28.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.358+0000 7fc675800700 1 -- 172.21.15.81:0/2459351425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6701033d0 msgr2=0x7fc6701a17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:28.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.358+0000 7fc675800700 1 --2- 172.21.15.81:0/2459351425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6701033d0 0x7fc6701a17e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc660000c00 tx=0x7fc6600047b0 comp rx=0 tx=0).stop 2024-05-03T17:04:28.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.358+0000 7fc675800700 1 -- 172.21.15.81:0/2459351425 shutdown_connections 2024-05-03T17:04:28.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.358+0000 7fc675800700 1 --2- 172.21.15.81:0/2459351425 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fc6540b2910 0x7fc6540b4dd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:28.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.358+0000 7fc675800700 1 --2- 172.21.15.81:0/2459351425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc670109460 0x7fc67019b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:28.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.358+0000 7fc675800700 1 --2- 172.21.15.81:0/2459351425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6701033d0 0x7fc6701a17e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:28.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.358+0000 7fc675800700 1 --2- 172.21.15.81:0/2459351425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc670103d90 0x7fc6701a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:28.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.358+0000 7fc675800700 1 -- 172.21.15.81:0/2459351425 >> 172.21.15.81:0/2459351425 conn(0x7fc6700fef20 msgr2=0x7fc67010eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:04:28.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.358+0000 7fc675800700 1 -- 172.21.15.81:0/2459351425 shutdown_connections 2024-05-03T17:04:28.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:28.358+0000 7fc675800700 1 -- 172.21.15.81:0/2459351425 wait complete. 2024-05-03T17:04:28.360 INFO:teuthology.orchestra.run.smithi081.stderr:listed 10 entries 2024-05-03T17:04:28.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:28 smithi134 ceph-mon[31708]: pgmap v992: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:28.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:28 smithi146 ceph-mon[32357]: pgmap v992: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:29.212 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-03T17:04:29.212 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-03T17:04:29.261 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-03T17:04:29.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:29 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2459351425' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T17:04:29.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:29 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2459351425' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T17:04:29.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:29 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2459351425' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T17:04:29.729 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T17:04:30.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:30 smithi134 ceph-mon[31708]: pgmap v993: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:30.470 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:30 smithi081 ceph-mon[28640]: pgmap v993: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:30.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:30 smithi146 ceph-mon[32357]: pgmap v993: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.201+0000 7fa6fec00700 1 -- 172.21.15.81:0/2776574984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f81060a0 msgr2=0x7fa6f81125b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.201+0000 7fa6fec00700 1 --2- 172.21.15.81:0/2776574984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f81060a0 0x7fa6f81125b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa6f000b0a0 tx=0x7fa6f000b3b0 comp rx=0 tx=0).stop 2024-05-03T17:04:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.201+0000 7fa6fec00700 1 -- 172.21.15.81:0/2776574984 shutdown_connections 2024-05-03T17:04:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.201+0000 7fa6fec00700 1 --2- 172.21.15.81:0/2776574984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f81060a0 0x7fa6f81125b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.201+0000 7fa6fec00700 1 --2- 172.21.15.81:0/2776574984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6f810b6e0 0x7fa6f810bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.201+0000 7fa6fec00700 1 --2- 172.21.15.81:0/2776574984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6f81056e0 0x7fa6f8105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.201+0000 7fa6fec00700 1 -- 172.21.15.81:0/2776574984 >> 172.21.15.81:0/2776574984 conn(0x7fa6f81011d0 msgr2=0x7fa6f81035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:04:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.201+0000 7fa6fec00700 1 -- 172.21.15.81:0/2776574984 shutdown_connections 2024-05-03T17:04:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.201+0000 7fa6fec00700 1 -- 172.21.15.81:0/2776574984 wait complete. 2024-05-03T17:04:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.202+0000 7fa6fec00700 1 Processor -- start 2024-05-03T17:04:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.203+0000 7fa6fec00700 1 -- start start 2024-05-03T17:04:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.203+0000 7fa6fec00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6f81056e0 0x7fa6f81a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.203+0000 7fa6fec00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f81060a0 0x7fa6f81a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.203+0000 7fa6fec00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6f810b6e0 0x7fa6f819ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.203+0000 7fa6fec00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f8115770 con 0x7fa6f81060a0 2024-05-03T17:04:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.203+0000 7fa6fec00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f81155f0 con 0x7fa6f81056e0 2024-05-03T17:04:32.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.203+0000 7fa6fec00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f81158f0 con 0x7fa6f810b6e0 2024-05-03T17:04:32.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.203+0000 7fa6f7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f81060a0 0x7fa6f81a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:32.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.204+0000 7fa6f7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f81060a0 0x7fa6f81a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41872/0 (socket says 172.21.15.81:41872) 2024-05-03T17:04:32.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.204+0000 7fa6f7400700 1 -- 172.21.15.81:0/2254663266 learned_addr learned my addr 172.21.15.81:0/2254663266 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T17:04:32.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.204+0000 7fa6fcc00700 1 --2- 172.21.15.81:0/2254663266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6f810b6e0 0x7fa6f819ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:32.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.204+0000 7fa6f7e00700 1 --2- 172.21.15.81:0/2254663266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6f81056e0 0x7fa6f81a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:32.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.204+0000 7fa6f7400700 1 -- 172.21.15.81:0/2254663266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6f810b6e0 msgr2=0x7fa6f819ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:32.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.204+0000 7fa6f7400700 1 --2- 172.21.15.81:0/2254663266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6f810b6e0 0x7fa6f819ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:32.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.204+0000 7fa6f7400700 1 -- 172.21.15.81:0/2254663266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6f81056e0 msgr2=0x7fa6f81a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.204+0000 7fa6f7400700 1 --2- 172.21.15.81:0/2254663266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6f81056e0 0x7fa6f81a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.204+0000 7fa6f7400700 1 -- 172.21.15.81:0/2254663266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f819c1d0 con 0x7fa6f81060a0 2024-05-03T17:04:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.204+0000 7fa6f7400700 1 --2- 172.21.15.81:0/2254663266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f81060a0 0x7fa6f81a1df0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400c920 tx=0x7fa6e400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:04:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.205+0000 7fa6f4c00700 1 -- 172.21.15.81:0/2254663266 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4007b00 con 0x7fa6f81060a0 2024-05-03T17:04:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.205+0000 7fa6f4c00700 1 -- 172.21.15.81:0/2254663266 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6e4004cc0 con 0x7fa6f81060a0 2024-05-03T17:04:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.205+0000 7fa6fec00700 1 -- 172.21.15.81:0/2254663266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f819c4c0 con 0x7fa6f81060a0 2024-05-03T17:04:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.205+0000 7fa6f4c00700 1 -- 172.21.15.81:0/2254663266 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e40054f0 con 0x7fa6f81060a0 2024-05-03T17:04:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.205+0000 7fa6fec00700 1 -- 172.21.15.81:0/2254663266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f81a8780 con 0x7fa6f81060a0 2024-05-03T17:04:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.206+0000 7fa6fec00700 1 -- 172.21.15.81:0/2254663266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f806a190 con 0x7fa6f81060a0 2024-05-03T17:04:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.209+0000 7fa6f4c00700 1 -- 172.21.15.81:0/2254663266 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa6e4007ca0 con 0x7fa6f81060a0 2024-05-03T17:04:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.210+0000 7fa6f4c00700 1 --2- 172.21.15.81:0/2254663266 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa6dc0b2990 0x7fa6dc0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.211+0000 7fa6f4c00700 1 -- 172.21.15.81:0/2254663266 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fa6e40e2380 con 0x7fa6f81060a0 2024-05-03T17:04:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.211+0000 7fa6f7e00700 1 --2- 172.21.15.81:0/2254663266 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa6dc0b2990 0x7fa6dc0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.212+0000 7fa6f7e00700 1 --2- 172.21.15.81:0/2254663266 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa6dc0b2990 0x7fa6dc0b4e50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8005fd0 tx=0x7fa6e8005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:04:32.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.216+0000 7fa6f4c00700 1 -- 172.21.15.81:0/2254663266 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa6e4014030 con 0x7fa6f81060a0 2024-05-03T17:04:32.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.464+0000 7fa6fec00700 1 -- 172.21.15.81:0/2254663266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa6f802e510 con 0x7fa6f81060a0 2024-05-03T17:04:32.465 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:32 smithi081 ceph-mon[28640]: pgmap v994: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:32.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.465+0000 7fa6f4c00700 1 -- 172.21.15.81:0/2254663266 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v91) ==== 81+0+592 (secure 0 0 0) 0x7fa6e40a9b30 con 0x7fa6f81060a0 2024-05-03T17:04:32.466 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/2734678359 2024-05-04T16:34:04.089390+0000 2024-05-03T17:04:32.466 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/2734678359 2024-05-04T16:34:04.089390+0000 2024-05-03T17:04:32.466 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2237510960 2024-05-04T16:34:04.089390+0000 2024-05-03T17:04:32.467 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/2256692598 2024-05-04T16:33:30.274051+0000 2024-05-03T17:04:32.467 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3199433706 2024-05-04T16:33:30.274051+0000 2024-05-03T17:04:32.467 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1689714816 2024-05-04T16:33:30.274051+0000 2024-05-03T17:04:32.467 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2777950369 2024-05-04T16:34:04.089390+0000 2024-05-03T17:04:32.467 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1982866220 2024-05-04T16:34:04.089390+0000 2024-05-03T17:04:32.467 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/2256692598 2024-05-04T16:33:30.274051+0000 2024-05-03T17:04:32.467 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1112375028 2024-05-04T16:33:30.274051+0000 2024-05-03T17:04:32.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:32 smithi134 ceph-mon[31708]: pgmap v994: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:32.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.468+0000 7fa6fec00700 1 -- 172.21.15.81:0/2254663266 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa6dc0b2990 msgr2=0x7fa6dc0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:32.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.468+0000 7fa6fec00700 1 --2- 172.21.15.81:0/2254663266 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa6dc0b2990 0x7fa6dc0b4e50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8005fd0 tx=0x7fa6e8005db0 comp rx=0 tx=0).stop 2024-05-03T17:04:32.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.468+0000 7fa6fec00700 1 -- 172.21.15.81:0/2254663266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f81060a0 msgr2=0x7fa6f81a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:32.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.468+0000 7fa6fec00700 1 --2- 172.21.15.81:0/2254663266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f81060a0 0x7fa6f81a1df0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400c920 tx=0x7fa6e400cce0 comp rx=0 tx=0).stop 2024-05-03T17:04:32.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.469+0000 7fa6fec00700 1 -- 172.21.15.81:0/2254663266 shutdown_connections 2024-05-03T17:04:32.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.469+0000 7fa6fec00700 1 --2- 172.21.15.81:0/2254663266 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fa6dc0b2990 0x7fa6dc0b4e50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:32.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.469+0000 7fa6fec00700 1 --2- 172.21.15.81:0/2254663266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6f810b6e0 0x7fa6f819ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:32.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.469+0000 7fa6fec00700 1 --2- 172.21.15.81:0/2254663266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6f81056e0 0x7fa6f81a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:32.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.469+0000 7fa6fec00700 1 --2- 172.21.15.81:0/2254663266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f81060a0 0x7fa6f81a1df0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:32.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.469+0000 7fa6fec00700 1 -- 172.21.15.81:0/2254663266 >> 172.21.15.81:0/2254663266 conn(0x7fa6f81011d0 msgr2=0x7fa6f81018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:04:32.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.469+0000 7fa6fec00700 1 -- 172.21.15.81:0/2254663266 shutdown_connections 2024-05-03T17:04:32.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:32.469+0000 7fa6fec00700 1 -- 172.21.15.81:0/2254663266 wait complete. 2024-05-03T17:04:32.471 INFO:teuthology.orchestra.run.smithi081.stderr:listed 10 entries 2024-05-03T17:04:32.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:32 smithi146 ceph-mon[32357]: pgmap v994: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T17:04:33.334 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-05-03T17:04:33.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T17:04:33.334 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-03T17:04:33.409 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[86143]: fuse finished with error 0 and tester_r 0 2024-05-03T17:04:33.413 INFO:teuthology.orchestra.run:waiting for 300 2024-05-03T17:04:33.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:33 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2254663266' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T17:04:33.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:33 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2254663266' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T17:04:33.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:33 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2254663266' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T17:04:34.462 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:34 smithi146 ceph-mon[32357]: pgmap v995: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:34.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:34 smithi134 ceph-mon[31708]: pgmap v995: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:34.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:34 smithi081 ceph-mon[28640]: pgmap v995: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:36.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:36 smithi134 ceph-mon[31708]: pgmap v996: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-03T17:04:36.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:36 smithi081 ceph-mon[28640]: pgmap v996: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-03T17:04:36.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:36 smithi146 ceph-mon[32357]: pgmap v996: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-03T17:04:38.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:38 smithi134 ceph-mon[31708]: pgmap v997: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 12 op/s 2024-05-03T17:04:38.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:38 smithi081 ceph-mon[28640]: pgmap v997: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 12 op/s 2024-05-03T17:04:38.561 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:38 smithi146 ceph-mon[32357]: pgmap v997: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 12 op/s 2024-05-03T17:04:39.515 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-05-03T17:04:39.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T17:04:39.516 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-03T17:04:39.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T17:04:39.575 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-05-03T17:04:39.625 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-03T17:04:39.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T17:04:39.627 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T17:04:39.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T17:04:39.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-05-03T17:04:39.803 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-03T17:04:39.813 INFO:tasks.cephadm:Teardown begin 2024-05-03T17:04:39.813 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-03T17:04:39.813 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T17:04:40.240 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T17:04:40.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:40 smithi134 ceph-mon[31708]: pgmap v998: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-03T17:04:40.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:40 smithi081 ceph-mon[28640]: pgmap v998: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-03T17:04:40.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:40 smithi146 ceph-mon[32357]: pgmap v998: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-03T17:04:42.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:42 smithi134 ceph-mon[31708]: pgmap v999: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-03T17:04:42.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:42 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T17:04:42.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:42 smithi081 ceph-mon[28640]: pgmap v999: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-03T17:04:42.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:42 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T17:04:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.529+0000 7f4926e00700 1 -- 172.21.15.81:0/809236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49200758d0 msgr2=0x7f4920075cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.529+0000 7f4926e00700 1 --2- 172.21.15.81:0/809236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49200758d0 0x7f4920075cb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4914009990 tx=0x7f4914009ca0 comp rx=0 tx=0).stop 2024-05-03T17:04:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.529+0000 7f4926e00700 1 -- 172.21.15.81:0/809236007 shutdown_connections 2024-05-03T17:04:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.529+0000 7f4926e00700 1 --2- 172.21.15.81:0/809236007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f492010fc10 0x7f4920112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.529+0000 7f4926e00700 1 --2- 172.21.15.81:0/809236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49200758d0 0x7f4920075cb0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.529+0000 7f4926e00700 1 --2- 172.21.15.81:0/809236007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49200761f0 0x7f492010f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.529+0000 7f4926e00700 1 -- 172.21.15.81:0/809236007 >> 172.21.15.81:0/809236007 conn(0x7f49200fef20 msgr2=0x7f4920101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:04:42.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.530+0000 7f4926e00700 1 -- 172.21.15.81:0/809236007 shutdown_connections 2024-05-03T17:04:42.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.530+0000 7f4926e00700 1 -- 172.21.15.81:0/809236007 wait complete. 2024-05-03T17:04:42.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.531+0000 7f4926e00700 1 Processor -- start 2024-05-03T17:04:42.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.531+0000 7f4926e00700 1 -- start start 2024-05-03T17:04:42.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.531+0000 7f4926e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49200758d0 0x7f49201a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:42.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.531+0000 7f4926e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49200761f0 0x7f49201a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:42.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.531+0000 7f4926e00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f492010fc10 0x7f492019ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:42.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.531+0000 7f4926e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f49201156c0 con 0x7f49200758d0 2024-05-03T17:04:42.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.531+0000 7f4926e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4920115540 con 0x7f49200761f0 2024-05-03T17:04:42.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.531+0000 7f4926e00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4920115840 con 0x7f492010fc10 2024-05-03T17:04:42.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.532+0000 7f4925a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49200758d0 0x7f49201a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:42.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.532+0000 7f4925a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49200758d0 0x7f49201a18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42752/0 (socket says 172.21.15.81:42752) 2024-05-03T17:04:42.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.532+0000 7f4925a00700 1 -- 172.21.15.81:0/477992618 learned_addr learned my addr 172.21.15.81:0/477992618 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T17:04:42.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.532+0000 7f4926400700 1 --2- 172.21.15.81:0/477992618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f492010fc10 0x7f492019ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:42.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.532+0000 7f4925000700 1 --2- 172.21.15.81:0/477992618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49200761f0 0x7f49201a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:42.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.532+0000 7f4925a00700 1 -- 172.21.15.81:0/477992618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f492010fc10 msgr2=0x7f492019ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:42.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.532+0000 7f4925a00700 1 --2- 172.21.15.81:0/477992618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f492010fc10 0x7f492019ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:42.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.532+0000 7f4925a00700 1 -- 172.21.15.81:0/477992618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49200761f0 msgr2=0x7f49201a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:42.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.532+0000 7f4925a00700 1 --2- 172.21.15.81:0/477992618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49200761f0 0x7f49201a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:42.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.532+0000 7f4925a00700 1 -- 172.21.15.81:0/477992618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492019c1e0 con 0x7f49200758d0 2024-05-03T17:04:42.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.532+0000 7f4925000700 1 --2- 172.21.15.81:0/477992618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49200761f0 0x7f49201a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T17:04:42.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.533+0000 7f4925a00700 1 --2- 172.21.15.81:0/477992618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49200758d0 0x7f49201a18c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f49140098e0 tx=0x7f49140057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:04:42.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.533+0000 7f491e000700 1 -- 172.21.15.81:0/477992618 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4914027070 con 0x7f49200758d0 2024-05-03T17:04:42.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.533+0000 7f491e000700 1 -- 172.21.15.81:0/477992618 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4914022470 con 0x7f49200758d0 2024-05-03T17:04:42.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.533+0000 7f491e000700 1 -- 172.21.15.81:0/477992618 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4914017650 con 0x7f49200758d0 2024-05-03T17:04:42.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.533+0000 7f4926e00700 1 -- 172.21.15.81:0/477992618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f492019c470 con 0x7f49200758d0 2024-05-03T17:04:42.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.533+0000 7f4926e00700 1 -- 172.21.15.81:0/477992618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49201a8790 con 0x7f49200758d0 2024-05-03T17:04:42.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.534+0000 7f4926e00700 1 -- 172.21.15.81:0/477992618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f492006a190 con 0x7f49200758d0 2024-05-03T17:04:42.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.537+0000 7f491e000700 1 -- 172.21.15.81:0/477992618 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f491402a070 con 0x7f49200758d0 2024-05-03T17:04:42.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.539+0000 7f491e000700 1 --2- 172.21.15.81:0/477992618 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f49080b2990 0x7f49080b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:42.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.539+0000 7f491e000700 1 -- 172.21.15.81:0/477992618 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f49140e3900 con 0x7f49200758d0 2024-05-03T17:04:42.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.540+0000 7f4925000700 1 --2- 172.21.15.81:0/477992618 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f49080b2990 0x7f49080b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:42.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.540+0000 7f4925000700 1 --2- 172.21.15.81:0/477992618 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f49080b2990 0x7f49080b4e50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f49201110b0 tx=0x7f490c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:04:42.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.541+0000 7f491e000700 1 -- 172.21.15.81:0/477992618 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4914013070 con 0x7f49200758d0 2024-05-03T17:04:42.561 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:42 smithi146 ceph-mon[32357]: pgmap v999: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-03T17:04:42.561 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:42 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T17:04:42.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.825+0000 7f4926e00700 1 -- 172.21.15.81:0/477992618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f492002e510 con 0x7f49200758d0 2024-05-03T17:04:42.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.826+0000 7f491e000700 1 -- 172.21.15.81:0/477992618 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11941 (secure 0 0 0) 0x7f49140ab140 con 0x7f49200758d0 2024-05-03T17:04:42.828 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T17:04:42.828 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/886382058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":886382058},{"type":"v1","addr":"172.21.15.81:6835","nonce":886382058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3285208793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3285208793},{"type":"v1","addr":"172.21.15.81:6837","nonce":3285208793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T16:43:58.734681+0000","modified":"2024-05-03T16:49:23.957065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34466,"mds_1":34439,"mds_2":34418,"mds_3":34400,"mds_4":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3710454674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3710454674},{"type":"v1","addr":"172.21.15.81:6839","nonce":3710454674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1174252889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1174252889},{"type":"v1","addr":"172.21.15.81:6841","nonce":1174252889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1900581381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1900581381},{"type":"v1","addr":"172.21.15.146:6833","nonce":1900581381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/3514751933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3514751933},{"type":"v1","addr":"172.21.15.146:6835","nonce":3514751933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6837/971814714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":971814714},{"type":"v1","addr":"172.21.15.146:6837","nonce":971814714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":32,"addr":"172.21.15.146:6839/3770312555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":3770312555},{"type":"v1","addr":"172.21.15.146:6839","nonce":3770312555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34400":{"gid":34400,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.134:6833/749392804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":749392804},{"type":"v1","addr":"172.21.15.134:6833","nonce":749392804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34418":{"gid":34418,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.134:6835/3681203129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3681203129},{"type":"v1","addr":"172.21.15.134:6835","nonce":3681203129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34439":{"gid":34439,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.134:6837/2915415754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2915415754},{"type":"v1","addr":"172.21.15.134:6837","nonce":2915415754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34466":{"gid":34466,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2061491127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2061491127},{"type":"v1","addr":"172.21.15.134:6839","nonce":2061491127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34466,"qdb_cluster":[34418,34439,34466,24481,34400]},"id":1}]} 2024-05-03T17:04:42.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.830+0000 7f4926e00700 1 -- 172.21.15.81:0/477992618 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f49080b2990 msgr2=0x7f49080b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:42.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.830+0000 7f4926e00700 1 --2- 172.21.15.81:0/477992618 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f49080b2990 0x7f49080b4e50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f49201110b0 tx=0x7f490c009260 comp rx=0 tx=0).stop 2024-05-03T17:04:42.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.830+0000 7f4926e00700 1 -- 172.21.15.81:0/477992618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49200758d0 msgr2=0x7f49201a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:42.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.830+0000 7f4926e00700 1 --2- 172.21.15.81:0/477992618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49200758d0 0x7f49201a18c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f49140098e0 tx=0x7f49140057c0 comp rx=0 tx=0).stop 2024-05-03T17:04:42.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.831+0000 7f4926e00700 1 -- 172.21.15.81:0/477992618 shutdown_connections 2024-05-03T17:04:42.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.831+0000 7f4926e00700 1 --2- 172.21.15.81:0/477992618 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f49080b2990 0x7f49080b4e50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:42.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.831+0000 7f4926e00700 1 --2- 172.21.15.81:0/477992618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f492010fc10 0x7f492019ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:42.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.831+0000 7f4926e00700 1 --2- 172.21.15.81:0/477992618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49200758d0 0x7f49201a18c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:42.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.831+0000 7f4926e00700 1 --2- 172.21.15.81:0/477992618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49200761f0 0x7f49201a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:42.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.831+0000 7f4926e00700 1 -- 172.21.15.81:0/477992618 >> 172.21.15.81:0/477992618 conn(0x7f49200fef20 msgr2=0x7f49200ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:04:42.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.831+0000 7f4926e00700 1 -- 172.21.15.81:0/477992618 shutdown_connections 2024-05-03T17:04:42.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:42.831+0000 7f4926e00700 1 -- 172.21.15.81:0/477992618 wait complete. 2024-05-03T17:04:42.833 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 30 2024-05-03T17:04:43.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:43 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/477992618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T17:04:43.561 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:43 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/477992618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T17:04:43.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:43 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/477992618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T17:04:43.759 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T17:04:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T17:04:44.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:44 smithi081 ceph-mon[28640]: pgmap v1000: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-03T17:04:44.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:04:44.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:04:44.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:04:44.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:04:44.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T17:04:44.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T17:04:44.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:44 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:04:44.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:44 smithi146 ceph-mon[32357]: pgmap v1000: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-03T17:04:44.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:04:44.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:04:44.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:04:44.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:04:44.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T17:04:44.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T17:04:44.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:44 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:04:44.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:44 smithi134 ceph-mon[31708]: pgmap v1000: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-03T17:04:44.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:04:44.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:04:44.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:04:44.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:04:44.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T17:04:44.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T17:04:44.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:44 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' 2024-05-03T17:04:46.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:46 smithi081 ceph-mon[28640]: pgmap v1001: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-03T17:04:46.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.530+0000 7f432b600700 1 -- 172.21.15.81:0/356360812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4324109ad0 msgr2=0x7f4324109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:46.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.530+0000 7f432b600700 1 --2- 172.21.15.81:0/356360812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4324109ad0 0x7f4324109f50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4310009990 tx=0x7f4310009ca0 comp rx=0 tx=0).stop 2024-05-03T17:04:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.530+0000 7f432b600700 1 -- 172.21.15.81:0/356360812 shutdown_connections 2024-05-03T17:04:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.530+0000 7f432b600700 1 --2- 172.21.15.81:0/356360812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f432410fb60 0x7f432410ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.530+0000 7f432b600700 1 --2- 172.21.15.81:0/356360812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f432410a490 0x7f43241169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.530+0000 7f432b600700 1 --2- 172.21.15.81:0/356360812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4324109ad0 0x7f4324109f50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.530+0000 7f432b600700 1 -- 172.21.15.81:0/356360812 >> 172.21.15.81:0/356360812 conn(0x7f4324076c70 msgr2=0x7f43241082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:04:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.530+0000 7f432b600700 1 -- 172.21.15.81:0/356360812 shutdown_connections 2024-05-03T17:04:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.531+0000 7f432b600700 1 -- 172.21.15.81:0/356360812 wait complete. 2024-05-03T17:04:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.531+0000 7f432b600700 1 Processor -- start 2024-05-03T17:04:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.532+0000 7f432b600700 1 -- start start 2024-05-03T17:04:46.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.532+0000 7f432b600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4324109ad0 0x7f43241a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:46.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.532+0000 7f432b600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f432410a490 0x7f43241a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:46.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.532+0000 7f432b600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f432410fb60 0x7f43241a49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:46.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.532+0000 7f432b600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4324119bd0 con 0x7f4324109ad0 2024-05-03T17:04:46.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.532+0000 7f432b600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4324119a50 con 0x7f432410fb60 2024-05-03T17:04:46.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.532+0000 7f432b600700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4324119d50 con 0x7f432410a490 2024-05-03T17:04:46.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.532+0000 7f4328c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4324109ad0 0x7f43241a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:46.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.533+0000 7f4328c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4324109ad0 0x7f43241a0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50068/0 (socket says 172.21.15.81:50068) 2024-05-03T17:04:46.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.533+0000 7f4328c00700 1 -- 172.21.15.81:0/2938822287 learned_addr learned my addr 172.21.15.81:0/2938822287 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T17:04:46.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.533+0000 7f4323e00700 1 --2- 172.21.15.81:0/2938822287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f432410a490 0x7f43241a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:46.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.533+0000 7f4329600700 1 --2- 172.21.15.81:0/2938822287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f432410fb60 0x7f43241a49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:46.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.533+0000 7f4328c00700 1 -- 172.21.15.81:0/2938822287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f432410a490 msgr2=0x7f43241a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:46.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.533+0000 7f4328c00700 1 --2- 172.21.15.81:0/2938822287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f432410a490 0x7f43241a0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:46.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.533+0000 7f4328c00700 1 -- 172.21.15.81:0/2938822287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f432410fb60 msgr2=0x7f43241a49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:46.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.533+0000 7f4328c00700 1 --2- 172.21.15.81:0/2938822287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f432410fb60 0x7f43241a49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:46.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.533+0000 7f4328c00700 1 -- 172.21.15.81:0/2938822287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43241a5110 con 0x7f4324109ad0 2024-05-03T17:04:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.533+0000 7f4328c00700 1 --2- 172.21.15.81:0/2938822287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4324109ad0 0x7f43241a0100 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f431800d950 tx=0x7f431800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:04:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.534+0000 7f4321600700 1 -- 172.21.15.81:0/2938822287 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4318016070 con 0x7f4324109ad0 2024-05-03T17:04:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.534+0000 7f4321600700 1 -- 172.21.15.81:0/2938822287 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4318010460 con 0x7f4324109ad0 2024-05-03T17:04:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.534+0000 7f4321600700 1 -- 172.21.15.81:0/2938822287 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431800f620 con 0x7f4324109ad0 2024-05-03T17:04:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.534+0000 7f432b600700 1 -- 172.21.15.81:0/2938822287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43241a5400 con 0x7f4324109ad0 2024-05-03T17:04:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.534+0000 7f432b600700 1 -- 172.21.15.81:0/2938822287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43241acc80 con 0x7f4324109ad0 2024-05-03T17:04:46.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.535+0000 7f432b600700 1 -- 172.21.15.81:0/2938822287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f432406a190 con 0x7f4324109ad0 2024-05-03T17:04:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.539+0000 7f4321600700 1 -- 172.21.15.81:0/2938822287 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f4318019070 con 0x7f4324109ad0 2024-05-03T17:04:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.540+0000 7f4321600700 1 --2- 172.21.15.81:0/2938822287 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f430c0b2990 0x7f430c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.541+0000 7f4321600700 1 -- 172.21.15.81:0/2938822287 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f43180e22e0 con 0x7f4324109ad0 2024-05-03T17:04:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.541+0000 7f4323e00700 1 --2- 172.21.15.81:0/2938822287 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f430c0b2990 0x7f430c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:46.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.541+0000 7f4323e00700 1 --2- 172.21.15.81:0/2938822287 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f430c0b2990 0x7f430c0b4e50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f431000b5c0 tx=0x7f431001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:04:46.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.543+0000 7f4321600700 1 -- 172.21.15.81:0/2938822287 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f43180a9a90 con 0x7f4324109ad0 2024-05-03T17:04:46.561 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:46 smithi146 ceph-mon[32357]: pgmap v1001: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-03T17:04:46.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:46 smithi134 ceph-mon[31708]: pgmap v1001: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-03T17:04:46.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.827+0000 7f432b600700 1 -- 172.21.15.81:0/2938822287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f432402e510 con 0x7f4324109ad0 2024-05-03T17:04:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.829+0000 7f4321600700 1 -- 172.21.15.81:0/2938822287 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11941 (secure 0 0 0) 0x7f43180a9390 con 0x7f4324109ad0 2024-05-03T17:04:46.830 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T17:04:46.830 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/886382058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":886382058},{"type":"v1","addr":"172.21.15.81:6835","nonce":886382058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3285208793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3285208793},{"type":"v1","addr":"172.21.15.81:6837","nonce":3285208793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T16:43:58.734681+0000","modified":"2024-05-03T16:49:23.957065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34466,"mds_1":34439,"mds_2":34418,"mds_3":34400,"mds_4":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3710454674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3710454674},{"type":"v1","addr":"172.21.15.81:6839","nonce":3710454674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1174252889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1174252889},{"type":"v1","addr":"172.21.15.81:6841","nonce":1174252889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1900581381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1900581381},{"type":"v1","addr":"172.21.15.146:6833","nonce":1900581381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/3514751933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3514751933},{"type":"v1","addr":"172.21.15.146:6835","nonce":3514751933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6837/971814714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":971814714},{"type":"v1","addr":"172.21.15.146:6837","nonce":971814714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":32,"addr":"172.21.15.146:6839/3770312555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":3770312555},{"type":"v1","addr":"172.21.15.146:6839","nonce":3770312555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34400":{"gid":34400,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.134:6833/749392804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":749392804},{"type":"v1","addr":"172.21.15.134:6833","nonce":749392804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34418":{"gid":34418,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.134:6835/3681203129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":3681203129},{"type":"v1","addr":"172.21.15.134:6835","nonce":3681203129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34439":{"gid":34439,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.134:6837/2915415754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2915415754},{"type":"v1","addr":"172.21.15.134:6837","nonce":2915415754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34466":{"gid":34466,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6839/2061491127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":2061491127},{"type":"v1","addr":"172.21.15.134:6839","nonce":2061491127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34466,"qdb_cluster":[34418,34439,34466,24481,34400]},"id":1}]} 2024-05-03T17:04:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.832+0000 7f432b600700 1 -- 172.21.15.81:0/2938822287 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f430c0b2990 msgr2=0x7f430c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.832+0000 7f432b600700 1 --2- 172.21.15.81:0/2938822287 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f430c0b2990 0x7f430c0b4e50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f431000b5c0 tx=0x7f431001a040 comp rx=0 tx=0).stop 2024-05-03T17:04:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.832+0000 7f432b600700 1 -- 172.21.15.81:0/2938822287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4324109ad0 msgr2=0x7f43241a0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.832+0000 7f432b600700 1 --2- 172.21.15.81:0/2938822287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4324109ad0 0x7f43241a0100 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f431800d950 tx=0x7f431800dd10 comp rx=0 tx=0).stop 2024-05-03T17:04:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.832+0000 7f432b600700 1 -- 172.21.15.81:0/2938822287 shutdown_connections 2024-05-03T17:04:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.832+0000 7f432b600700 1 --2- 172.21.15.81:0/2938822287 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f430c0b2990 0x7f430c0b4e50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.832+0000 7f432b600700 1 --2- 172.21.15.81:0/2938822287 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f432410fb60 0x7f43241a49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.832+0000 7f432b600700 1 --2- 172.21.15.81:0/2938822287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4324109ad0 0x7f43241a0100 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.832+0000 7f432b600700 1 --2- 172.21.15.81:0/2938822287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f432410a490 0x7f43241a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.832+0000 7f432b600700 1 -- 172.21.15.81:0/2938822287 >> 172.21.15.81:0/2938822287 conn(0x7f4324076c70 msgr2=0x7f4324077330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:04:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.832+0000 7f432b600700 1 -- 172.21.15.81:0/2938822287 shutdown_connections 2024-05-03T17:04:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:46.832+0000 7f432b600700 1 -- 172.21.15.81:0/2938822287 wait complete. 2024-05-03T17:04:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 30 2024-05-03T17:04:47.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:47 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2938822287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T17:04:47.595 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:47 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2938822287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T17:04:47.650 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T17:04:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:47 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2938822287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T17:04:48.107 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T17:04:48.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:48 smithi146 ceph-mon[32357]: pgmap v1002: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 852 B/s wr, 12 op/s 2024-05-03T17:04:48.616 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:48 smithi081 ceph-mon[28640]: pgmap v1002: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 852 B/s wr, 12 op/s 2024-05-03T17:04:48.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:48 smithi134 ceph-mon[31708]: pgmap v1002: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 852 B/s wr, 12 op/s 2024-05-03T17:04:50.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.469+0000 7fe0ece00700 1 -- 172.21.15.81:0/4029691207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e806b180 msgr2=0x7fe0e806b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:50.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.469+0000 7fe0ece00700 1 --2- 172.21.15.81:0/4029691207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e806b180 0x7fe0e806b600 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009990 tx=0x7fe0d4009ca0 comp rx=0 tx=0).stop 2024-05-03T17:04:50.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.470+0000 7fe0ece00700 1 -- 172.21.15.81:0/4029691207 shutdown_connections 2024-05-03T17:04:50.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.470+0000 7fe0ece00700 1 --2- 172.21.15.81:0/4029691207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0e8109510 0x7fe0e81098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:50.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.470+0000 7fe0ece00700 1 --2- 172.21.15.81:0/4029691207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0e806bb40 0x7fe0e8110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:50.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.470+0000 7fe0ece00700 1 --2- 172.21.15.81:0/4029691207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e806b180 0x7fe0e806b600 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:50.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.470+0000 7fe0ece00700 1 -- 172.21.15.81:0/4029691207 >> 172.21.15.81:0/4029691207 conn(0x7fe0e8079350 msgr2=0x7fe0e8079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:04:50.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.470+0000 7fe0ece00700 1 -- 172.21.15.81:0/4029691207 shutdown_connections 2024-05-03T17:04:50.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.470+0000 7fe0ece00700 1 -- 172.21.15.81:0/4029691207 wait complete. 2024-05-03T17:04:50.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.471+0000 7fe0ece00700 1 Processor -- start 2024-05-03T17:04:50.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.471+0000 7fe0ece00700 1 -- start start 2024-05-03T17:04:50.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.472+0000 7fe0ece00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0e806b180 0x7fe0e8102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:50.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.472+0000 7fe0ece00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0e806bb40 0x7fe0e81029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:50.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.472+0000 7fe0ece00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e8109510 0x7fe0e8102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:50.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.472+0000 7fe0ece00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e8113540 con 0x7fe0e8109510 2024-05-03T17:04:50.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.472+0000 7fe0ece00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e81133c0 con 0x7fe0e806b180 2024-05-03T17:04:50.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.472+0000 7fe0ece00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e81136c0 con 0x7fe0e806bb40 2024-05-03T17:04:50.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.472+0000 7fe0e6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e8109510 0x7fe0e8102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:50.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.472+0000 7fe0e6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e8109510 0x7fe0e8102ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50090/0 (socket says 172.21.15.81:50090) 2024-05-03T17:04:50.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.472+0000 7fe0e6800700 1 -- 172.21.15.81:0/1122038915 learned_addr learned my addr 172.21.15.81:0/1122038915 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T17:04:50.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.472+0000 7fe0e5400700 1 --2- 172.21.15.81:0/1122038915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0e806bb40 0x7fe0e81029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:50.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.473+0000 7fe0e5e00700 1 --2- 172.21.15.81:0/1122038915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0e806b180 0x7fe0e8102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:50.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.473+0000 7fe0e6800700 1 -- 172.21.15.81:0/1122038915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0e806bb40 msgr2=0x7fe0e81029b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:50.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.473+0000 7fe0e6800700 1 --2- 172.21.15.81:0/1122038915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0e806bb40 0x7fe0e81029b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:50.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.473+0000 7fe0e6800700 1 -- 172.21.15.81:0/1122038915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0e806b180 msgr2=0x7fe0e8102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:50.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.473+0000 7fe0e6800700 1 --2- 172.21.15.81:0/1122038915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0e806b180 0x7fe0e8102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:50.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.473+0000 7fe0e6800700 1 -- 172.21.15.81:0/1122038915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e81a8060 con 0x7fe0e8109510 2024-05-03T17:04:50.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.473+0000 7fe0e5e00700 1 --2- 172.21.15.81:0/1122038915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0e806b180 0x7fe0e8102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T17:04:50.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.473+0000 7fe0e6800700 1 --2- 172.21.15.81:0/1122038915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e8109510 0x7fe0e8102ef0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000ada0 tx=0x7fe0e000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:04:50.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.473+0000 7fe0dea00700 1 -- 172.21.15.81:0/1122038915 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0017020 con 0x7fe0e8109510 2024-05-03T17:04:50.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.473+0000 7fe0dea00700 1 -- 172.21.15.81:0/1122038915 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0e000ce10 con 0x7fe0e8109510 2024-05-03T17:04:50.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.473+0000 7fe0ece00700 1 -- 172.21.15.81:0/1122038915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e81a8350 con 0x7fe0e8109510 2024-05-03T17:04:50.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.473+0000 7fe0dea00700 1 -- 172.21.15.81:0/1122038915 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0005440 con 0x7fe0e8109510 2024-05-03T17:04:50.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.473+0000 7fe0ece00700 1 -- 172.21.15.81:0/1122038915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e81a8890 con 0x7fe0e8109510 2024-05-03T17:04:50.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.475+0000 7fe0ece00700 1 -- 172.21.15.81:0/1122038915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e810b9f0 con 0x7fe0e8109510 2024-05-03T17:04:50.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.479+0000 7fe0dea00700 1 -- 172.21.15.81:0/1122038915 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe0e0004ad0 con 0x7fe0e8109510 2024-05-03T17:04:50.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.480+0000 7fe0dea00700 1 --2- 172.21.15.81:0/1122038915 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe0cc0b2990 0x7fe0cc0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:50.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.480+0000 7fe0dea00700 1 -- 172.21.15.81:0/1122038915 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fe0e00e2520 con 0x7fe0e8109510 2024-05-03T17:04:50.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.480+0000 7fe0e5e00700 1 --2- 172.21.15.81:0/1122038915 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe0cc0b2990 0x7fe0cc0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:50.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.481+0000 7fe0e5e00700 1 --2- 172.21.15.81:0/1122038915 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe0cc0b2990 0x7fe0cc0b4e50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8009b50 tx=0x7fe0d8009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:04:50.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.483+0000 7fe0dea00700 1 -- 172.21.15.81:0/1122038915 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe0e0021020 con 0x7fe0e8109510 2024-05-03T17:04:50.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:50 smithi146 ceph-mon[32357]: pgmap v1003: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-03T17:04:50.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.713+0000 7fe0ece00700 1 -- 172.21.15.81:0/1122038915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0e810b3d0 con 0x7fe0e8109510 2024-05-03T17:04:50.716 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:50 smithi081 ceph-mon[28640]: pgmap v1003: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-03T17:04:50.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:50 smithi134 ceph-mon[31708]: pgmap v1003: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-03T17:04:50.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.717+0000 7fe0dea00700 1 -- 172.21.15.81:0/1122038915 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24767 (secure 0 0 0) 0x7fe0e00a9d60 con 0x7fe0e8109510 2024-05-03T17:04:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-03T17:04:50.720 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":91,"fsid":"8988869e-096a-11ef-bc97-c7b262605968","created":"2024-05-03T16:32:56.440204+0000","modified":"2024-05-03T16:45:06.079032+0000","last_up_change":"2024-05-03T16:42:31.768974+0000","last_in_change":"2024-05-03T16:42:06.989688+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T16:37:18.271939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T16:43:50.469793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T16:43:54.708564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T16:44:09.064474+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"957b05dc-dfb9-4561-8800-b7ec0aba679d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6803","nonce":1639968055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6805","nonce":1639968055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6809","nonce":1639968055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1639968055},{"type":"v1","addr":"172.21.15.81:6807","nonce":1639968055}]},"public_addr":"172.21.15.81:6803/1639968055","cluster_addr":"172.21.15.81:6805/1639968055","heartbeat_back_addr":"172.21.15.81:6809/1639968055","heartbeat_front_addr":"172.21.15.81:6807/1639968055","state":["exists","up"]},{"osd":1,"uuid":"3bb199cd-b4d0-4c67-b98f-2106336dd57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6801","nonce":1928503491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6803","nonce":1928503491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6807","nonce":1928503491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1928503491},{"type":"v1","addr":"172.21.15.134:6805","nonce":1928503491}]},"public_addr":"172.21.15.134:6801/1928503491","cluster_addr":"172.21.15.134:6803/1928503491","heartbeat_back_addr":"172.21.15.134:6807/1928503491","heartbeat_front_addr":"172.21.15.134:6805/1928503491","state":["exists","up"]},{"osd":2,"uuid":"79ec9995-50e8-4eaf-935a-39a479925734","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6801","nonce":1233108455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6803","nonce":1233108455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6807","nonce":1233108455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":1233108455},{"type":"v1","addr":"172.21.15.146:6805","nonce":1233108455}]},"public_addr":"172.21.15.146:6801/1233108455","cluster_addr":"172.21.15.146:6803/1233108455","heartbeat_back_addr":"172.21.15.146:6807/1233108455","heartbeat_front_addr":"172.21.15.146:6805/1233108455","state":["exists","up"]},{"osd":3,"uuid":"2d38f4e7-73c3-4e70-9f87-d44da28db452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6811","nonce":4128709465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6813","nonce":4128709465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6817","nonce":4128709465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4128709465},{"type":"v1","addr":"172.21.15.81:6815","nonce":4128709465}]},"public_addr":"172.21.15.81:6811/4128709465","cluster_addr":"172.21.15.81:6813/4128709465","heartbeat_back_addr":"172.21.15.81:6817/4128709465","heartbeat_front_addr":"172.21.15.81:6815/4128709465","state":["exists","up"]},{"osd":4,"uuid":"3837a136-a25b-4cb9-aa82-084b477c67d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6809","nonce":1498616220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6811","nonce":1498616220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6815","nonce":1498616220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1498616220},{"type":"v1","addr":"172.21.15.134:6813","nonce":1498616220}]},"public_addr":"172.21.15.134:6809/1498616220","cluster_addr":"172.21.15.134:6811/1498616220","heartbeat_back_addr":"172.21.15.134:6815/1498616220","heartbeat_front_addr":"172.21.15.134:6813/1498616220","state":["exists","up"]},{"osd":5,"uuid":"2e783d2e-c181-41a9-97de-f17705a201bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6809","nonce":1276988922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6811","nonce":1276988922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6815","nonce":1276988922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1276988922},{"type":"v1","addr":"172.21.15.146:6813","nonce":1276988922}]},"public_addr":"172.21.15.146:6809/1276988922","cluster_addr":"172.21.15.146:6811/1276988922","heartbeat_back_addr":"172.21.15.146:6815/1276988922","heartbeat_front_addr":"172.21.15.146:6813/1276988922","state":["exists","up"]},{"osd":6,"uuid":"6faebdbf-7820-42e5-b07c-15db11f278dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6819","nonce":3319125020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6821","nonce":3319125020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6825","nonce":3319125020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3319125020},{"type":"v1","addr":"172.21.15.81:6823","nonce":3319125020}]},"public_addr":"172.21.15.81:6819/3319125020","cluster_addr":"172.21.15.81:6821/3319125020","heartbeat_back_addr":"172.21.15.81:6825/3319125020","heartbeat_front_addr":"172.21.15.81:6823/3319125020","state":["exists","up"]},{"osd":7,"uuid":"ec4b6b84-6c5f-4d07-a747-06610b2cd345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6817","nonce":3241993481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6819","nonce":3241993481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6823","nonce":3241993481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3241993481},{"type":"v1","addr":"172.21.15.134:6821","nonce":3241993481}]},"public_addr":"172.21.15.134:6817/3241993481","cluster_addr":"172.21.15.134:6819/3241993481","heartbeat_back_addr":"172.21.15.134:6823/3241993481","heartbeat_front_addr":"172.21.15.134:6821/3241993481","state":["exists","up"]},{"osd":8,"uuid":"02b1b0fd-837c-4c29-bedb-54fa2ee7531d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6817","nonce":2423161684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6819","nonce":2423161684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6823","nonce":2423161684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2423161684},{"type":"v1","addr":"172.21.15.146:6821","nonce":2423161684}]},"public_addr":"172.21.15.146:6817/2423161684","cluster_addr":"172.21.15.146:6819/2423161684","heartbeat_back_addr":"172.21.15.146:6823/2423161684","heartbeat_front_addr":"172.21.15.146:6821/2423161684","state":["exists","up"]},{"osd":9,"uuid":"46713a8e-743d-44d5-babe-c01d3179afcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6827","nonce":873909886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6829","nonce":873909886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6833","nonce":873909886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":873909886},{"type":"v1","addr":"172.21.15.81:6831","nonce":873909886}]},"public_addr":"172.21.15.81:6827/873909886","cluster_addr":"172.21.15.81:6829/873909886","heartbeat_back_addr":"172.21.15.81:6833/873909886","heartbeat_front_addr":"172.21.15.81:6831/873909886","state":["exists","up"]},{"osd":10,"uuid":"12fcae89-30af-436b-a513-3998303da93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6825","nonce":1183629038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6827","nonce":1183629038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6831","nonce":1183629038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1183629038},{"type":"v1","addr":"172.21.15.134:6829","nonce":1183629038}]},"public_addr":"172.21.15.134:6825/1183629038","cluster_addr":"172.21.15.134:6827/1183629038","heartbeat_back_addr":"172.21.15.134:6831/1183629038","heartbeat_front_addr":"172.21.15.134:6829/1183629038","state":["exists","up"]},{"osd":11,"uuid":"a543f42c-61da-4a93-b16b-a2891a4ef873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6825","nonce":2627233639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6827","nonce":2627233639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6831","nonce":2627233639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2627233639},{"type":"v1","addr":"172.21.15.146:6829","nonce":2627233639}]},"public_addr":"172.21.15.146:6825/2627233639","cluster_addr":"172.21.15.146:6827/2627233639","heartbeat_back_addr":"172.21.15.146:6831/2627233639","heartbeat_front_addr":"172.21.15.146:6829/2627233639","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:08.411954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:36:41.459869+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:15.068172+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:37:49.711273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:23.231811+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:38:57.917964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:39:32.982397+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:07.434610+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:40:43.606108+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:19.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:41:54.917284+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T16:42:30.525217+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6801/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2734678359":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/2237510960":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6801/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/3199433706":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1689714816":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/2777950369":"2024-05-04T16:34:04.089390+0000","172.21.15.81:0/1982866220":"2024-05-04T16:34:04.089390+0000","172.21.15.81:6800/2256692598":"2024-05-04T16:33:30.274051+0000","172.21.15.81:0/1112375028":"2024-05-04T16:33:30.274051+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T17:04:50.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.721+0000 7fe0ece00700 1 -- 172.21.15.81:0/1122038915 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe0cc0b2990 msgr2=0x7fe0cc0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:50.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.721+0000 7fe0ece00700 1 --2- 172.21.15.81:0/1122038915 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe0cc0b2990 0x7fe0cc0b4e50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8009b50 tx=0x7fe0d8009550 comp rx=0 tx=0).stop 2024-05-03T17:04:50.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.721+0000 7fe0ece00700 1 -- 172.21.15.81:0/1122038915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e8109510 msgr2=0x7fe0e8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:50.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.721+0000 7fe0ece00700 1 --2- 172.21.15.81:0/1122038915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e8109510 0x7fe0e8102ef0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000ada0 tx=0x7fe0e000c330 comp rx=0 tx=0).stop 2024-05-03T17:04:50.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.722+0000 7fe0ece00700 1 -- 172.21.15.81:0/1122038915 shutdown_connections 2024-05-03T17:04:50.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.722+0000 7fe0ece00700 1 --2- 172.21.15.81:0/1122038915 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fe0cc0b2990 0x7fe0cc0b4e50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:50.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.722+0000 7fe0ece00700 1 --2- 172.21.15.81:0/1122038915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e8109510 0x7fe0e8102ef0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:50.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.722+0000 7fe0ece00700 1 --2- 172.21.15.81:0/1122038915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0e806b180 0x7fe0e8102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:50.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.722+0000 7fe0ece00700 1 --2- 172.21.15.81:0/1122038915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0e806bb40 0x7fe0e81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:50.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.722+0000 7fe0ece00700 1 -- 172.21.15.81:0/1122038915 >> 172.21.15.81:0/1122038915 conn(0x7fe0e8079350 msgr2=0x7fe0e8101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:04:50.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.722+0000 7fe0ece00700 1 -- 172.21.15.81:0/1122038915 shutdown_connections 2024-05-03T17:04:50.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:50.722+0000 7fe0ece00700 1 -- 172.21.15.81:0/1122038915 wait complete. 2024-05-03T17:04:51.560 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:51 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/1122038915' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T17:04:51.561 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:51 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/1122038915' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T17:04:51.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs fail cephfs 2024-05-03T17:04:51.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:51 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/1122038915' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T17:04:52.022 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T17:04:52.424 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:52 smithi081 ceph-mon[28640]: pgmap v1004: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T17:04:52.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:52 smithi146 ceph-mon[32357]: pgmap v1004: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T17:04:52.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:52 smithi134 ceph-mon[31708]: pgmap v1004: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T17:04:54.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.364+0000 7fbbb6800700 1 -- 172.21.15.81:0/3302598377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb0109ad0 msgr2=0x7fbbb0109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.364+0000 7fbbb6800700 1 --2- 172.21.15.81:0/3302598377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb0109ad0 0x7fbbb0109f50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c009990 tx=0x7fbb9c009ca0 comp rx=0 tx=0).stop 2024-05-03T17:04:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.364+0000 7fbbb6800700 1 -- 172.21.15.81:0/3302598377 shutdown_connections 2024-05-03T17:04:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.364+0000 7fbbb6800700 1 --2- 172.21.15.81:0/3302598377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbb010fb60 0x7fbbb010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.364+0000 7fbbb6800700 1 --2- 172.21.15.81:0/3302598377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb010a490 0x7fbbb01169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.364+0000 7fbbb6800700 1 --2- 172.21.15.81:0/3302598377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb0109ad0 0x7fbbb0109f50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.364+0000 7fbbb6800700 1 -- 172.21.15.81:0/3302598377 >> 172.21.15.81:0/3302598377 conn(0x7fbbb0076c70 msgr2=0x7fbbb01082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:04:54.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.364+0000 7fbbb6800700 1 -- 172.21.15.81:0/3302598377 shutdown_connections 2024-05-03T17:04:54.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.364+0000 7fbbb6800700 1 -- 172.21.15.81:0/3302598377 wait complete. 2024-05-03T17:04:54.368 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:54 smithi081 ceph-mon[28640]: pgmap v1005: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:54.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.365+0000 7fbbb6800700 1 Processor -- start 2024-05-03T17:04:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.365+0000 7fbbb6800700 1 -- start start 2024-05-03T17:04:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.366+0000 7fbbb6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb0109ad0 0x7fbbb01a0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.366+0000 7fbbb6800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb010a490 0x7fbbb01a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.366+0000 7fbbb6800700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbb010fb60 0x7fbbb01a4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.366+0000 7fbbb6800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb0119b80 con 0x7fbbb0109ad0 2024-05-03T17:04:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.366+0000 7fbbb6800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb0119a00 con 0x7fbbb010a490 2024-05-03T17:04:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.366+0000 7fbbb6800700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb0119d00 con 0x7fbbb010fb60 2024-05-03T17:04:54.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.366+0000 7fbbaf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb0109ad0 0x7fbbb01a0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:54.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.366+0000 7fbbaf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb0109ad0 0x7fbbb01a0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50112/0 (socket says 172.21.15.81:50112) 2024-05-03T17:04:54.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.366+0000 7fbbaf400700 1 -- 172.21.15.81:0/3446056680 learned_addr learned my addr 172.21.15.81:0/3446056680 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T17:04:54.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.366+0000 7fbbaea00700 1 --2- 172.21.15.81:0/3446056680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb010a490 0x7fbbb01a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:54.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.366+0000 7fbbafe00700 1 --2- 172.21.15.81:0/3446056680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbb010fb60 0x7fbbb01a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:54.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.366+0000 7fbbaf400700 1 -- 172.21.15.81:0/3446056680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbb010fb60 msgr2=0x7fbbb01a4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:54.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.366+0000 7fbbaf400700 1 --2- 172.21.15.81:0/3446056680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbb010fb60 0x7fbbb01a4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:54.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.366+0000 7fbbaf400700 1 -- 172.21.15.81:0/3446056680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb010a490 msgr2=0x7fbbb01a05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:54.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.366+0000 7fbbaf400700 1 --2- 172.21.15.81:0/3446056680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb010a490 0x7fbbb01a05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:54.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.366+0000 7fbbaf400700 1 -- 172.21.15.81:0/3446056680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb01a5080 con 0x7fbbb0109ad0 2024-05-03T17:04:54.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.367+0000 7fbbafe00700 1 --2- 172.21.15.81:0/3446056680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbb010fb60 0x7fbbb01a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T17:04:54.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.367+0000 7fbbaf400700 1 --2- 172.21.15.81:0/3446056680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb0109ad0 0x7fbbb01a0070 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbba000d980 tx=0x7fbba000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:04:54.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.367+0000 7fbba7e00700 1 -- 172.21.15.81:0/3446056680 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0016070 con 0x7fbbb0109ad0 2024-05-03T17:04:54.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.367+0000 7fbbb6800700 1 -- 172.21.15.81:0/3446056680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb01a5370 con 0x7fbbb0109ad0 2024-05-03T17:04:54.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.367+0000 7fbba7e00700 1 -- 172.21.15.81:0/3446056680 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbba0004020 con 0x7fbbb0109ad0 2024-05-03T17:04:54.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.367+0000 7fbba7e00700 1 -- 172.21.15.81:0/3446056680 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0004b90 con 0x7fbbb0109ad0 2024-05-03T17:04:54.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.367+0000 7fbbb6800700 1 -- 172.21.15.81:0/3446056680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb01acbf0 con 0x7fbbb0109ad0 2024-05-03T17:04:54.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.369+0000 7fbbb6800700 1 -- 172.21.15.81:0/3446056680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbb006a190 con 0x7fbbb0109ad0 2024-05-03T17:04:54.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.371+0000 7fbba7e00700 1 -- 172.21.15.81:0/3446056680 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fbba000bb60 con 0x7fbbb0109ad0 2024-05-03T17:04:54.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.372+0000 7fbba7e00700 1 --2- 172.21.15.81:0/3446056680 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fbb940b2910 0x7fbb940b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:54.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.373+0000 7fbba7e00700 1 -- 172.21.15.81:0/3446056680 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fbba00e2ac0 con 0x7fbbb0109ad0 2024-05-03T17:04:54.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.373+0000 7fbbaea00700 1 --2- 172.21.15.81:0/3446056680 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fbb940b2910 0x7fbb940b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:54.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.374+0000 7fbbaea00700 1 --2- 172.21.15.81:0/3446056680 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fbb940b2910 0x7fbb940b4dd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c005850 tx=0x7fbb9c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:04:54.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.377+0000 7fbba7e00700 1 -- 172.21.15.81:0/3446056680 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fbba001f020 con 0x7fbbb0109ad0 2024-05-03T17:04:54.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:54 smithi146 ceph-mon[32357]: pgmap v1005: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:54.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.656+0000 7fbbb6800700 1 -- 172.21.15.81:0/3446056680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbbb002e510 con 0x7fbbb0109ad0 2024-05-03T17:04:54.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.663+0000 7fbba7e00700 1 -- 172.21.15.81:0/3446056680 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) ==== 161+0+0 (secure 0 0 0) 0x7fbba00cae20 con 0x7fbbb0109ad0 2024-05-03T17:04:54.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.668+0000 7fbbb6800700 1 -- 172.21.15.81:0/3446056680 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fbb940b2910 msgr2=0x7fbb940b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:54.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.668+0000 7fbbb6800700 1 --2- 172.21.15.81:0/3446056680 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fbb940b2910 0x7fbb940b4dd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c005850 tx=0x7fbb9c01a040 comp rx=0 tx=0).stop 2024-05-03T17:04:54.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.668+0000 7fbbb6800700 1 -- 172.21.15.81:0/3446056680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb0109ad0 msgr2=0x7fbbb01a0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:54.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.668+0000 7fbbb6800700 1 --2- 172.21.15.81:0/3446056680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb0109ad0 0x7fbbb01a0070 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbba000d980 tx=0x7fbba000dd40 comp rx=0 tx=0).stop 2024-05-03T17:04:54.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.668+0000 7fbbb6800700 1 -- 172.21.15.81:0/3446056680 shutdown_connections 2024-05-03T17:04:54.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.669+0000 7fbbb6800700 1 --2- 172.21.15.81:0/3446056680 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fbb940b2910 0x7fbb940b4dd0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:54.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.669+0000 7fbbb6800700 1 --2- 172.21.15.81:0/3446056680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbb010fb60 0x7fbbb01a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:54.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.669+0000 7fbbb6800700 1 --2- 172.21.15.81:0/3446056680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb0109ad0 0x7fbbb01a0070 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:54.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.669+0000 7fbbb6800700 1 --2- 172.21.15.81:0/3446056680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb010a490 0x7fbbb01a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:54.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.669+0000 7fbbb6800700 1 -- 172.21.15.81:0/3446056680 >> 172.21.15.81:0/3446056680 conn(0x7fbbb0076c70 msgr2=0x7fbbb0077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:04:54.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.669+0000 7fbbb6800700 1 -- 172.21.15.81:0/3446056680 shutdown_connections 2024-05-03T17:04:54.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:54.669+0000 7fbbb6800700 1 -- 172.21.15.81:0/3446056680 wait complete. 2024-05-03T17:04:54.673 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-03T17:04:54.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:54 smithi134 ceph-mon[31708]: pgmap v1005: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T17:04:54.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-a[28636]: 2024-05-03T17:04:54.659+0000 7fe38c200700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-03T17:04:54.991 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 17:04:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-a[68361]: ignoring --setuser ceph since I am not root 2024-05-03T17:04:54.991 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 17:04:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-a[68361]: ignoring --setgroup ceph since I am not root 2024-05-03T17:04:54.991 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 17:04:54 smithi081 ceph-mds[68370]: -- 172.21.15.81:0/201135611 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fd09b29a40 con 0x55fd09afd000 2024-05-03T17:04:54.991 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 17:04:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-a[68361]: starting mds.a at 2024-05-03T17:04:54.992 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 03 17:04:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-g[67939]: ignoring --setuser ceph since I am not root 2024-05-03T17:04:54.992 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 03 17:04:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-g[67939]: ignoring --setgroup ceph since I am not root 2024-05-03T17:04:54.992 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 03 17:04:54 smithi081 ceph-mds[67943]: -- 172.21.15.81:0/3385320402 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5634b3fa1a40 con 0x5634b3f74800 2024-05-03T17:04:54.992 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 03 17:04:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-g[67939]: starting mds.g at 2024-05-03T17:04:55.062 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 17:04:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-c[63033]: ignoring --setuser ceph since I am not root 2024-05-03T17:04:55.063 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 17:04:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-c[63033]: ignoring --setgroup ceph since I am not root 2024-05-03T17:04:55.063 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 17:04:54 smithi146 ceph-mds[63037]: -- 172.21.15.146:0/4167159258 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ec9b18da40 con 0x55ec9b160800 2024-05-03T17:04:55.063 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 17:04:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-c[63033]: starting mds.c at 2024-05-03T17:04:55.063 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 17:04:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-f[62724]: ignoring --setuser ceph since I am not root 2024-05-03T17:04:55.064 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 17:04:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-f[62724]: ignoring --setgroup ceph since I am not root 2024-05-03T17:04:55.064 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 17:04:54 smithi146 ceph-mds[62733]: -- 172.21.15.146:0/2978614415 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c7a1535a40 con 0x55c7a1508800 2024-05-03T17:04:55.064 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 17:04:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-f[62724]: starting mds.f at 2024-05-03T17:04:55.064 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 17:04:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-i[63336]: ignoring --setuser ceph since I am not root 2024-05-03T17:04:55.064 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 17:04:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-i[63336]: ignoring --setgroup ceph since I am not root 2024-05-03T17:04:55.064 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 17:04:54 smithi146 ceph-mds[63340]: -- 172.21.15.146:0/3506523954 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564e5d523a40 con 0x564e5d4f6c00 2024-05-03T17:04:55.065 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 17:04:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-i[63336]: starting mds.i at 2024-05-03T17:04:55.065 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 17:04:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-l[62403]: ignoring --setuser ceph since I am not root 2024-05-03T17:04:55.065 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 17:04:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-l[62403]: ignoring --setgroup ceph since I am not root 2024-05-03T17:04:55.065 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 17:04:54 smithi146 ceph-mds[62407]: -- 172.21.15.146:0/1556675033 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f2572404e0 con 0x55f257216800 2024-05-03T17:04:55.065 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 17:04:54 smithi146 ceph-mds[62407]: -- 172.21.15.146:0/1556675033 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f257243a40 con 0x55f257216800 2024-05-03T17:04:55.065 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 17:04:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-l[62403]: starting mds.l at 2024-05-03T17:04:55.216 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 03 17:04:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-e[61608]: ignoring --setuser ceph since I am not root 2024-05-03T17:04:55.217 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 03 17:04:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-e[61608]: ignoring --setgroup ceph since I am not root 2024-05-03T17:04:55.217 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 03 17:04:54 smithi134 ceph-mds[61612]: -- 172.21.15.134:0/470144427 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b5ceb0fa40 con 0x55b5ceae2c00 2024-05-03T17:04:55.217 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 03 17:04:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-e[61608]: starting mds.e at 2024-05-03T17:04:55.217 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 17:04:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-h[61911]: ignoring --setuser ceph since I am not root 2024-05-03T17:04:55.217 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 17:04:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-h[61911]: ignoring --setgroup ceph since I am not root 2024-05-03T17:04:55.217 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 17:04:54 smithi134 ceph-mds[61915]: -- 172.21.15.134:0/470500799 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557ca3e69a40 con 0x557ca3e3c800 2024-05-03T17:04:55.218 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 17:04:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-h[61911]: starting mds.h at 2024-05-03T17:04:55.218 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 03 17:04:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-k[61299]: ignoring --setuser ceph since I am not root 2024-05-03T17:04:55.218 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 03 17:04:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-k[61299]: ignoring --setgroup ceph since I am not root 2024-05-03T17:04:55.218 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 03 17:04:54 smithi134 ceph-mds[61305]: -- 172.21.15.134:0/1906330050 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5578b2db5a40 con 0x5578b2d88c00 2024-05-03T17:04:55.218 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 03 17:04:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-k[61299]: starting mds.k at 2024-05-03T17:04:55.219 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 17:04:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-b[62229]: ignoring --setuser ceph since I am not root 2024-05-03T17:04:55.219 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 17:04:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-b[62229]: ignoring --setgroup ceph since I am not root 2024-05-03T17:04:55.219 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 17:04:54 smithi134 ceph-mds[62234]: -- 172.21.15.134:0/1839598617 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ac01ee9a40 con 0x55ac01ebc800 2024-05-03T17:04:55.219 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 17:04:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-b[62229]: starting mds.b at 2024-05-03T17:04:55.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:55 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3446056680' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-03T17:04:55.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:55 smithi081 ceph-mon[28640]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-03T17:04:55.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:55 smithi081 ceph-mon[28640]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-03T17:04:55.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:55 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3446056680' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-03T17:04:55.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:55 smithi081 ceph-mon[28640]: osdmap e92: 12 total, 12 up, 12 in 2024-05-03T17:04:55.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:55 smithi081 ceph-mon[28640]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-03T17:04:55.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:55 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T17:04:55.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:55 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3446056680' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-03T17:04:55.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:55 smithi146 ceph-mon[32357]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-03T17:04:55.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:55 smithi146 ceph-mon[32357]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-03T17:04:55.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:55 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3446056680' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-03T17:04:55.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:55 smithi146 ceph-mon[32357]: osdmap e92: 12 total, 12 up, 12 in 2024-05-03T17:04:55.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:55 smithi146 ceph-mon[32357]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-03T17:04:55.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:55 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T17:04:55.619 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-05-03T17:04:55.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:55 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3446056680' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-03T17:04:55.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:55 smithi134 ceph-mon[31708]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-03T17:04:55.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:55 smithi134 ceph-mon[31708]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-03T17:04:55.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:55 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3446056680' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-03T17:04:55.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:55 smithi134 ceph-mon[31708]: osdmap e92: 12 total, 12 up, 12 in 2024-05-03T17:04:55.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:55 smithi134 ceph-mon[31708]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-03T17:04:55.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:55 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T17:04:56.070 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T17:04:56.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: pgmap v1007: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-03T17:04:56.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.81:6838/1091254336,v1:172.21.15.81:6839/1091254336] up:boot 2024-05-03T17:04:56.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.81:6840/712278851,v1:172.21.15.81:6841/712278851] up:boot 2024-05-03T17:04:56.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.146:6832/1626793209,v1:172.21.15.146:6834/1626793209] up:boot 2024-05-03T17:04:56.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.146:6833/3427626606,v1:172.21.15.146:6835/3427626606] up:boot 2024-05-03T17:04:56.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.134:6832/3667692373,v1:172.21.15.134:6833/3667692373] up:boot 2024-05-03T17:04:56.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.134:6834/277772760,v1:172.21.15.134:6835/277772760] up:boot 2024-05-03T17:04:56.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.146:6836/1100133600,v1:172.21.15.146:6837/1100133600] up:boot 2024-05-03T17:04:56.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.146:6838/2640620570,v1:172.21.15.146:6839/2640620570] up:boot 2024-05-03T17:04:56.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.134:6836/141326427,v1:172.21.15.134:6838/141326427] up:boot 2024-05-03T17:04:56.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: mds.? [v2:172.21.15.134:6837/2901436272,v1:172.21.15.134:6839/2901436272] up:boot 2024-05-03T17:04:56.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-03T17:04:56.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-03T17:04:56.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-03T17:04:56.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-03T17:04:56.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-03T17:04:56.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-03T17:04:56.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-03T17:04:56.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-03T17:04:56.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T17:04:56.494 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-03T17:04:56.494 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:56 smithi081 ceph-mon[28640]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-03T17:04:56.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: pgmap v1007: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-03T17:04:56.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.81:6838/1091254336,v1:172.21.15.81:6839/1091254336] up:boot 2024-05-03T17:04:56.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.81:6840/712278851,v1:172.21.15.81:6841/712278851] up:boot 2024-05-03T17:04:56.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.146:6832/1626793209,v1:172.21.15.146:6834/1626793209] up:boot 2024-05-03T17:04:56.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.146:6833/3427626606,v1:172.21.15.146:6835/3427626606] up:boot 2024-05-03T17:04:56.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.134:6832/3667692373,v1:172.21.15.134:6833/3667692373] up:boot 2024-05-03T17:04:56.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.134:6834/277772760,v1:172.21.15.134:6835/277772760] up:boot 2024-05-03T17:04:56.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.146:6836/1100133600,v1:172.21.15.146:6837/1100133600] up:boot 2024-05-03T17:04:56.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.146:6838/2640620570,v1:172.21.15.146:6839/2640620570] up:boot 2024-05-03T17:04:56.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.134:6836/141326427,v1:172.21.15.134:6838/141326427] up:boot 2024-05-03T17:04:56.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: mds.? [v2:172.21.15.134:6837/2901436272,v1:172.21.15.134:6839/2901436272] up:boot 2024-05-03T17:04:56.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-03T17:04:56.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-03T17:04:56.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-03T17:04:56.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-03T17:04:56.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-03T17:04:56.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-03T17:04:56.564 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-03T17:04:56.565 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-03T17:04:56.565 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T17:04:56.565 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-03T17:04:56.565 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:56 smithi146 ceph-mon[32357]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-03T17:04:56.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: pgmap v1007: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-03T17:04:56.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.81:6838/1091254336,v1:172.21.15.81:6839/1091254336] up:boot 2024-05-03T17:04:56.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.81:6840/712278851,v1:172.21.15.81:6841/712278851] up:boot 2024-05-03T17:04:56.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.146:6832/1626793209,v1:172.21.15.146:6834/1626793209] up:boot 2024-05-03T17:04:56.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.146:6833/3427626606,v1:172.21.15.146:6835/3427626606] up:boot 2024-05-03T17:04:56.718 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.134:6832/3667692373,v1:172.21.15.134:6833/3667692373] up:boot 2024-05-03T17:04:56.718 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.134:6834/277772760,v1:172.21.15.134:6835/277772760] up:boot 2024-05-03T17:04:56.718 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.146:6836/1100133600,v1:172.21.15.146:6837/1100133600] up:boot 2024-05-03T17:04:56.718 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.146:6838/2640620570,v1:172.21.15.146:6839/2640620570] up:boot 2024-05-03T17:04:56.718 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.134:6836/141326427,v1:172.21.15.134:6838/141326427] up:boot 2024-05-03T17:04:56.718 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: mds.? [v2:172.21.15.134:6837/2901436272,v1:172.21.15.134:6839/2901436272] up:boot 2024-05-03T17:04:56.718 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-03T17:04:56.718 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-03T17:04:56.719 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-03T17:04:56.719 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-03T17:04:56.719 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-03T17:04:56.719 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-03T17:04:56.719 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-03T17:04:56.719 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-03T17:04:56.719 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T17:04:56.719 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-03T17:04:56.719 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:56 smithi134 ceph-mon[31708]: from='mgr.14152 172.21.15.81:0/2833565706' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-03T17:04:58.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.347+0000 7fae3ee00700 1 -- 172.21.15.81:0/781940572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae38104100 msgr2=0x7fae38108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:58.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.347+0000 7fae3ee00700 1 --2- 172.21.15.81:0/781940572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae38104100 0x7fae38108120 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fae240099c0 tx=0x7fae24009cd0 comp rx=0 tx=0).stop 2024-05-03T17:04:58.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.347+0000 7fae3ee00700 1 -- 172.21.15.81:0/781940572 shutdown_connections 2024-05-03T17:04:58.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.347+0000 7fae3ee00700 1 --2- 172.21.15.81:0/781940572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae38103750 0x7fae38103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:58.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.347+0000 7fae3ee00700 1 --2- 172.21.15.81:0/781940572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae38108850 0x7fae381103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:58.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.347+0000 7fae3ee00700 1 --2- 172.21.15.81:0/781940572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae38104100 0x7fae38108120 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:58.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.347+0000 7fae3ee00700 1 -- 172.21.15.81:0/781940572 >> 172.21.15.81:0/781940572 conn(0x7fae3807a600 msgr2=0x7fae3807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:04:58.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.347+0000 7fae3ee00700 1 -- 172.21.15.81:0/781940572 shutdown_connections 2024-05-03T17:04:58.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.347+0000 7fae3ee00700 1 -- 172.21.15.81:0/781940572 wait complete. 2024-05-03T17:04:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.349+0000 7fae3ee00700 1 Processor -- start 2024-05-03T17:04:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.349+0000 7fae3ee00700 1 -- start start 2024-05-03T17:04:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.349+0000 7fae3ee00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae38103750 0x7fae381a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.349+0000 7fae3ee00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae38104100 0x7fae381a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.349+0000 7fae3ee00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae38108850 0x7fae3819ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.349+0000 7fae3ee00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae381134e0 con 0x7fae38108850 2024-05-03T17:04:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.349+0000 7fae3ee00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fae38113360 con 0x7fae38103750 2024-05-03T17:04:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.349+0000 7fae3ee00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fae38113660 con 0x7fae38104100 2024-05-03T17:04:58.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.350+0000 7fae3ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae38108850 0x7fae3819ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:58.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.350+0000 7fae3ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae38108850 0x7fae3819ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59234/0 (socket says 172.21.15.81:59234) 2024-05-03T17:04:58.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.350+0000 7fae3ce00700 1 -- 172.21.15.81:0/2812766885 learned_addr learned my addr 172.21.15.81:0/2812766885 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T17:04:58.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.350+0000 7fae37400700 1 --2- 172.21.15.81:0/2812766885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae38104100 0x7fae381a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:58.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.350+0000 7fae37e00700 1 --2- 172.21.15.81:0/2812766885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae38103750 0x7fae381a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:58.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.350+0000 7fae3ce00700 1 -- 172.21.15.81:0/2812766885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae38104100 msgr2=0x7fae381a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:58.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.350+0000 7fae3ce00700 1 --2- 172.21.15.81:0/2812766885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae38104100 0x7fae381a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:58.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.350+0000 7fae3ce00700 1 -- 172.21.15.81:0/2812766885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae38103750 msgr2=0x7fae381a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:58.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.350+0000 7fae3ce00700 1 --2- 172.21.15.81:0/2812766885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae38103750 0x7fae381a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:58.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.350+0000 7fae3ce00700 1 -- 172.21.15.81:0/2812766885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae3819c1c0 con 0x7fae38108850 2024-05-03T17:04:58.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.350+0000 7fae37e00700 1 --2- 172.21.15.81:0/2812766885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae38103750 0x7fae381a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T17:04:58.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.351+0000 7fae3ce00700 1 --2- 172.21.15.81:0/2812766885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae38108850 0x7fae3819ba60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fae30007ee0 tx=0x7fae3000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:04:58.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.351+0000 7fae34c00700 1 -- 172.21.15.81:0/2812766885 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3000dbd0 con 0x7fae38108850 2024-05-03T17:04:58.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.351+0000 7fae34c00700 1 -- 172.21.15.81:0/2812766885 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae3000dd70 con 0x7fae38108850 2024-05-03T17:04:58.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.351+0000 7fae3ee00700 1 -- 172.21.15.81:0/2812766885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae3819c4b0 con 0x7fae38108850 2024-05-03T17:04:58.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.351+0000 7fae34c00700 1 -- 172.21.15.81:0/2812766885 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae300058d0 con 0x7fae38108850 2024-05-03T17:04:58.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.351+0000 7fae3ee00700 1 -- 172.21.15.81:0/2812766885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae381a8770 con 0x7fae38108850 2024-05-03T17:04:58.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.352+0000 7fae3ee00700 1 -- 172.21.15.81:0/2812766885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae3806a190 con 0x7fae38108850 2024-05-03T17:04:58.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.356+0000 7fae34c00700 1 -- 172.21.15.81:0/2812766885 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fae3001a020 con 0x7fae38108850 2024-05-03T17:04:58.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.357+0000 7fae34c00700 1 --2- 172.21.15.81:0/2812766885 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fae1c0b2990 0x7fae1c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:04:58.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.358+0000 7fae34c00700 1 -- 172.21.15.81:0/2812766885 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9609+0+0 (secure 0 0 0) 0x7fae300e2190 con 0x7fae38108850 2024-05-03T17:04:58.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.358+0000 7fae37e00700 1 --2- 172.21.15.81:0/2812766885 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fae1c0b2990 0x7fae1c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:04:58.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.359+0000 7fae37e00700 1 --2- 172.21.15.81:0/2812766885 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fae1c0b2990 0x7fae1c0b4e50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fae3819cba0 tx=0x7fae2800b2c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:04:58.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.362+0000 7fae34c00700 1 -- 172.21.15.81:0/2812766885 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fae30010070 con 0x7fae38108850 2024-05-03T17:04:58.561 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:58 smithi146 ceph-mon[32357]: pgmap v1008: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T17:04:58.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:58.648+0000 7fae3ee00700 1 -- 172.21.15.81:0/2812766885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fae381a8940 con 0x7fae38108850 2024-05-03T17:04:58.651 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:58 smithi081 ceph-mon[28640]: pgmap v1008: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T17:04:58.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:58 smithi134 ceph-mon[31708]: pgmap v1008: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T17:04:59.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:59.312+0000 7fae34c00700 1 -- 172.21.15.81:0/2812766885 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) ==== 104+0+0 (secure 0 0 0) 0x7fae300a9790 con 0x7fae38108850 2024-05-03T17:04:59.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:59.315+0000 7fae3ee00700 1 -- 172.21.15.81:0/2812766885 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fae1c0b2990 msgr2=0x7fae1c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:59.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:59.315+0000 7fae3ee00700 1 --2- 172.21.15.81:0/2812766885 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fae1c0b2990 0x7fae1c0b4e50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fae3819cba0 tx=0x7fae2800b2c0 comp rx=0 tx=0).stop 2024-05-03T17:04:59.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:59.315+0000 7fae3ee00700 1 -- 172.21.15.81:0/2812766885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae38108850 msgr2=0x7fae3819ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:04:59.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:59.315+0000 7fae3ee00700 1 --2- 172.21.15.81:0/2812766885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae38108850 0x7fae3819ba60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fae30007ee0 tx=0x7fae3000d3b0 comp rx=0 tx=0).stop 2024-05-03T17:04:59.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:59.316+0000 7fae3ee00700 1 -- 172.21.15.81:0/2812766885 shutdown_connections 2024-05-03T17:04:59.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:59.316+0000 7fae3ee00700 1 --2- 172.21.15.81:0/2812766885 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fae1c0b2990 0x7fae1c0b4e50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:59.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:59.316+0000 7fae3ee00700 1 --2- 172.21.15.81:0/2812766885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae38108850 0x7fae3819ba60 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:59.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:59.316+0000 7fae3ee00700 1 --2- 172.21.15.81:0/2812766885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae38103750 0x7fae381a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:59.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:59.316+0000 7fae3ee00700 1 --2- 172.21.15.81:0/2812766885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae38104100 0x7fae381a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:04:59.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:59.316+0000 7fae3ee00700 1 -- 172.21.15.81:0/2812766885 >> 172.21.15.81:0/2812766885 conn(0x7fae3807a600 msgr2=0x7fae38101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:04:59.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:59.316+0000 7fae3ee00700 1 -- 172.21.15.81:0/2812766885 shutdown_connections 2024-05-03T17:04:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:04:59.316+0000 7fae3ee00700 1 -- 172.21.15.81:0/2812766885 wait complete. 2024-05-03T17:04:59.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:04:59 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2812766885' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-03T17:04:59.685 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:04:59 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2812766885' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-03T17:04:59.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:04:59 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2812766885' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-03T17:05:00.265 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-03T17:05:00.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:00 smithi081 ceph-mon[28640]: pgmap v1009: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T17:05:00.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:00 smithi081 ceph-mon[28640]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-03T17:05:00.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:00 smithi081 ceph-mon[28640]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-03T17:05:00.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:00 smithi081 ceph-mon[28640]: Cluster is now healthy 2024-05-03T17:05:00.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:00 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2812766885' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-03T17:05:00.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:00 smithi081 ceph-mon[28640]: fsmap 12 up:standby 2024-05-03T17:05:00.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:00 smithi146 ceph-mon[32357]: pgmap v1009: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T17:05:00.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:00 smithi146 ceph-mon[32357]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-03T17:05:00.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:00 smithi146 ceph-mon[32357]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-03T17:05:00.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:00 smithi146 ceph-mon[32357]: Cluster is now healthy 2024-05-03T17:05:00.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:00 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2812766885' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-03T17:05:00.563 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:00 smithi146 ceph-mon[32357]: fsmap 12 up:standby 2024-05-03T17:05:00.709 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T17:05:00.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:00 smithi134 ceph-mon[31708]: pgmap v1009: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T17:05:00.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:00 smithi134 ceph-mon[31708]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-03T17:05:00.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:00 smithi134 ceph-mon[31708]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-03T17:05:00.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:00 smithi134 ceph-mon[31708]: Cluster is now healthy 2024-05-03T17:05:00.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:00 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2812766885' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-03T17:05:00.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:00 smithi134 ceph-mon[31708]: fsmap 12 up:standby 2024-05-03T17:05:02.434 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:02 smithi081 ceph-mon[28640]: pgmap v1010: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-05-03T17:05:02.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:02 smithi146 ceph-mon[32357]: pgmap v1010: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-05-03T17:05:02.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:02 smithi134 ceph-mon[31708]: pgmap v1010: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-05-03T17:05:02.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.955+0000 7f5695e00700 1 -- 172.21.15.81:0/1212815106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5690108850 msgr2=0x7f56901103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:05:02.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.955+0000 7f5695e00700 1 --2- 172.21.15.81:0/1212815106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5690108850 0x7f56901103d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f568800b0d0 tx=0x7f568800b3e0 comp rx=0 tx=0).stop 2024-05-03T17:05:02.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.955+0000 7f5695e00700 1 -- 172.21.15.81:0/1212815106 shutdown_connections 2024-05-03T17:05:02.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.955+0000 7f5695e00700 1 --2- 172.21.15.81:0/1212815106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5690103750 0x7f5690103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:02.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.955+0000 7f5695e00700 1 --2- 172.21.15.81:0/1212815106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5690108850 0x7f56901103d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:02.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.955+0000 7f5695e00700 1 --2- 172.21.15.81:0/1212815106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5690104100 0x7f5690108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:02.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.955+0000 7f5695e00700 1 -- 172.21.15.81:0/1212815106 >> 172.21.15.81:0/1212815106 conn(0x7f569007a600 msgr2=0x7f569007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:05:02.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.955+0000 7f5695e00700 1 -- 172.21.15.81:0/1212815106 shutdown_connections 2024-05-03T17:05:02.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.955+0000 7f5695e00700 1 -- 172.21.15.81:0/1212815106 wait complete. 2024-05-03T17:05:02.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.957+0000 7f5695e00700 1 Processor -- start 2024-05-03T17:05:02.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.957+0000 7f5695e00700 1 -- start start 2024-05-03T17:05:02.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.957+0000 7f5695e00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5690103750 0x7f569019f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:05:02.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.957+0000 7f5695e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5690104100 0x7f569019fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:05:02.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.957+0000 7f5695e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5690108850 0x7f5690199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:05:02.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.957+0000 7f5695e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f56901134d0 con 0x7f5690104100 2024-05-03T17:05:02.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.957+0000 7f5695e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5690113350 con 0x7f5690108850 2024-05-03T17:05:02.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.957+0000 7f5695e00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5690113650 con 0x7f5690103750 2024-05-03T17:05:02.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.958+0000 7f5687e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5690104100 0x7f569019fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:05:02.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.958+0000 7f5687e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5690104100 0x7f569019fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59256/0 (socket says 172.21.15.81:59256) 2024-05-03T17:05:02.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.958+0000 7f5687e00700 1 -- 172.21.15.81:0/3528092557 learned_addr learned my addr 172.21.15.81:0/3528092557 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T17:05:02.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.958+0000 7f568ea00700 1 --2- 172.21.15.81:0/3528092557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5690103750 0x7f569019f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:05:02.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.958+0000 7f568f400700 1 --2- 172.21.15.81:0/3528092557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5690108850 0x7f5690199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:05:02.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.958+0000 7f5687e00700 1 -- 172.21.15.81:0/3528092557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5690103750 msgr2=0x7f569019f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:05:02.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.958+0000 7f5687e00700 1 --2- 172.21.15.81:0/3528092557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5690103750 0x7f569019f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:02.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.958+0000 7f5687e00700 1 -- 172.21.15.81:0/3528092557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5690108850 msgr2=0x7f5690199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:05:02.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.958+0000 7f5687e00700 1 --2- 172.21.15.81:0/3528092557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5690108850 0x7f5690199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:02.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.958+0000 7f5687e00700 1 -- 172.21.15.81:0/3528092557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5690199ff0 con 0x7f5690104100 2024-05-03T17:05:02.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.958+0000 7f568ea00700 1 --2- 172.21.15.81:0/3528092557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5690103750 0x7f569019f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T17:05:02.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.959+0000 7f5687e00700 1 --2- 172.21.15.81:0/3528092557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5690104100 0x7f569019fb80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f567800c9b0 tx=0x7f567800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:05:02.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.959+0000 7f5694a00700 1 -- 172.21.15.81:0/3528092557 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678007b00 con 0x7f5690104100 2024-05-03T17:05:02.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.959+0000 7f5694a00700 1 -- 172.21.15.81:0/3528092557 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5678007ca0 con 0x7f5690104100 2024-05-03T17:05:02.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.959+0000 7f5694a00700 1 -- 172.21.15.81:0/3528092557 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678018660 con 0x7f5690104100 2024-05-03T17:05:02.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.959+0000 7f5695e00700 1 -- 172.21.15.81:0/3528092557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f569019a2e0 con 0x7f5690104100 2024-05-03T17:05:02.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.959+0000 7f5695e00700 1 -- 172.21.15.81:0/3528092557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56901a65c0 con 0x7f5690104100 2024-05-03T17:05:02.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.960+0000 7f5695e00700 1 -- 172.21.15.81:0/3528092557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5690104be0 con 0x7f5690104100 2024-05-03T17:05:02.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.963+0000 7f5694a00700 1 -- 172.21.15.81:0/3528092557 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f567800f450 con 0x7f5690104100 2024-05-03T17:05:02.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.964+0000 7f5694a00700 1 --2- 172.21.15.81:0/3528092557 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f56740b2990 0x7f56740b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:05:02.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.964+0000 7f5694a00700 1 -- 172.21.15.81:0/3528092557 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9609+0+0 (secure 0 0 0) 0x7f56780e2c30 con 0x7f5690104100 2024-05-03T17:05:02.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.965+0000 7f568ea00700 1 --2- 172.21.15.81:0/3528092557 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f56740b2990 0x7f56740b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:05:02.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.965+0000 7f568ea00700 1 --2- 172.21.15.81:0/3528092557 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f56740b2990 0x7f56740b4e50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5680005950 tx=0x7f56800058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:05:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:02.967+0000 7f5694a00700 1 -- 172.21.15.81:0/3528092557 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f5678014030 con 0x7f5690104100 2024-05-03T17:05:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:03.196+0000 7f5695e00700 1 -- 172.21.15.81:0/3528092557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f569019ac40 con 0x7f5690104100 2024-05-03T17:05:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:03.321+0000 7f5694a00700 1 -- 172.21.15.81:0/3528092557 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v93) ==== 181+0+0 (secure 0 0 0) 0x7f56780aa340 con 0x7f5690104100 2024-05-03T17:05:03.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:03.327+0000 7f5695e00700 1 -- 172.21.15.81:0/3528092557 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f56740b2990 msgr2=0x7f56740b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:05:03.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:03.327+0000 7f5695e00700 1 --2- 172.21.15.81:0/3528092557 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f56740b2990 0x7f56740b4e50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5680005950 tx=0x7f56800058e0 comp rx=0 tx=0).stop 2024-05-03T17:05:03.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:03.327+0000 7f5695e00700 1 -- 172.21.15.81:0/3528092557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5690104100 msgr2=0x7f569019fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:05:03.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:03.327+0000 7f5695e00700 1 --2- 172.21.15.81:0/3528092557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5690104100 0x7f569019fb80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f567800c9b0 tx=0x7f567800cd70 comp rx=0 tx=0).stop 2024-05-03T17:05:03.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:03.327+0000 7f5695e00700 1 -- 172.21.15.81:0/3528092557 shutdown_connections 2024-05-03T17:05:03.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:03.327+0000 7f5695e00700 1 --2- 172.21.15.81:0/3528092557 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7f56740b2990 0x7f56740b4e50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:03.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:03.327+0000 7f5695e00700 1 --2- 172.21.15.81:0/3528092557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5690103750 0x7f569019f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:03.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:03.327+0000 7f5695e00700 1 --2- 172.21.15.81:0/3528092557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5690108850 0x7f5690199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:03.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:03.327+0000 7f5695e00700 1 --2- 172.21.15.81:0/3528092557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5690104100 0x7f569019fb80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:03.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:03.327+0000 7f5695e00700 1 -- 172.21.15.81:0/3528092557 >> 172.21.15.81:0/3528092557 conn(0x7f569007a600 msgr2=0x7f5690101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:05:03.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:03.328+0000 7f5695e00700 1 -- 172.21.15.81:0/3528092557 shutdown_connections 2024-05-03T17:05:03.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:03.329+0000 7f5695e00700 1 -- 172.21.15.81:0/3528092557 wait complete. 2024-05-03T17:05:03.332 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-05-03T17:05:03.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:03 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3528092557' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T17:05:03.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:03 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3528092557' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T17:05:03.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:03 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3528092557' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T17:05:04.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-03T17:05:04.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:04 smithi081 ceph-mon[28640]: pgmap v1011: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-05-03T17:05:04.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:04 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/3528092557' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T17:05:04.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:04 smithi081 ceph-mon[28640]: osdmap e93: 12 total, 12 up, 12 in 2024-05-03T17:05:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T17:05:04.714 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:04 smithi146 ceph-mon[32357]: pgmap v1011: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-05-03T17:05:04.714 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:04 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/3528092557' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T17:05:04.714 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:04 smithi146 ceph-mon[32357]: osdmap e93: 12 total, 12 up, 12 in 2024-05-03T17:05:04.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:04 smithi134 ceph-mon[31708]: pgmap v1011: 129 pgs: 129 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-05-03T17:05:04.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:04 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/3528092557' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T17:05:04.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:04 smithi134 ceph-mon[31708]: osdmap e93: 12 total, 12 up, 12 in 2024-05-03T17:05:05.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:05 smithi134 ceph-mon[31708]: pgmap v1013: 97 pgs: 97 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T17:05:05.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:05 smithi081 ceph-mon[28640]: pgmap v1013: 97 pgs: 97 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T17:05:05.812 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:05 smithi146 ceph-mon[32357]: pgmap v1013: 97 pgs: 97 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T17:05:07.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.102+0000 7fbe2ba00700 1 -- 172.21.15.81:0/1574836620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe24075ff0 msgr2=0x7fbe2410f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:05:07.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.102+0000 7fbe2ba00700 1 --2- 172.21.15.81:0/1574836620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe24075ff0 0x7fbe2410f960 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbe10009990 tx=0x7fbe10009ca0 comp rx=0 tx=0).stop 2024-05-03T17:05:07.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.102+0000 7fbe2ba00700 1 -- 172.21.15.81:0/1574836620 shutdown_connections 2024-05-03T17:05:07.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.102+0000 7fbe2ba00700 1 --2- 172.21.15.81:0/1574836620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe240756d0 0x7fbe24075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:07.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.102+0000 7fbe2ba00700 1 --2- 172.21.15.81:0/1574836620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe2410fea0 0x7fbe24112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:07.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.102+0000 7fbe2ba00700 1 --2- 172.21.15.81:0/1574836620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe24075ff0 0x7fbe2410f960 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:07.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.102+0000 7fbe2ba00700 1 -- 172.21.15.81:0/1574836620 >> 172.21.15.81:0/1574836620 conn(0x7fbe2407a600 msgr2=0x7fbe2407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:05:07.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.102+0000 7fbe2ba00700 1 -- 172.21.15.81:0/1574836620 shutdown_connections 2024-05-03T17:05:07.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.102+0000 7fbe2ba00700 1 -- 172.21.15.81:0/1574836620 wait complete. 2024-05-03T17:05:07.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.103+0000 7fbe2ba00700 1 Processor -- start 2024-05-03T17:05:07.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.103+0000 7fbe2ba00700 1 -- start start 2024-05-03T17:05:07.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.103+0000 7fbe2ba00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe240756d0 0x7fbe241a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:05:07.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.104+0000 7fbe2ba00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe24075ff0 0x7fbe241a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:05:07.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.104+0000 7fbe2ba00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe2410fea0 0x7fbe2419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:05:07.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.104+0000 7fbe2ba00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbe24115710 con 0x7fbe24075ff0 2024-05-03T17:05:07.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.104+0000 7fbe2ba00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbe24115590 con 0x7fbe240756d0 2024-05-03T17:05:07.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.104+0000 7fbe2ba00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbe24115890 con 0x7fbe2410fea0 2024-05-03T17:05:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.104+0000 7fbe23e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe24075ff0 0x7fbe241a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:05:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.104+0000 7fbe23e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe24075ff0 0x7fbe241a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42366/0 (socket says 172.21.15.81:42366) 2024-05-03T17:05:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.104+0000 7fbe23e00700 1 -- 172.21.15.81:0/2418077710 learned_addr learned my addr 172.21.15.81:0/2418077710 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T17:05:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.104+0000 7fbe29000700 1 --2- 172.21.15.81:0/2418077710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe240756d0 0x7fbe241a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:05:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.104+0000 7fbe29a00700 1 --2- 172.21.15.81:0/2418077710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe2410fea0 0x7fbe2419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:05:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.104+0000 7fbe23e00700 1 -- 172.21.15.81:0/2418077710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe2410fea0 msgr2=0x7fbe2419bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:05:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.104+0000 7fbe23e00700 1 --2- 172.21.15.81:0/2418077710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe2410fea0 0x7fbe2419bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.104+0000 7fbe23e00700 1 -- 172.21.15.81:0/2418077710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe240756d0 msgr2=0x7fbe241a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:05:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.104+0000 7fbe23e00700 1 --2- 172.21.15.81:0/2418077710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe240756d0 0x7fbe241a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:07.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.105+0000 7fbe23e00700 1 -- 172.21.15.81:0/2418077710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2419c230 con 0x7fbe24075ff0 2024-05-03T17:05:07.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.105+0000 7fbe23e00700 1 --2- 172.21.15.81:0/2418077710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe24075ff0 0x7fbe241a1e50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbe10000c00 tx=0x7fbe10009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:05:07.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.105+0000 7fbe21600700 1 -- 172.21.15.81:0/2418077710 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10027070 con 0x7fbe24075ff0 2024-05-03T17:05:07.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.105+0000 7fbe21600700 1 -- 172.21.15.81:0/2418077710 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe1000fc70 con 0x7fbe24075ff0 2024-05-03T17:05:07.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.105+0000 7fbe2ba00700 1 -- 172.21.15.81:0/2418077710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe2419c4c0 con 0x7fbe24075ff0 2024-05-03T17:05:07.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.105+0000 7fbe21600700 1 -- 172.21.15.81:0/2418077710 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10022d30 con 0x7fbe24075ff0 2024-05-03T17:05:07.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.105+0000 7fbe2ba00700 1 -- 172.21.15.81:0/2418077710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe241a87e0 con 0x7fbe24075ff0 2024-05-03T17:05:07.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.107+0000 7fbe2ba00700 1 -- 172.21.15.81:0/2418077710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe2406a190 con 0x7fbe24075ff0 2024-05-03T17:05:07.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.109+0000 7fbe21600700 1 -- 172.21.15.81:0/2418077710 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fbe1002a070 con 0x7fbe24075ff0 2024-05-03T17:05:07.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.110+0000 7fbe21600700 1 --2- 172.21.15.81:0/2418077710 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fbe0c0b2990 0x7fbe0c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:05:07.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.111+0000 7fbe21600700 1 -- 172.21.15.81:0/2418077710 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9026+0+0 (secure 0 0 0) 0x7fbe100e3570 con 0x7fbe24075ff0 2024-05-03T17:05:07.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.111+0000 7fbe29000700 1 --2- 172.21.15.81:0/2418077710 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fbe0c0b2990 0x7fbe0c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:05:07.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.112+0000 7fbe29000700 1 --2- 172.21.15.81:0/2418077710 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fbe0c0b2990 0x7fbe0c0b4e50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbe18005950 tx=0x7fbe180058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:05:07.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.115+0000 7fbe21600700 1 -- 172.21.15.81:0/2418077710 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fbe1005fd70 con 0x7fbe24075ff0 2024-05-03T17:05:07.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.356+0000 7fbe2ba00700 1 -- 172.21.15.81:0/2418077710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbe2419cfc0 con 0x7fbe24075ff0 2024-05-03T17:05:07.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.990+0000 7fbe21600700 1 -- 172.21.15.81:0/2418077710 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v94) ==== 169+0+0 (secure 0 0 0) 0x7fbe10013070 con 0x7fbe24075ff0 2024-05-03T17:05:07.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.994+0000 7fbe2ba00700 1 -- 172.21.15.81:0/2418077710 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fbe0c0b2990 msgr2=0x7fbe0c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:05:07.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.994+0000 7fbe2ba00700 1 --2- 172.21.15.81:0/2418077710 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fbe0c0b2990 0x7fbe0c0b4e50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbe18005950 tx=0x7fbe180058e0 comp rx=0 tx=0).stop 2024-05-03T17:05:07.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.994+0000 7fbe2ba00700 1 -- 172.21.15.81:0/2418077710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe24075ff0 msgr2=0x7fbe241a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:05:07.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.994+0000 7fbe2ba00700 1 --2- 172.21.15.81:0/2418077710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe24075ff0 0x7fbe241a1e50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbe10000c00 tx=0x7fbe10009f90 comp rx=0 tx=0).stop 2024-05-03T17:05:07.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.995+0000 7fbe2ba00700 1 -- 172.21.15.81:0/2418077710 shutdown_connections 2024-05-03T17:05:07.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.995+0000 7fbe2ba00700 1 --2- 172.21.15.81:0/2418077710 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7fbe0c0b2990 0x7fbe0c0b4e50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:07.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.995+0000 7fbe2ba00700 1 --2- 172.21.15.81:0/2418077710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe2410fea0 0x7fbe2419bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:07.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.995+0000 7fbe2ba00700 1 --2- 172.21.15.81:0/2418077710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe240756d0 0x7fbe241a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:08.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.995+0000 7fbe2ba00700 1 --2- 172.21.15.81:0/2418077710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe24075ff0 0x7fbe241a1e50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:08.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.995+0000 7fbe2ba00700 1 -- 172.21.15.81:0/2418077710 >> 172.21.15.81:0/2418077710 conn(0x7fbe2407a600 msgr2=0x7fbe24100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:05:08.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.996+0000 7fbe2ba00700 1 -- 172.21.15.81:0/2418077710 shutdown_connections 2024-05-03T17:05:08.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:07.996+0000 7fbe2ba00700 1 -- 172.21.15.81:0/2418077710 wait complete. 2024-05-03T17:05:08.000 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-05-03T17:05:08.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:08 smithi146 ceph-mon[32357]: pgmap v1014: 97 pgs: 97 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T17:05:08.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:08 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2418077710' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T17:05:08.379 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:08 smithi081 ceph-mon[28640]: pgmap v1014: 97 pgs: 97 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T17:05:08.380 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:08 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2418077710' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T17:05:08.420 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:08 smithi134 ceph-mon[31708]: pgmap v1014: 97 pgs: 97 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T17:05:08.420 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:08 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2418077710' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T17:05:08.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 8988869e-096a-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-03T17:05:09.234 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T17:05:09.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:09 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/2418077710' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T17:05:09.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:09 smithi146 ceph-mon[32357]: osdmap e94: 12 total, 12 up, 12 in 2024-05-03T17:05:09.396 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:09 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/2418077710' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T17:05:09.397 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:09 smithi081 ceph-mon[28640]: osdmap e94: 12 total, 12 up, 12 in 2024-05-03T17:05:09.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:09 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/2418077710' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T17:05:09.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:09 smithi134 ceph-mon[31708]: osdmap e94: 12 total, 12 up, 12 in 2024-05-03T17:05:10.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:10 smithi081 ceph-mon[28640]: pgmap v1016: 33 pgs: 33 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T17:05:10.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:10 smithi146 ceph-mon[32357]: pgmap v1016: 33 pgs: 33 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T17:05:10.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:10 smithi134 ceph-mon[31708]: pgmap v1016: 33 pgs: 33 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T17:05:11.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.637+0000 7ff7d8a00700 1 -- 172.21.15.81:0/2226421640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7d4109510 msgr2=0x7ff7d41098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:05:11.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.637+0000 7ff7d8a00700 1 --2- 172.21.15.81:0/2226421640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7d4109510 0x7ff7d41098f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009990 tx=0x7ff7c4009ca0 comp rx=0 tx=0).stop 2024-05-03T17:05:11.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.637+0000 7ff7d8a00700 1 -- 172.21.15.81:0/2226421640 shutdown_connections 2024-05-03T17:05:11.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.637+0000 7ff7d8a00700 1 --2- 172.21.15.81:0/2226421640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7d406c590 0x7ff7d4110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:11.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.637+0000 7ff7d8a00700 1 --2- 172.21.15.81:0/2226421640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7d4109510 0x7ff7d41098f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:11.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.637+0000 7ff7d8a00700 1 --2- 172.21.15.81:0/2226421640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d406bbd0 0x7ff7d406c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:11.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.637+0000 7ff7d8a00700 1 -- 172.21.15.81:0/2226421640 >> 172.21.15.81:0/2226421640 conn(0x7ff7d4079350 msgr2=0x7ff7d4079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:05:11.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.637+0000 7ff7d8a00700 1 -- 172.21.15.81:0/2226421640 shutdown_connections 2024-05-03T17:05:11.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.637+0000 7ff7d8a00700 1 -- 172.21.15.81:0/2226421640 wait complete. 2024-05-03T17:05:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.639+0000 7ff7d8a00700 1 Processor -- start 2024-05-03T17:05:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.639+0000 7ff7d8a00700 1 -- start start 2024-05-03T17:05:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.639+0000 7ff7d8a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7d406bbd0 0x7ff7d419bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:05:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.639+0000 7ff7d8a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7d406c590 0x7ff7d419c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:05:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.639+0000 7ff7d8a00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d4109510 0x7ff7d41a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:05:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.639+0000 7ff7d8a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d4113520 con 0x7ff7d406bbd0 2024-05-03T17:05:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.639+0000 7ff7d8a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d41133a0 con 0x7ff7d406c590 2024-05-03T17:05:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.639+0000 7ff7d8a00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d41136a0 con 0x7ff7d4109510 2024-05-03T17:05:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.640+0000 7ff7d1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7d406bbd0 0x7ff7d419bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:05:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.640+0000 7ff7d1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7d406bbd0 0x7ff7d419bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42372/0 (socket says 172.21.15.81:42372) 2024-05-03T17:05:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.640+0000 7ff7d1e00700 1 -- 172.21.15.81:0/644490863 learned_addr learned my addr 172.21.15.81:0/644490863 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-03T17:05:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.640+0000 7ff7d1400700 1 --2- 172.21.15.81:0/644490863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7d406c590 0x7ff7d419c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:05:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.640+0000 7ff7d2800700 1 --2- 172.21.15.81:0/644490863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d4109510 0x7ff7d41a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:05:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.640+0000 7ff7d1e00700 1 -- 172.21.15.81:0/644490863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d4109510 msgr2=0x7ff7d41a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:05:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.640+0000 7ff7d1e00700 1 --2- 172.21.15.81:0/644490863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d4109510 0x7ff7d41a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.640+0000 7ff7d1e00700 1 -- 172.21.15.81:0/644490863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7d406c590 msgr2=0x7ff7d419c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:05:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.640+0000 7ff7d1e00700 1 --2- 172.21.15.81:0/644490863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7d406c590 0x7ff7d419c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.640+0000 7ff7d1e00700 1 -- 172.21.15.81:0/644490863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d41a0d60 con 0x7ff7d406bbd0 2024-05-03T17:05:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.640+0000 7ff7d1400700 1 --2- 172.21.15.81:0/644490863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7d406c590 0x7ff7d419c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T17:05:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.640+0000 7ff7d2800700 1 --2- 172.21.15.81:0/644490863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d4109510 0x7ff7d41a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T17:05:11.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.641+0000 7ff7d1e00700 1 --2- 172.21.15.81:0/644490863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7d406bbd0 0x7ff7d419bd50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4000c00 tx=0x7ff7c4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:05:11.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.641+0000 7ff7caa00700 1 -- 172.21.15.81:0/644490863 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4027070 con 0x7ff7d406bbd0 2024-05-03T17:05:11.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.641+0000 7ff7caa00700 1 -- 172.21.15.81:0/644490863 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff7c400fb80 con 0x7ff7d406bbd0 2024-05-03T17:05:11.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.641+0000 7ff7d8a00700 1 -- 172.21.15.81:0/644490863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7d41a0ff0 con 0x7ff7d406bbd0 2024-05-03T17:05:11.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.641+0000 7ff7caa00700 1 -- 172.21.15.81:0/644490863 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4022c30 con 0x7ff7d406bbd0 2024-05-03T17:05:11.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.641+0000 7ff7d8a00700 1 -- 172.21.15.81:0/644490863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7d41a88d0 con 0x7ff7d406bbd0 2024-05-03T17:05:11.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.643+0000 7ff7d8a00700 1 -- 172.21.15.81:0/644490863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7d406a190 con 0x7ff7d406bbd0 2024-05-03T17:05:11.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.645+0000 7ff7caa00700 1 -- 172.21.15.81:0/644490863 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff7c402a070 con 0x7ff7d406bbd0 2024-05-03T17:05:11.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.646+0000 7ff7caa00700 1 --2- 172.21.15.81:0/644490863 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff7b80b2990 0x7ff7b80b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T17:05:11.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.647+0000 7ff7caa00700 1 -- 172.21.15.81:0/644490863 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8496+0+0 (secure 0 0 0) 0x7ff7c40e3590 con 0x7ff7d406bbd0 2024-05-03T17:05:11.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.647+0000 7ff7d1400700 1 --2- 172.21.15.81:0/644490863 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff7b80b2990 0x7ff7b80b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T17:05:11.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.647+0000 7ff7d1400700 1 --2- 172.21.15.81:0/644490863 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff7b80b2990 0x7ff7b80b4e50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0005fd0 tx=0x7ff7c0005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T17:05:11.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.649+0000 7ff7caa00700 1 -- 172.21.15.81:0/644490863 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff7c4031080 con 0x7ff7d406bbd0 2024-05-03T17:05:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:11.884+0000 7ff7d8a00700 1 -- 172.21.15.81:0/644490863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff7d41a8aa0 con 0x7ff7d406bbd0 2024-05-03T17:05:12.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:12.025+0000 7ff7caa00700 1 -- 172.21.15.81:0/644490863 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v95) ==== 178+0+0 (secure 0 0 0) 0x7ff7c4013070 con 0x7ff7d406bbd0 2024-05-03T17:05:12.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:12.031+0000 7ff7d8a00700 1 -- 172.21.15.81:0/644490863 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff7b80b2990 msgr2=0x7ff7b80b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:05:12.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:12.031+0000 7ff7d8a00700 1 --2- 172.21.15.81:0/644490863 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff7b80b2990 0x7ff7b80b4e50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0005fd0 tx=0x7ff7c0005ee0 comp rx=0 tx=0).stop 2024-05-03T17:05:12.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:12.031+0000 7ff7d8a00700 1 -- 172.21.15.81:0/644490863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7d406bbd0 msgr2=0x7ff7d419bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T17:05:12.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:12.031+0000 7ff7d8a00700 1 --2- 172.21.15.81:0/644490863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7d406bbd0 0x7ff7d419bd50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4000c00 tx=0x7ff7c4005ef0 comp rx=0 tx=0).stop 2024-05-03T17:05:12.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:12.031+0000 7ff7d8a00700 1 -- 172.21.15.81:0/644490863 shutdown_connections 2024-05-03T17:05:12.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:12.031+0000 7ff7d8a00700 1 --2- 172.21.15.81:0/644490863 >> [v2:172.21.15.81:6800/1773670984,v1:172.21.15.81:6801/1773670984] conn(0x7ff7b80b2990 0x7ff7b80b4e50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:12.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:12.031+0000 7ff7d8a00700 1 --2- 172.21.15.81:0/644490863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d4109510 0x7ff7d41a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:12.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:12.031+0000 7ff7d8a00700 1 --2- 172.21.15.81:0/644490863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7d406bbd0 0x7ff7d419bd50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:12.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:12.031+0000 7ff7d8a00700 1 --2- 172.21.15.81:0/644490863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7d406c590 0x7ff7d419c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T17:05:12.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:12.031+0000 7ff7d8a00700 1 -- 172.21.15.81:0/644490863 >> 172.21.15.81:0/644490863 conn(0x7ff7d4079350 msgr2=0x7ff7d410e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T17:05:12.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:12.031+0000 7ff7d8a00700 1 -- 172.21.15.81:0/644490863 shutdown_connections 2024-05-03T17:05:12.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-03T17:05:12.031+0000 7ff7d8a00700 1 -- 172.21.15.81:0/644490863 wait complete. 2024-05-03T17:05:12.035 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data_ec' removed 2024-05-03T17:05:12.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:12 smithi081 ceph-mon[28640]: pgmap v1017: 33 pgs: 33 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T17:05:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:12 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/644490863' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T17:05:12.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:12 smithi146 ceph-mon[32357]: pgmap v1017: 33 pgs: 33 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T17:05:12.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:12 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/644490863' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T17:05:12.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:12 smithi134 ceph-mon[31708]: pgmap v1017: 33 pgs: 33 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T17:05:12.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:12 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/644490863' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T17:05:12.914 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-03T17:05:12.993 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-03T17:05:13.083 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-03T17:05:13.175 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-03T17:05:13.176 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-03T17:05:13.233 DEBUG:teuthology.orchestra.run.smithi134:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-03T17:05:13.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:13 smithi081 ceph-mon[28640]: from='client.? 172.21.15.81:0/644490863' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T17:05:13.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:13 smithi081 ceph-mon[28640]: osdmap e95: 12 total, 12 up, 12 in 2024-05-03T17:05:13.289 DEBUG:teuthology.orchestra.run.smithi146:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-03T17:05:13.311 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:13 smithi146 ceph-mon[32357]: from='client.? 172.21.15.81:0/644490863' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T17:05:13.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:13 smithi146 ceph-mon[32357]: osdmap e95: 12 total, 12 up, 12 in 2024-05-03T17:05:13.348 INFO:tasks.cephadm:Stopping all daemons... 2024-05-03T17:05:13.348 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-03T17:05:13.348 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@mon.a 2024-05-03T17:05:13.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:13 smithi134 ceph-mon[31708]: from='client.? 172.21.15.81:0/644490863' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T17:05:13.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:13 smithi134 ceph-mon[31708]: osdmap e95: 12 total, 12 up, 12 in 2024-05-03T17:05:13.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:13 smithi081 systemd[1]: Stopping Ceph mon.a for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:05:14.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:13 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-a[28636]: 2024-05-03T17:05:13.946+0000 7fe393000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:05:14.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:13 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-a[28636]: 2024-05-03T17:05:13.946+0000 7fe393000700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-03T17:05:14.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:14 smithi081 podman[90795]: 2024-05-03 17:05:14.173978033 +0000 UTC m=+0.406224284 container died ac30952d6fd320ec145a822ab7d1e17f7c4155ce056f31bf8fd28b5deefd197e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-03T17:05:14.909 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:14 smithi081 podman[90795]: 2024-05-03 17:05:14.639808168 +0000 UTC m=+0.872054399 container cleanup ac30952d6fd320ec145a822ab7d1e17f7c4155ce056f31bf8fd28b5deefd197e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430) 2024-05-03T17:05:14.910 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:14 smithi081 bash[90795]: ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-a 2024-05-03T17:05:15.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 03 17:05:14 smithi081 podman[90809]: 2024-05-03 17:05:14.908278348 +0000 UTC m=+0.720188930 container remove ac30952d6fd320ec145a822ab7d1e17f7c4155ce056f31bf8fd28b5deefd197e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T17:05:15.397 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mon.a.service' 2024-05-03T17:05:15.524 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:05:15.525 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-03T17:05:15.525 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-03T17:05:15.525 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@mon.b 2024-05-03T17:05:15.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:15 smithi134 systemd[1]: Stopping Ceph mon.b for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:05:16.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:16 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-b[31704]: 2024-05-03T17:05:16.111+0000 7f3be4000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:05:16.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:16 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-b[31704]: 2024-05-03T17:05:16.111+0000 7f3be4000700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-03T17:05:16.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:16 smithi134 podman[67301]: 2024-05-03 17:05:16.287281571 +0000 UTC m=+0.307711856 container died 609640d09339d7acfc38e4f6fcdbb769c4403e074001e92b20f9cdfccd6cf256 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True) 2024-05-03T17:05:16.966 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:16 smithi134 podman[67301]: 2024-05-03 17:05:16.830330399 +0000 UTC m=+0.850760750 container cleanup 609640d09339d7acfc38e4f6fcdbb769c4403e074001e92b20f9cdfccd6cf256 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-b, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-03T17:05:16.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:16 smithi134 bash[67301]: ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-b 2024-05-03T17:05:17.466 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 03 17:05:17 smithi134 podman[67315]: 2024-05-03 17:05:17.116167988 +0000 UTC m=+0.808154949 container remove 609640d09339d7acfc38e4f6fcdbb769c4403e074001e92b20f9cdfccd6cf256 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430) 2024-05-03T17:05:17.588 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mon.b.service' 2024-05-03T17:05:17.713 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:05:17.714 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-03T17:05:17.714 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-03T17:05:17.714 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@mon.c 2024-05-03T17:05:18.062 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:17 smithi146 systemd[1]: Stopping Ceph mon.c for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:05:18.561 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:18 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-c[32348]: 2024-05-03T17:05:18.269+0000 7f6e47a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:05:18.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:18 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-c[32348]: 2024-05-03T17:05:18.269+0000 7f6e47a00700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-03T17:05:18.562 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:18 smithi146 podman[68353]: 2024-05-03 17:05:18.517699693 +0000 UTC m=+0.385541931 container died a6467fcc8a320296b757171e31c1066e189097941ab5e6ee824ebe474d94cabd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T17:05:19.468 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:19 smithi146 podman[68353]: 2024-05-03 17:05:19.089947115 +0000 UTC m=+0.957789375 container cleanup a6467fcc8a320296b757171e31c1066e189097941ab5e6ee824ebe474d94cabd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T17:05:19.468 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:19 smithi146 bash[68353]: ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-c 2024-05-03T17:05:19.739 INFO:journalctl@ceph.mon.c.smithi146.stdout:May 03 17:05:19 smithi146 podman[68367]: 2024-05-03 17:05:19.467467932 +0000 UTC m=+0.936541657 container remove a6467fcc8a320296b757171e31c1066e189097941ab5e6ee824ebe474d94cabd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mon-c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-05-03T17:05:19.755 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mon.c.service' 2024-05-03T17:05:19.877 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:05:19.877 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-03T17:05:19.877 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-03T17:05:19.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@mgr.x 2024-05-03T17:05:20.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 17:05:19 smithi081 systemd[1]: Stopping Ceph mgr.x for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:05:20.740 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 17:05:20 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T17:05:20.476+0000 7f8ee9200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:05:20.741 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 17:05:20 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x[28869]: 2024-05-03T17:05:20.476+0000 7f8ee9200700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-05-03T17:05:20.741 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 17:05:20 smithi081 podman[90918]: 2024-05-03 17:05:20.569389934 +0000 UTC m=+0.230148930 container died efb7bca1e81960e9cee42ff2c8bc92ad6a3c96fb99e23ff186d20eb7590ceb45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T17:05:21.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 17:05:21 smithi081 podman[90918]: 2024-05-03 17:05:21.054196255 +0000 UTC m=+0.714955206 container cleanup efb7bca1e81960e9cee42ff2c8bc92ad6a3c96fb99e23ff186d20eb7590ceb45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-05-03T17:05:21.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 17:05:21 smithi081 bash[90918]: ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x 2024-05-03T17:05:21.740 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 03 17:05:21 smithi081 podman[90932]: 2024-05-03 17:05:21.273921852 +0000 UTC m=+0.691708220 container remove efb7bca1e81960e9cee42ff2c8bc92ad6a3c96fb99e23ff186d20eb7590ceb45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-x, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-03T17:05:21.784 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mgr.x.service' 2024-05-03T17:05:21.889 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:05:21.890 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-03T17:05:21.890 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-03T17:05:21.890 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@mgr.y 2024-05-03T17:05:22.466 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 17:05:22 smithi134 systemd[1]: Stopping Ceph mgr.y for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:05:22.863 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 17:05:22 smithi134 podman[67424]: 2024-05-03 17:05:22.561283514 +0000 UTC m=+0.246551132 container died 1e2f457195e2e8c2321da6398bba81a25bd6638dbe7f14fd11689399ba995b0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T17:05:23.207 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 17:05:22 smithi134 podman[67424]: 2024-05-03 17:05:22.970522858 +0000 UTC m=+0.655790456 container cleanup 1e2f457195e2e8c2321da6398bba81a25bd6638dbe7f14fd11689399ba995b0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T17:05:23.207 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 17:05:22 smithi134 bash[67424]: ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y 2024-05-03T17:05:23.466 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 17:05:23 smithi134 podman[67438]: 2024-05-03 17:05:23.205686508 +0000 UTC m=+0.630191774 container remove 1e2f457195e2e8c2321da6398bba81a25bd6638dbe7f14fd11689399ba995b0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-y, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T17:05:23.466 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 03 17:05:23 smithi134 systemd[1]: ceph-8988869e-096a-11ef-bc97-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-05-03T17:05:23.717 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mgr.y.service' 2024-05-03T17:05:23.821 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:05:23.821 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-03T17:05:23.822 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-03T17:05:23.822 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@mgr.z 2024-05-03T17:05:24.312 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 17:05:23 smithi146 systemd[1]: Stopping Ceph mgr.z for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:05:24.812 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 17:05:24 smithi146 podman[68489]: 2024-05-03 17:05:24.534706265 +0000 UTC m=+0.265864615 container died 17ef6eaac8aa60e13e9c87dd5ed851eb6d885727256683ba58c511968421f6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T17:05:25.312 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 17:05:25 smithi146 podman[68489]: 2024-05-03 17:05:25.094447439 +0000 UTC m=+0.825605774 container cleanup 17ef6eaac8aa60e13e9c87dd5ed851eb6d885727256683ba58c511968421f6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-05-03T17:05:25.312 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 17:05:25 smithi146 bash[68489]: ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z 2024-05-03T17:05:25.812 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 17:05:25 smithi146 podman[68503]: 2024-05-03 17:05:25.32611468 +0000 UTC m=+0.775901529 container remove 17ef6eaac8aa60e13e9c87dd5ed851eb6d885727256683ba58c511968421f6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mgr-z, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T17:05:25.812 INFO:journalctl@ceph.mgr.z.smithi146.stdout:May 03 17:05:25 smithi146 systemd[1]: ceph-8988869e-096a-11ef-bc97-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-05-03T17:05:25.895 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mgr.z.service' 2024-05-03T17:05:26.003 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:05:26.003 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-03T17:05:26.003 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-03T17:05:26.004 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.0 2024-05-03T17:05:26.490 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 17:05:26 smithi081 systemd[1]: Stopping Ceph osd.0 for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:05:26.990 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 17:05:26 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-0[40734]: 2024-05-03T17:05:26.540+0000 7f0b8b200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:05:26.990 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 17:05:26 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-0[40734]: 2024-05-03T17:05:26.540+0000 7f0b8b200700 -1 osd.0 95 *** Got signal Terminated *** 2024-05-03T17:05:26.990 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 17:05:26 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-0[40734]: 2024-05-03T17:05:26.540+0000 7f0b8b200700 -1 osd.0 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T17:05:32.240 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 17:05:31 smithi081 podman[91042]: 2024-05-03 17:05:31.953605978 +0000 UTC m=+5.550099481 container died 4e8e1482c45502ee1853776c5630894d3532268f9a2ccf7592b6b9356e81a8b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T17:05:32.679 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 17:05:32 smithi081 podman[91042]: 2024-05-03 17:05:32.409944164 +0000 UTC m=+6.006437694 container cleanup 4e8e1482c45502ee1853776c5630894d3532268f9a2ccf7592b6b9356e81a8b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T17:05:32.679 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 17:05:32 smithi081 bash[91042]: ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-0 2024-05-03T17:05:32.989 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 17:05:32 smithi081 podman[91060]: 2024-05-03 17:05:32.678291853 +0000 UTC m=+0.712250553 container remove 4e8e1482c45502ee1853776c5630894d3532268f9a2ccf7592b6b9356e81a8b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T17:05:33.836 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 17:05:33 smithi081 podman[91155]: 2024-05-03 17:05:33.438286808 +0000 UTC m=+0.033176429 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T17:05:33.837 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 17:05:33 smithi081 podman[91155]: 2024-05-03 17:05:33.562768299 +0000 UTC m=+0.157657954 container create 7922dd2fb3804eb6dab44a490fd7e9cd98ceb367d25ad0cd6ba3472edbfd4652 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-03T17:05:33.837 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 17:05:33 smithi081 podman[91155]: 2024-05-03 17:05:33.835373095 +0000 UTC m=+0.430262755 container init 7922dd2fb3804eb6dab44a490fd7e9cd98ceb367d25ad0cd6ba3472edbfd4652 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240430, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T17:05:34.240 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 17:05:33 smithi081 podman[91155]: 2024-05-03 17:05:33.846218786 +0000 UTC m=+0.441108468 container start 7922dd2fb3804eb6dab44a490fd7e9cd98ceb367d25ad0cd6ba3472edbfd4652 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T17:05:34.240 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 17:05:33 smithi081 podman[91155]: 2024-05-03 17:05:33.925956716 +0000 UTC m=+0.520846428 container attach 7922dd2fb3804eb6dab44a490fd7e9cd98ceb367d25ad0cd6ba3472edbfd4652 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240430, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS) 2024-05-03T17:05:34.628 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 03 17:05:34 smithi081 podman[91155]: 2024-05-03 17:05:34.315572751 +0000 UTC m=+0.910462426 container died 7922dd2fb3804eb6dab44a490fd7e9cd98ceb367d25ad0cd6ba3472edbfd4652 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-05-03T17:05:35.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.0.service' 2024-05-03T17:05:35.147 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:05:35.147 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-03T17:05:35.147 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-03T17:05:35.147 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.1 2024-05-03T17:05:35.675 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 17:05:35 smithi134 systemd[1]: Stopping Ceph osd.1 for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:05:35.966 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 17:05:35 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-1[36306]: 2024-05-03T17:05:35.672+0000 7fcdafc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:05:35.967 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 17:05:35 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-1[36306]: 2024-05-03T17:05:35.672+0000 7fcdafc00700 -1 osd.1 95 *** Got signal Terminated *** 2024-05-03T17:05:35.967 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 17:05:35 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-1[36306]: 2024-05-03T17:05:35.672+0000 7fcdafc00700 -1 osd.1 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T17:05:41.466 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 17:05:41 smithi134 podman[67548]: 2024-05-03 17:05:41.188128318 +0000 UTC m=+5.660175700 container died 2a262ba720922089312467140ff0ff17863569a0b450d4259e9d0b5f710ff000 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-1, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=) 2024-05-03T17:05:41.869 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 17:05:41 smithi134 podman[67548]: 2024-05-03 17:05:41.634229798 +0000 UTC m=+6.106277243 container cleanup 2a262ba720922089312467140ff0ff17863569a0b450d4259e9d0b5f710ff000 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-1, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T17:05:41.869 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 17:05:41 smithi134 bash[67548]: ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-1 2024-05-03T17:05:42.216 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 17:05:41 smithi134 podman[67565]: 2024-05-03 17:05:41.868785629 +0000 UTC m=+0.668650952 container remove 2a262ba720922089312467140ff0ff17863569a0b450d4259e9d0b5f710ff000 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-1, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430) 2024-05-03T17:05:42.929 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 17:05:42 smithi134 podman[67666]: 2024-05-03 17:05:42.495347323 +0000 UTC m=+0.030317442 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T17:05:42.929 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 17:05:42 smithi134 podman[67666]: 2024-05-03 17:05:42.636873544 +0000 UTC m=+0.171843670 container create b5de7728754101a3e054a82502fe956a15b77afab70b8124d90eb218e69c88c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-1-deactivate, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-03T17:05:42.929 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 17:05:42 smithi134 podman[67666]: 2024-05-03 17:05:42.927713304 +0000 UTC m=+0.462683461 container init b5de7728754101a3e054a82502fe956a15b77afab70b8124d90eb218e69c88c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-03T17:05:43.216 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 17:05:42 smithi134 podman[67666]: 2024-05-03 17:05:42.937768006 +0000 UTC m=+0.472738133 container start b5de7728754101a3e054a82502fe956a15b77afab70b8124d90eb218e69c88c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-05-03T17:05:43.216 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 17:05:43 smithi134 podman[67666]: 2024-05-03 17:05:43.048987364 +0000 UTC m=+0.583957562 container attach b5de7728754101a3e054a82502fe956a15b77afab70b8124d90eb218e69c88c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T17:05:43.716 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 03 17:05:43 smithi134 podman[67693]: 2024-05-03 17:05:43.398508557 +0000 UTC m=+0.030069306 container died b5de7728754101a3e054a82502fe956a15b77afab70b8124d90eb218e69c88c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T17:05:44.130 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.1.service' 2024-05-03T17:05:44.245 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:05:44.246 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-03T17:05:44.246 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-03T17:05:44.246 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.2 2024-05-03T17:05:44.810 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 17:05:44 smithi146 systemd[1]: Stopping Ceph osd.2 for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:05:45.062 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 17:05:44 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-2[37362]: 2024-05-03T17:05:44.808+0000 7f1261200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:05:45.062 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 17:05:44 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-2[37362]: 2024-05-03T17:05:44.808+0000 7f1261200700 -1 osd.2 95 *** Got signal Terminated *** 2024-05-03T17:05:45.063 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 17:05:44 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-2[37362]: 2024-05-03T17:05:44.808+0000 7f1261200700 -1 osd.2 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T17:05:50.562 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 17:05:50 smithi146 podman[68612]: 2024-05-03 17:05:50.211016506 +0000 UTC m=+5.526501854 container died 9565413ef2409d9b613fac565c7f8c782156c6edcac88efb6594e868abf60f55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux ) 2024-05-03T17:05:50.965 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 17:05:50 smithi146 podman[68612]: 2024-05-03 17:05:50.753682589 +0000 UTC m=+6.069167964 container cleanup 9565413ef2409d9b613fac565c7f8c782156c6edcac88efb6594e868abf60f55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_CLEAN=True, ceph=True) 2024-05-03T17:05:50.965 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 17:05:50 smithi146 bash[68612]: ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-2 2024-05-03T17:05:51.312 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 17:05:50 smithi146 podman[68642]: 2024-05-03 17:05:50.963507958 +0000 UTC m=+0.740324899 container remove 9565413ef2409d9b613fac565c7f8c782156c6edcac88efb6594e868abf60f55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5) 2024-05-03T17:05:52.035 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 17:05:51 smithi146 podman[68730]: 2024-05-03 17:05:51.683114749 +0000 UTC m=+0.034767496 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T17:05:52.035 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 17:05:51 smithi146 podman[68730]: 2024-05-03 17:05:51.856313216 +0000 UTC m=+0.207965995 container create 9dc85ccda6741ef965964c2599e045db3cfae434af6d02f0f6d13d99e317ba0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T17:05:52.562 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 17:05:52 smithi146 podman[68730]: 2024-05-03 17:05:52.21117033 +0000 UTC m=+0.562823129 container init 9dc85ccda6741ef965964c2599e045db3cfae434af6d02f0f6d13d99e317ba0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-03T17:05:52.562 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 17:05:52 smithi146 podman[68730]: 2024-05-03 17:05:52.224266475 +0000 UTC m=+0.575919224 container start 9dc85ccda6741ef965964c2599e045db3cfae434af6d02f0f6d13d99e317ba0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-2-deactivate, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-03T17:05:52.562 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 17:05:52 smithi146 podman[68730]: 2024-05-03 17:05:52.333950849 +0000 UTC m=+0.685603658 container attach 9dc85ccda6741ef965964c2599e045db3cfae434af6d02f0f6d13d99e317ba0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-03T17:05:53.060 INFO:journalctl@ceph.osd.2.smithi146.stdout:May 03 17:05:52 smithi146 podman[68730]: 2024-05-03 17:05:52.681820026 +0000 UTC m=+1.033472811 container died 9dc85ccda6741ef965964c2599e045db3cfae434af6d02f0f6d13d99e317ba0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_CLEAN=True) 2024-05-03T17:05:53.548 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.2.service' 2024-05-03T17:05:53.662 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:05:53.662 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-03T17:05:53.663 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-03T17:05:53.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.3 2024-05-03T17:05:53.812 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:05:53 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:05:53.572+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:05:53.990 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:05:53 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3[47677]: 2024-05-03T17:05:53.625+0000 7f6897e00700 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:26.776081+0000 front 2024-05-03T17:05:26.776473+0000 (oldest deadline 2024-05-03T17:05:52.676153+0000) 2024-05-03T17:05:53.990 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:05:53 smithi081 systemd[1]: Stopping Ceph osd.3 for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:05:54.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:05:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:05:54.020+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:05:54.603 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:05:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3[47677]: 2024-05-03T17:05:54.296+0000 7f68a1600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:05:54.604 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:05:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3[47677]: 2024-05-03T17:05:54.296+0000 7f68a1600700 -1 osd.3 95 *** Got signal Terminated *** 2024-05-03T17:05:54.604 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:05:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3[47677]: 2024-05-03T17:05:54.296+0000 7f68a1600700 -1 osd.3 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T17:05:54.604 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:05:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3[47677]: 2024-05-03T17:05:54.601+0000 7f6897e00700 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:26.776081+0000 front 2024-05-03T17:05:26.776473+0000 (oldest deadline 2024-05-03T17:05:52.676153+0000) 2024-05-03T17:05:54.811 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:05:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:05:54.527+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:05:54.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:05:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:05:54.658+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:05:55.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:05:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:05:54.983+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:05:55.489 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:05:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:05:54.993+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:05:55.812 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:05:55 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:05:55.536+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:05:55.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:05:55 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:05:55.652+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:05:55.951 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:05:55 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3[47677]: 2024-05-03T17:05:55.569+0000 7f6897e00700 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:26.776081+0000 front 2024-05-03T17:05:26.776473+0000 (oldest deadline 2024-05-03T17:05:52.676153+0000) 2024-05-03T17:05:56.216 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:05:55 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:05:55.959+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:05:56.239 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:05:55 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:05:55.949+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:05:56.812 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:05:56 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:05:56.531+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:05:56.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:05:56 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:05:56.664+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:05:56.971 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:05:56 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3[47677]: 2024-05-03T17:05:56.560+0000 7f6897e00700 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:26.776081+0000 front 2024-05-03T17:05:26.776473+0000 (oldest deadline 2024-05-03T17:05:52.676153+0000) 2024-05-03T17:05:57.240 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:05:56 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:05:56.969+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:05:57.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:05:56 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:05:56.995+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:05:57.812 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:05:57 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:05:57.560+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:05:57.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:05:57 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:05:57.633+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:05:57.972 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:05:57 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3[47677]: 2024-05-03T17:05:57.522+0000 7f6897e00700 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:26.776081+0000 front 2024-05-03T17:05:26.776473+0000 (oldest deadline 2024-05-03T17:05:52.676153+0000) 2024-05-03T17:05:58.239 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:05:57 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:05:57.971+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:05:58.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:05:58 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:05:58.032+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:05:58.740 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:05:58 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3[47677]: 2024-05-03T17:05:58.474+0000 7f6897e00700 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:26.776081+0000 front 2024-05-03T17:05:26.776473+0000 (oldest deadline 2024-05-03T17:05:52.676153+0000) 2024-05-03T17:05:59.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:05:58 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:05:58.581+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:05:59.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:05:58 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:05:58.665+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:05:59.240 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:05:58 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:05:58.963+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:05:59.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:05:59 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:05:59.043+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:05:59.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:05:59 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:05:59.936+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:05:59.990 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:05:59 smithi081 podman[91276]: 2024-05-03 17:05:59.731291077 +0000 UTC m=+5.629604410 container died b75de4959980b52323c6d7c3ac6dd2f4c916edcd14754b02f285390d99a19a3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T17:06:00.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:05:59 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:05:59.690+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:00.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:05:59 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:05:59.588+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:06:00.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:00 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:00.073+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:00.486 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:06:00 smithi081 podman[91276]: 2024-05-03 17:06:00.199964317 +0000 UTC m=+6.098277679 container cleanup b75de4959980b52323c6d7c3ac6dd2f4c916edcd14754b02f285390d99a19a3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-03T17:06:00.486 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:06:00 smithi081 bash[91276]: ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3 2024-05-03T17:06:00.740 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:06:00 smithi081 podman[91296]: 2024-05-03 17:06:00.484648129 +0000 UTC m=+0.737892819 container remove b75de4959980b52323c6d7c3ac6dd2f4c916edcd14754b02f285390d99a19a3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-03T17:06:01.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:00 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:00.583+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:06:01.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:00 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:00.658+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:01.239 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:00 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:00.968+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:01.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:01 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:01.111+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:01.718 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:06:01 smithi081 podman[91382]: 2024-05-03 17:06:01.238300906 +0000 UTC m=+0.033116469 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T17:06:01.718 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:06:01 smithi081 podman[91382]: 2024-05-03 17:06:01.352381182 +0000 UTC m=+0.147196782 container create 66d7278043b54e9f8bebd754541dae2b639a1a1188cd5b64621629a233521a29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T17:06:01.718 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:06:01 smithi081 podman[91382]: 2024-05-03 17:06:01.715841331 +0000 UTC m=+0.510656938 container init 66d7278043b54e9f8bebd754541dae2b639a1a1188cd5b64621629a233521a29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5) 2024-05-03T17:06:01.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:01 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:01.959+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:01.990 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:06:01 smithi081 podman[91382]: 2024-05-03 17:06:01.727963661 +0000 UTC m=+0.522779294 container start 66d7278043b54e9f8bebd754541dae2b639a1a1188cd5b64621629a233521a29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T17:06:01.990 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:06:01 smithi081 podman[91382]: 2024-05-03 17:06:01.805639297 +0000 UTC m=+0.600454877 container attach 66d7278043b54e9f8bebd754541dae2b639a1a1188cd5b64621629a233521a29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-03T17:06:02.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:01 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:01.575+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:06:02.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:01 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:01.682+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:02.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:02 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:02.137+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:02.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:01 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:01.971+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:02.490 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 03 17:06:02 smithi081 podman[91382]: 2024-05-03 17:06:02.181634938 +0000 UTC m=+0.976450568 container died 66d7278043b54e9f8bebd754541dae2b639a1a1188cd5b64621629a233521a29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-03T17:06:02.491 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:02 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:02.267+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:02.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.3.service' 2024-05-03T17:06:03.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:02 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:02.618+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:06:03.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:02 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:02.649+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:03.079 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:06:03.079 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-03T17:06:03.079 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-03T17:06:03.080 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.4 2024-05-03T17:06:03.239 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:02 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:02.977+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:03.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:02 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:02.993+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:03.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:03 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:03.093+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:03.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:03 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:03.093+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:03.467 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:03 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-4[42940]: 2024-05-03T17:06:03.054+0000 7f0267200700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.002556+0000 front 2024-05-03T17:05:40.002617+0000 (oldest deadline 2024-05-03T17:06:02.302571+0000) 2024-05-03T17:06:03.467 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:03 smithi134 systemd[1]: Stopping Ceph osd.4 for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:06:03.740 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:03 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:03.280+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:03.966 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:03 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-4[42940]: 2024-05-03T17:06:03.663+0000 7f026ba00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:06:03.966 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:03 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-4[42940]: 2024-05-03T17:06:03.663+0000 7f026ba00700 -1 osd.4 95 *** Got signal Terminated *** 2024-05-03T17:06:03.967 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:03 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-4[42940]: 2024-05-03T17:06:03.663+0000 7f026ba00700 -1 osd.4 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T17:06:04.021 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:03 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:03.656+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:06:04.022 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:03 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:03.658+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:04.240 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:03 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:03.971+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:04.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:04 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:04.020+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:04.466 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:04 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-4[42940]: 2024-05-03T17:06:04.038+0000 7f0267200700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.002556+0000 front 2024-05-03T17:05:40.002617+0000 (oldest deadline 2024-05-03T17:06:02.302571+0000) 2024-05-03T17:06:04.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:04 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:04.006+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:04.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:04 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:04.090+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:04.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:04 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:04.090+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:04.740 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:04 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:04.271+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:04.984 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:04 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:04.666+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:04.984 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:04 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:04.619+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:06:04.984 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:04 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:04.619+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.287513+0000 front 2024-05-03T17:05:40.287564+0000 (oldest deadline 2024-05-03T17:06:03.787652+0000) 2024-05-03T17:06:05.240 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:05 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:05.000+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:05.240 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:05 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:05.000+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:05.311 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:04 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:04.982+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:05.466 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:05 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-4[42940]: 2024-05-03T17:06:05.033+0000 7f0267200700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.002556+0000 front 2024-05-03T17:05:40.002617+0000 (oldest deadline 2024-05-03T17:06:02.302571+0000) 2024-05-03T17:06:05.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:05 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:05.024+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:05.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:05 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:05.056+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:05.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:05 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:05.056+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:05.651 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:05 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:05.251+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:05.995 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:05 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:05.596+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:06:05.995 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:05 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:05.596+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.287513+0000 front 2024-05-03T17:05:40.287564+0000 (oldest deadline 2024-05-03T17:06:03.787652+0000) 2024-05-03T17:06:05.996 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:05 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:05.630+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:06.248 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:05 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:05.990+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:06.248 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:05 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:05.990+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:06.311 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:05 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:05.994+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:06.466 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:06 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-4[42940]: 2024-05-03T17:06:06.064+0000 7f0267200700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.002556+0000 front 2024-05-03T17:05:40.002617+0000 (oldest deadline 2024-05-03T17:06:02.302571+0000) 2024-05-03T17:06:06.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:06 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:06.019+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:06.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:06 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:06.018+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:06.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:06 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:06.018+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:06.739 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:06 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:06.246+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:07.034 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:06 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:06.636+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:07.034 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:06 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:06.642+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:06:07.034 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:06 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:06.642+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.287513+0000 front 2024-05-03T17:05:40.287564+0000 (oldest deadline 2024-05-03T17:06:03.787652+0000) 2024-05-03T17:06:07.283 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:07 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:07.007+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:07.283 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:07 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:07.007+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:07.311 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:07 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:07.032+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:07.466 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:07 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-4[42940]: 2024-05-03T17:06:07.115+0000 7f0267200700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.002556+0000 front 2024-05-03T17:05:40.002617+0000 (oldest deadline 2024-05-03T17:06:02.302571+0000) 2024-05-03T17:06:07.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:06 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:06.977+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:07.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:07 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:07.035+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:07.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:07 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:07.035+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:07.739 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:07 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:07.281+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:08.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:07 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:07.632+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:08.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:07 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:07.641+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:06:08.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:07 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:07.641+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.287513+0000 front 2024-05-03T17:05:40.287564+0000 (oldest deadline 2024-05-03T17:06:03.787652+0000) 2024-05-03T17:06:08.326 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:08 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:08.036+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:08.326 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:08 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:08.036+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:08.466 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:08 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-4[42940]: 2024-05-03T17:06:08.091+0000 7f0267200700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.002556+0000 front 2024-05-03T17:05:40.002617+0000 (oldest deadline 2024-05-03T17:06:02.302571+0000) 2024-05-03T17:06:08.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:08 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:08.023+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:08.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:08 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:08.033+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:08.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:08 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:08.033+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:08.562 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:08 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:08.082+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:08.739 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:08 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:08.324+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:09.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:08 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:08.596+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:09.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:08 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:08.638+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:06:09.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:08 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:08.638+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.287513+0000 front 2024-05-03T17:05:40.287564+0000 (oldest deadline 2024-05-03T17:06:03.787652+0000) 2024-05-03T17:06:09.281 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:08 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:08.995+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:09.281 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:08 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:08.995+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:09.445 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:09 smithi134 podman[67771]: 2024-05-03 17:06:09.116275385 +0000 UTC m=+5.605248317 container died 37f9a92980a1282945b5d1da0d6fe098a5bea65683be0f3ac22616ca3767de65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-4, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-05-03T17:06:09.446 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:09 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:09.068+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:09.446 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:09 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:09.072+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:09.446 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:09 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:09.072+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:09.562 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:09 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:09.125+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:09.716 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:09 smithi134 podman[67771]: 2024-05-03 17:06:09.572961415 +0000 UTC m=+6.061934376 container cleanup 37f9a92980a1282945b5d1da0d6fe098a5bea65683be0f3ac22616ca3767de65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-4, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T17:06:09.716 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:09 smithi134 bash[67771]: ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-4 2024-05-03T17:06:09.739 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:09 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:09.279+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:10.029 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:09 smithi134 podman[67791]: 2024-05-03 17:06:09.791241196 +0000 UTC m=+0.656996680 container remove 37f9a92980a1282945b5d1da0d6fe098a5bea65683be0f3ac22616ca3767de65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-4, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T17:06:10.061 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:09 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:09.618+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:10.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:09 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:09.672+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:06:10.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:09 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:09.672+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.287513+0000 front 2024-05-03T17:05:40.287564+0000 (oldest deadline 2024-05-03T17:06:03.787652+0000) 2024-05-03T17:06:10.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:10 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:10.092+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:10.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:10 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:10.027+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:10.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:10 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:10.027+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:10.489 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:10 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:10.034+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:10.489 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:10 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:10.034+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:10.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:10 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:10.259+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:10.561 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:10 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:10.142+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:10.966 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:10 smithi134 podman[67883]: 2024-05-03 17:06:10.584639701 +0000 UTC m=+0.038310717 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T17:06:10.967 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:10 smithi134 podman[67883]: 2024-05-03 17:06:10.70034817 +0000 UTC m=+0.154019217 container create 193315c20511513d34a3699f30b61c726f188dc432d9be2b18c3e8a41853813a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-03T17:06:11.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:10 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:10.590+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:11.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:10 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:10.693+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:06:11.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:10 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:10.693+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.287513+0000 front 2024-05-03T17:05:40.287564+0000 (oldest deadline 2024-05-03T17:06:03.787652+0000) 2024-05-03T17:06:11.450 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:11 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:11.043+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:11.450 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:11 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:11.043+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:11.450 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:11 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:11.043+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:11.451 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:10 smithi134 podman[67883]: 2024-05-03 17:06:10.99620057 +0000 UTC m=+0.449871661 container init 193315c20511513d34a3699f30b61c726f188dc432d9be2b18c3e8a41853813a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-03T17:06:11.451 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:11 smithi134 podman[67883]: 2024-05-03 17:06:11.007371095 +0000 UTC m=+0.461042172 container start 193315c20511513d34a3699f30b61c726f188dc432d9be2b18c3e8a41853813a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-03T17:06:11.451 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:11 smithi134 podman[67883]: 2024-05-03 17:06:11.111889909 +0000 UTC m=+0.565560992 container attach 193315c20511513d34a3699f30b61c726f188dc432d9be2b18c3e8a41853813a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430) 2024-05-03T17:06:11.451 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:11 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:11.068+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:11.489 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:11 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:11.263+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:11.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:11 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:11.037+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:11.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:11 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:11.037+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:11.561 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:11 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:11.148+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:11.562 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:11 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:11.148+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:11.716 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 03 17:06:11 smithi134 podman[67883]: 2024-05-03 17:06:11.450416167 +0000 UTC m=+0.904087214 container died 193315c20511513d34a3699f30b61c726f188dc432d9be2b18c3e8a41853813a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430) 2024-05-03T17:06:12.061 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:11 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:11.624+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:12.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:11 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:11.665+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:06:12.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:11 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:11.665+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.287513+0000 front 2024-05-03T17:05:40.287564+0000 (oldest deadline 2024-05-03T17:06:03.787652+0000) 2024-05-03T17:06:12.108 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:12 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:12.032+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:12.108 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:12 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:12.032+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:12.108 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:12 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:12.032+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:12.211 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.4.service' 2024-05-03T17:06:12.301 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:06:12.301 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-03T17:06:12.301 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-03T17:06:12.301 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.5 2024-05-03T17:06:12.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:12 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:12.107+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:12.489 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:12 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:12.222+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:12.489 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:12 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:12.036+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:12.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:12 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:12.036+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:12.561 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:12 smithi146 systemd[1]: Stopping Ceph osd.5 for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:06:12.562 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:12 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:12.167+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:12.562 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:12 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:12.167+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:12.898 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:12 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:12.625+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:06:12.898 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:12 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:12.625+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.287513+0000 front 2024-05-03T17:05:40.287564+0000 (oldest deadline 2024-05-03T17:06:03.787652+0000) 2024-05-03T17:06:12.898 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:12 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:12.600+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:12.898 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:12 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:12.600+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:13.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:13 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:13.145+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:13.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:13 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:13.145+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:13.312 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:12 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:12.896+0000 7f71f8400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:06:13.313 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:12 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:12.896+0000 7f71f8400700 -1 osd.5 95 *** Got signal Terminated *** 2024-05-03T17:06:13.313 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:12 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:12.896+0000 7f71f8400700 -1 osd.5 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T17:06:13.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:13 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:13.129+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:13.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:13 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:13.129+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:13.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:13 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:13.044+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:13.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:13 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:13.044+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:13.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:13 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:13.044+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:13.489 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:13 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:13.201+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:13.489 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:13 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:13.024+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:13.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:13 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:13.024+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:14.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:13 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:13.629+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:14.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:13 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:13.629+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:14.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:13 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:13.611+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:06:14.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:13 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:13.611+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.287513+0000 front 2024-05-03T17:05:40.287564+0000 (oldest deadline 2024-05-03T17:06:03.787652+0000) 2024-05-03T17:06:14.063 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:13 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:13.611+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.689619+0000 front 2024-05-03T17:05:49.689562+0000 (oldest deadline 2024-05-03T17:06:13.189847+0000) 2024-05-03T17:06:14.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:14 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:14.083+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:14.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:14 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:14.084+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:14.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:14 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:14.071+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:14.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:14 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:14.071+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:14.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:14 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:14.071+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:14.489 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:14 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:14.186+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:14.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:14 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:14.073+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:14.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:14 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:14.073+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:14.562 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:14 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:14.106+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:14.562 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:14 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:14.106+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:15.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:14 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:14.574+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:06:15.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:14 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:14.575+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.287513+0000 front 2024-05-03T17:05:40.287564+0000 (oldest deadline 2024-05-03T17:06:03.787652+0000) 2024-05-03T17:06:15.062 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:14 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:14.575+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.689619+0000 front 2024-05-03T17:05:49.689562+0000 (oldest deadline 2024-05-03T17:06:13.189847+0000) 2024-05-03T17:06:15.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:14 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:14.587+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:15.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:14 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:14.587+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:15.392 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:15 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:15.089+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:15.392 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:15 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:15.089+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:15.392 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:15 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:15.089+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:15.392 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:15 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:15.203+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:15.393 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:15 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:15.203+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.387452+0000 front 2024-05-03T17:05:49.387832+0000 (oldest deadline 2024-05-03T17:06:14.687255+0000) 2024-05-03T17:06:15.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:15 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:15.082+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:15.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:15 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:15.082+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:15.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:15 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:15.078+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:15.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:15 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:15.078+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:15.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:15 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:15.078+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:15.536 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:15 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:15.098+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:15.536 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:15 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:15.098+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:15.811 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:15 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:15.621+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:15.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:15 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:15.621+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:15.812 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:15 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:15.535+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:06:15.812 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:15 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:15.535+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.287513+0000 front 2024-05-03T17:05:40.287564+0000 (oldest deadline 2024-05-03T17:06:03.787652+0000) 2024-05-03T17:06:15.812 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:15 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:15.535+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.689619+0000 front 2024-05-03T17:05:49.689562+0000 (oldest deadline 2024-05-03T17:06:13.189847+0000) 2024-05-03T17:06:16.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:16 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:16.117+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:16.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:16 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:16.117+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:16.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:16 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:16.098+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:16.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:16 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:16.098+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:16.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:16 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:16.098+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:16.489 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:16 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:16.177+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:16.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:16 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:16.177+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.387452+0000 front 2024-05-03T17:05:49.387832+0000 (oldest deadline 2024-05-03T17:06:14.687255+0000) 2024-05-03T17:06:16.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:16 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:16.060+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:16.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:16 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:16.060+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:16.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:16 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:16.060+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:16.562 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:16 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:16.081+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:16.562 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:16 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:16.081+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:17.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:16 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:16.643+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:17.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:16 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:16.643+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:17.063 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:16 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:16.570+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:06:17.063 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:16 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:16.570+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.287513+0000 front 2024-05-03T17:05:40.287564+0000 (oldest deadline 2024-05-03T17:06:03.787652+0000) 2024-05-03T17:06:17.063 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:16 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:16.570+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.689619+0000 front 2024-05-03T17:05:49.689562+0000 (oldest deadline 2024-05-03T17:06:13.189847+0000) 2024-05-03T17:06:17.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:17 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:17.151+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:17.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:17 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:17.151+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:17.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:17 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:17.132+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:17.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:17 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:17.132+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:17.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:17 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:17.132+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:17.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:17 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:17.203+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:17.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:17 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:17.203+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.387452+0000 front 2024-05-03T17:05:49.387832+0000 (oldest deadline 2024-05-03T17:06:14.687255+0000) 2024-05-03T17:06:17.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:17 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:17.077+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:17.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:17 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:17.077+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:17.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:17 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:17.077+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:17.538 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:17 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:17.086+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:17.538 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:17 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:17.086+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:17.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:17 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:17.595+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:17.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:17 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:17.595+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:17.812 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:17 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:17.537+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.082967+0000 front 2024-05-03T17:05:31.083551+0000 (oldest deadline 2024-05-03T17:05:53.382855+0000) 2024-05-03T17:06:17.812 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:17 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:17.537+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:40.287513+0000 front 2024-05-03T17:05:40.287564+0000 (oldest deadline 2024-05-03T17:06:03.787652+0000) 2024-05-03T17:06:17.812 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:17 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5[43941]: 2024-05-03T17:06:17.537+0000 7f71eec00700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.689619+0000 front 2024-05-03T17:05:49.689562+0000 (oldest deadline 2024-05-03T17:06:13.189847+0000) 2024-05-03T17:06:18.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:18 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:18.159+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:18.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:18 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:18.159+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:18.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:18 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:18.172+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:18.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:18 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:18.172+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:18.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:18 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:18.172+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:18.478 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:18 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:18.106+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:18.478 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:18 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:18.106+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:18.489 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:18 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:18.213+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:18.489 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:18 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:18.213+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.387452+0000 front 2024-05-03T17:05:49.387832+0000 (oldest deadline 2024-05-03T17:06:14.687255+0000) 2024-05-03T17:06:18.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:18 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:18.036+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:18.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:18 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:18.036+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:18.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:18 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:18.036+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:18.812 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:18 smithi146 podman[68838]: 2024-05-03 17:06:18.478237389 +0000 UTC m=+5.763359905 container died dc6cc5816e85923f4c8d8ca339e91be79e6a9723bd2a29c565ede1ee7b01a335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-05-03T17:06:18.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:18 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:18.570+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:18.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:18 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:18.570+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:19.137 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:19 smithi146 podman[68838]: 2024-05-03 17:06:19.073699349 +0000 UTC m=+6.358821906 container cleanup dc6cc5816e85923f4c8d8ca339e91be79e6a9723bd2a29c565ede1ee7b01a335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True) 2024-05-03T17:06:19.137 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:19 smithi146 bash[68838]: ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5 2024-05-03T17:06:19.442 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:19 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:19.135+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:19.442 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:19 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:19.135+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:19.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:19 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:19.146+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:19.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:19 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:19.146+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:19.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:19 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:19.144+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:19.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:19 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:19.144+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:19.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:19 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:19.144+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:19.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:19 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:19.178+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:19.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:19 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:19.178+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.387452+0000 front 2024-05-03T17:05:49.387832+0000 (oldest deadline 2024-05-03T17:06:14.687255+0000) 2024-05-03T17:06:19.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:19 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:19.069+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:19.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:19 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:19.069+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:19.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:19 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:19.069+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:19.811 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:19 smithi146 podman[68856]: 2024-05-03 17:06:19.441612227 +0000 UTC m=+0.951821190 container remove dc6cc5816e85923f4c8d8ca339e91be79e6a9723bd2a29c565ede1ee7b01a335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T17:06:19.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:19 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:19.531+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:19.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:19 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:19.531+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:20.343 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:20 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:20.090+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:20.343 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:20 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:20.090+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:20.344 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:20 smithi146 podman[68945]: 2024-05-03 17:06:20.028988551 +0000 UTC m=+0.035968104 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T17:06:20.344 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:20 smithi146 podman[68945]: 2024-05-03 17:06:20.184350163 +0000 UTC m=+0.191329805 container create 7c45ac314d3eb93c94cf78ff490410d35adb6f0fe70dd831617da52f5dd25e35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-03T17:06:20.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:20 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:20.192+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:20.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:20 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:20.192+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:20.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:20 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:20.147+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:20.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:20 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:20.147+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:20.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:20 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:20.147+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:20.489 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:20 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:20.227+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:20.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:20 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:20.227+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.387452+0000 front 2024-05-03T17:05:49.387832+0000 (oldest deadline 2024-05-03T17:06:14.687255+0000) 2024-05-03T17:06:20.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:20 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:20.227+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.389137+0000 front 2024-05-03T17:05:56.389204+0000 (oldest deadline 2024-05-03T17:06:19.889529+0000) 2024-05-03T17:06:20.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:20 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:20.046+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:20.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:20 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:20.046+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:20.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:20 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:20.046+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:20.604 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:20 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:20.505+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:20.604 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:20 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:20.505+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:20.604 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:20 smithi146 podman[68945]: 2024-05-03 17:06:20.506548157 +0000 UTC m=+0.513527752 container init 7c45ac314d3eb93c94cf78ff490410d35adb6f0fe70dd831617da52f5dd25e35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5-deactivate, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T17:06:20.604 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:20 smithi146 podman[68945]: 2024-05-03 17:06:20.518430567 +0000 UTC m=+0.525410162 container start 7c45ac314d3eb93c94cf78ff490410d35adb6f0fe70dd831617da52f5dd25e35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T17:06:20.604 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:20 smithi146 podman[68945]: 2024-05-03 17:06:20.603335814 +0000 UTC m=+0.610315382 container attach 7c45ac314d3eb93c94cf78ff490410d35adb6f0fe70dd831617da52f5dd25e35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430) 2024-05-03T17:06:21.312 INFO:journalctl@ceph.osd.5.smithi146.stdout:May 03 17:06:20 smithi146 podman[68945]: 2024-05-03 17:06:20.976373229 +0000 UTC m=+0.983352841 container died 7c45ac314d3eb93c94cf78ff490410d35adb6f0fe70dd831617da52f5dd25e35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T17:06:21.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:21 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:21.047+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:21.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:21 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:21.047+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:21.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:21 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:21.187+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:21.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:21 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:21.187+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:21.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:21 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:21.187+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:54.327170+0000 front 2024-05-03T17:05:54.326892+0000 (oldest deadline 2024-05-03T17:06:20.226641+0000) 2024-05-03T17:06:21.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:21 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:21.145+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:21.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:21 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:21.145+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:21.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:21 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:21.145+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:21.489 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:21 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:21.272+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:21.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:21 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:21.272+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.387452+0000 front 2024-05-03T17:05:49.387832+0000 (oldest deadline 2024-05-03T17:06:14.687255+0000) 2024-05-03T17:06:21.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:21 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:21.272+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.389137+0000 front 2024-05-03T17:05:56.389204+0000 (oldest deadline 2024-05-03T17:06:19.889529+0000) 2024-05-03T17:06:21.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:21 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:21.075+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:21.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:21 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:21.075+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:21.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:21 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:21.075+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:21.808 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:21 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:21.501+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:21.808 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:21 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:21.501+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:21.857 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.5.service' 2024-05-03T17:06:21.968 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:06:21.968 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-03T17:06:21.969 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-03T17:06:21.969 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.6 2024-05-03T17:06:22.062 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:22 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:22.055+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:22.062 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:22 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:22.055+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:22.063 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:22 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:22.055+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:22.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:22 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:22.171+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:22.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:22 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:22.171+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:22.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:22 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:22.171+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:54.327170+0000 front 2024-05-03T17:05:54.326892+0000 (oldest deadline 2024-05-03T17:06:20.226641+0000) 2024-05-03T17:06:22.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:22 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:22.166+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:22.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:22 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:22.166+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:22.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:22 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:22.166+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:22.489 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:22 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:22.074+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:22.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:22 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:22.074+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:22.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:22 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:22.074+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:22.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:22 smithi081 systemd[1]: Stopping Ceph osd.6 for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:06:22.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:22 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:22.276+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:22.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:22 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:22.276+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.387452+0000 front 2024-05-03T17:05:49.387832+0000 (oldest deadline 2024-05-03T17:06:14.687255+0000) 2024-05-03T17:06:22.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:22 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:22.276+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.389137+0000 front 2024-05-03T17:05:56.389204+0000 (oldest deadline 2024-05-03T17:06:19.889529+0000) 2024-05-03T17:06:22.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:22 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:22.529+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:22.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:22 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:22.529+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:22.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:22 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:22.529+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:22.990 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:22 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:22.527+0000 7fe382a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:06:22.990 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:22 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:22.527+0000 7fe382a00700 -1 osd.6 95 *** Got signal Terminated *** 2024-05-03T17:06:22.990 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:22 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:22.527+0000 7fe382a00700 -1 osd.6 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T17:06:23.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:23 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:23.021+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:23.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:23 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:23.021+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:23.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:23 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:23.021+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:23.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:23 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:23.213+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:23.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:23 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:23.213+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:23.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:23 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:23.213+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:54.327170+0000 front 2024-05-03T17:05:54.326892+0000 (oldest deadline 2024-05-03T17:06:20.226641+0000) 2024-05-03T17:06:23.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:23 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:23.185+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:23.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:23 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:23.185+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:23.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:23 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:23.185+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:23.489 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:23 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:23.241+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:23.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:23 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:23.241+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.387452+0000 front 2024-05-03T17:05:49.387832+0000 (oldest deadline 2024-05-03T17:06:14.687255+0000) 2024-05-03T17:06:23.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:23 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:23.241+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.389137+0000 front 2024-05-03T17:05:56.389204+0000 (oldest deadline 2024-05-03T17:06:19.889529+0000) 2024-05-03T17:06:23.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:23 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:23.046+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:23.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:23 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:23.046+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:23.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:23 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:23.046+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:23.667 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:23 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:23.573+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:23.668 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:23 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:23.573+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:23.668 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:23 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:23.573+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:24.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:24 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:24.003+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:24.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:24 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:24.003+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:24.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:24 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:24.003+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:24.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:24 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:24.185+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:24.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:24 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:24.185+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:24.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:24 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:24.185+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:24.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:24 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:24.223+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:24.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:24 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:24.223+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:24.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:24 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:24.223+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:54.327170+0000 front 2024-05-03T17:05:54.326892+0000 (oldest deadline 2024-05-03T17:06:20.226641+0000) 2024-05-03T17:06:24.489 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:24 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:24.208+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:24.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:24 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:24.208+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.387452+0000 front 2024-05-03T17:05:49.387832+0000 (oldest deadline 2024-05-03T17:06:14.687255+0000) 2024-05-03T17:06:24.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:24 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:24.208+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.389137+0000 front 2024-05-03T17:05:56.389204+0000 (oldest deadline 2024-05-03T17:06:19.889529+0000) 2024-05-03T17:06:24.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:24 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:24.030+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:24.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:24 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:24.030+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:24.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:24 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:24.030+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:24.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:24 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:24.552+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:24.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:24 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:24.552+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:24.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:24 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:24.552+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:25.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:25 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:25.052+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:25.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:25 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:25.052+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:25.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:25 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:25.052+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:25.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:25 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:25.263+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:25.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:25 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:25.263+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:25.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:25 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:25.263+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:54.327170+0000 front 2024-05-03T17:05:54.326892+0000 (oldest deadline 2024-05-03T17:06:20.226641+0000) 2024-05-03T17:06:25.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:25 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:25.199+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:25.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:25 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:25.199+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:25.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:25 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:25.199+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:25.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:25 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:25.234+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:25.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:25 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:25.234+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.387452+0000 front 2024-05-03T17:05:49.387832+0000 (oldest deadline 2024-05-03T17:06:14.687255+0000) 2024-05-03T17:06:25.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:25 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:25.234+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.389137+0000 front 2024-05-03T17:05:56.389204+0000 (oldest deadline 2024-05-03T17:06:19.889529+0000) 2024-05-03T17:06:25.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:25 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:25.052+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:25.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:25 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:25.052+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:25.491 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:25 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:25.052+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:25.491 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:25 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:25.052+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:25.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:25 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:25.558+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:25.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:25 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:25.558+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:25.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:25 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:25.558+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:26.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:26 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:26.032+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:26.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:26 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:26.032+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:26.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:26 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:26.032+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:26.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:26 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:26.303+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:26.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:26 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:26.303+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:26.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:26 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:26.303+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:54.327170+0000 front 2024-05-03T17:05:54.326892+0000 (oldest deadline 2024-05-03T17:06:20.226641+0000) 2024-05-03T17:06:26.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:26 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:26.193+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:26.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:26 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:26.193+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:26.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:26 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:26.193+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:26.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:26 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:26.193+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:26.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:26 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:26.198+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:26.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:26 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:26.198+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.387452+0000 front 2024-05-03T17:05:49.387832+0000 (oldest deadline 2024-05-03T17:06:14.687255+0000) 2024-05-03T17:06:26.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:26 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:26.198+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.389137+0000 front 2024-05-03T17:05:56.389204+0000 (oldest deadline 2024-05-03T17:06:19.889529+0000) 2024-05-03T17:06:26.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:26 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:26.025+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:26.491 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:26 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:26.025+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:26.491 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:26 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:26.025+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:26.491 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:26 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:26.025+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:26.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:26 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:26.518+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:26.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:26 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:26.518+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:26.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:26 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:26.518+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:27.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:27 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:27.041+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:27.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:27 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:27.041+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:27.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:27 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:27.041+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:27.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:27 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:27.205+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.582410+0000 front 2024-05-03T17:05:36.582461+0000 (oldest deadline 2024-05-03T17:06:01.282756+0000) 2024-05-03T17:06:27.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:27 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:27.205+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.387452+0000 front 2024-05-03T17:05:49.387832+0000 (oldest deadline 2024-05-03T17:06:14.687255+0000) 2024-05-03T17:06:27.490 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:27 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6[54579]: 2024-05-03T17:06:27.205+0000 7fe37e200700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.389137+0000 front 2024-05-03T17:05:56.389204+0000 (oldest deadline 2024-05-03T17:06:19.889529+0000) 2024-05-03T17:06:27.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:27 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:27.062+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:27.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:27 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:27.062+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:27.491 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:27 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:27.062+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:27.491 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:27 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:27.062+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:27.716 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:27 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:27.285+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:27.716 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:27 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:27.285+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:27.717 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:27 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:27.285+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:54.327170+0000 front 2024-05-03T17:05:54.326892+0000 (oldest deadline 2024-05-03T17:06:20.226641+0000) 2024-05-03T17:06:27.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:27 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:27.236+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:27.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:27 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:27.236+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:27.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:27 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:27.236+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:27.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:27 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:27.236+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:27.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:27 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:27.471+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:27.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:27 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:27.471+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:27.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:27 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:27.471+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:28.240 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:27 smithi081 podman[91499]: 2024-05-03 17:06:27.942169036 +0000 UTC m=+5.545995815 container died 240f87870c6f5a82ca3b33737b6a2fecb17477e0ea513f62d5d965f1d650d345 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-03T17:06:28.240 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:28 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:28.045+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:28.240 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:28 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:28.045+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:28.241 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:28 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:28.045+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:28.241 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:28 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:28.045+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:28.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:28 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:28.286+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:28.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:28 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:28.286+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:28.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:28 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:28.286+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:54.327170+0000 front 2024-05-03T17:05:54.326892+0000 (oldest deadline 2024-05-03T17:06:20.226641+0000) 2024-05-03T17:06:28.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:28 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:28.203+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:28.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:28 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:28.203+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:28.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:28 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:28.203+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:28.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:28 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:28.203+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:28.475 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:28 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:28.082+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:28.475 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:28 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:28.082+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:28.475 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:28 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:28.082+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:28.664 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:28 smithi081 podman[91499]: 2024-05-03 17:06:28.411965184 +0000 UTC m=+6.015791999 container cleanup 240f87870c6f5a82ca3b33737b6a2fecb17477e0ea513f62d5d965f1d650d345 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T17:06:28.664 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:28 smithi081 bash[91499]: ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6 2024-05-03T17:06:28.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:28 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:28.474+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:28.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:28 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:28.474+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:28.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:28 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:28.474+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:28.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:28 smithi081 podman[91516]: 2024-05-03 17:06:28.663064461 +0000 UTC m=+0.700650468 container remove 240f87870c6f5a82ca3b33737b6a2fecb17477e0ea513f62d5d965f1d650d345 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-03T17:06:29.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:29 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:29.274+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:29.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:29 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:29.274+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:29.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:29 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:29.274+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:54.327170+0000 front 2024-05-03T17:05:54.326892+0000 (oldest deadline 2024-05-03T17:06:20.226641+0000) 2024-05-03T17:06:29.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:29 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:29.196+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:29.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:29 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:29.196+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:29.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:29 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:29.196+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:29.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:29 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:29.196+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:29.488 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:29 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:29.118+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:29.488 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:29 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:29.118+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:29.488 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:29 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:29.118+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:29.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:29 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:29.010+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:29.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:29 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:29.010+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:29.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:29 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:29.010+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:29.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:29 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:29.010+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:29.746 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:29 smithi081 podman[91609]: 2024-05-03 17:06:29.401048753 +0000 UTC m=+0.039396371 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T17:06:29.747 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:29 smithi081 podman[91609]: 2024-05-03 17:06:29.524567626 +0000 UTC m=+0.162915264 container create 4f3e7c6d6c3566780a51f678a1e6f828c12a8381ace4a734a2dfd1240263fdc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, org.label-schema.build-date=20240430, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T17:06:29.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:29 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:29.487+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:29.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:29 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:29.487+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:29.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:29 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:29.487+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:30.018 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:29 smithi081 podman[91609]: 2024-05-03 17:06:29.876233664 +0000 UTC m=+0.514581289 container init 4f3e7c6d6c3566780a51f678a1e6f828c12a8381ace4a734a2dfd1240263fdc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-03T17:06:30.018 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:29 smithi081 podman[91609]: 2024-05-03 17:06:29.887386701 +0000 UTC m=+0.525734353 container start 4f3e7c6d6c3566780a51f678a1e6f828c12a8381ace4a734a2dfd1240263fdc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-03T17:06:30.019 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:30 smithi081 podman[91609]: 2024-05-03 17:06:30.016857622 +0000 UTC m=+0.655205293 container attach 4f3e7c6d6c3566780a51f678a1e6f828c12a8381ace4a734a2dfd1240263fdc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-03T17:06:30.019 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:29 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:29.970+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:30.019 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:29 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:29.970+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:30.019 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:29 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:29.970+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:30.020 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:29 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:29.970+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:30.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:30 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:30.262+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:30.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:30 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:30.262+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:30.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:30 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:30.262+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:54.327170+0000 front 2024-05-03T17:05:54.326892+0000 (oldest deadline 2024-05-03T17:06:20.226641+0000) 2024-05-03T17:06:30.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:30 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:30.262+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:06.128784+0000 front 2024-05-03T17:06:06.128369+0000 (oldest deadline 2024-05-03T17:06:29.628344+0000) 2024-05-03T17:06:30.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:30 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:30.147+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:30.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:30 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:30.147+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:30.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:30 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:30.147+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:30.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:30 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:30.147+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:30.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:30 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:30.147+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:30.477 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:30 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:30.074+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:30.478 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:30 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:30.074+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:30.478 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:30 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:30.074+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:30.694 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 03 17:06:30 smithi081 podman[91609]: 2024-05-03 17:06:30.33964237 +0000 UTC m=+0.977989998 container died 4f3e7c6d6c3566780a51f678a1e6f828c12a8381ace4a734a2dfd1240263fdc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430) 2024-05-03T17:06:30.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:30 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:30.477+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:30.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:30 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:30.477+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:30.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:30 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:30.477+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:30.990 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:30 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:30.939+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:30.990 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:30 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:30.939+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:30.990 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:30 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:30.939+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:30.990 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:30 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:30.939+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:31.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.6.service' 2024-05-03T17:06:31.231 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:06:31.231 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-03T17:06:31.231 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-03T17:06:31.232 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.7 2024-05-03T17:06:31.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:31 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:31.271+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:31.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:31 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:31.271+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:31.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:31 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:31.271+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:54.327170+0000 front 2024-05-03T17:05:54.326892+0000 (oldest deadline 2024-05-03T17:06:20.226641+0000) 2024-05-03T17:06:31.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:31 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:31.271+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:06.128784+0000 front 2024-05-03T17:06:06.128369+0000 (oldest deadline 2024-05-03T17:06:29.628344+0000) 2024-05-03T17:06:31.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:31 smithi134 systemd[1]: Stopping Ceph osd.7 for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:06:31.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:31 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:31.125+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:31.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:31 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:31.125+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:31.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:31 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:31.125+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:31.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:31 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:31.125+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:31.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:31 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:31.125+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:31.488 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:31 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:31.065+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:31.488 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:31 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:31.065+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:31.489 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:31 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:31.065+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:31.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:31 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:31.486+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:31.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:31 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:31.486+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:31.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:31 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:31.486+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:31.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:31 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:31.486+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:32.216 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:31 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:31.842+0000 7f16e7e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:06:32.216 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:31 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:31.843+0000 7f16e7e00700 -1 osd.7 95 *** Got signal Terminated *** 2024-05-03T17:06:32.217 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:31 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:31.843+0000 7f16e7e00700 -1 osd.7 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T17:06:32.217 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:32 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:32.090+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:32.217 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:32 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:32.090+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:32.217 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:32 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:32.090+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:32.217 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:32 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:32.090+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:32.217 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:32 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:32.090+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:32.488 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:32 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:32.060+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:32.488 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:32 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:32.060+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:32.489 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:32 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:32.060+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:32.489 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:32 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:32.060+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.425467+0000 front 2024-05-03T17:06:08.425528+0000 (oldest deadline 2024-05-03T17:06:31.925623+0000) 2024-05-03T17:06:32.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:31 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:31.989+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:32.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:31 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:31.989+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:32.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:31 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:31.989+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:32.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:31 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:31.989+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:32.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:31 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:31.989+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:32.716 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:32 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:32.295+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:32.716 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:32 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:32.295+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:32.716 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:32 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:32.295+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:54.327170+0000 front 2024-05-03T17:05:54.326892+0000 (oldest deadline 2024-05-03T17:06:20.226641+0000) 2024-05-03T17:06:32.717 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:32 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:32.295+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:06.128784+0000 front 2024-05-03T17:06:06.128369+0000 (oldest deadline 2024-05-03T17:06:29.628344+0000) 2024-05-03T17:06:32.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:32 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:32.486+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:32.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:32 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:32.486+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:32.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:32 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:32.486+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:32.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:32 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:32.486+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:33.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:33 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:33.046+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:33.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:33 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:33.046+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:33.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:33 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:33.046+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:33.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:33 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:33.046+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.425467+0000 front 2024-05-03T17:06:08.425528+0000 (oldest deadline 2024-05-03T17:06:31.925623+0000) 2024-05-03T17:06:33.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:33 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:33.309+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:33.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:33 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:33.309+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:33.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:33 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:33.309+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:54.327170+0000 front 2024-05-03T17:05:54.326892+0000 (oldest deadline 2024-05-03T17:06:20.226641+0000) 2024-05-03T17:06:33.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:33 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:33.309+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:06.128784+0000 front 2024-05-03T17:06:06.128369+0000 (oldest deadline 2024-05-03T17:06:29.628344+0000) 2024-05-03T17:06:33.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:33 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:33.080+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:33.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:33 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:33.080+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:33.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:33 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:33.080+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:33.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:33 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:33.080+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:33.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:33 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:33.080+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:33.489 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:33 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:33.004+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:33.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:33 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:33.004+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:33.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:33 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:33.004+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:33.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:33 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:33.004+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:33.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:33 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:33.004+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:33.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:33 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:33.518+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:33.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:33 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:33.518+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:33.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:33 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:33.518+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:33.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:33 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:33.518+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:34.240 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:33 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:33.976+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:34.240 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:33 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:33.976+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:34.240 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:33 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:33.976+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:34.240 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:33 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:33.976+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:34.240 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:33 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:33.976+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:34.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:34 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:34.022+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:34.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:34 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:34.022+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:34.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:34 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:34.022+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:34.313 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:34 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:34.022+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.425467+0000 front 2024-05-03T17:06:08.425528+0000 (oldest deadline 2024-05-03T17:06:31.925623+0000) 2024-05-03T17:06:34.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:34 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:34.272+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:34.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:34 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:34.272+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:34.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:34 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:34.272+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:54.327170+0000 front 2024-05-03T17:05:54.326892+0000 (oldest deadline 2024-05-03T17:06:20.226641+0000) 2024-05-03T17:06:34.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:34 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:34.272+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:06.128784+0000 front 2024-05-03T17:06:06.128369+0000 (oldest deadline 2024-05-03T17:06:29.628344+0000) 2024-05-03T17:06:34.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:34 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:34.112+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:34.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:34 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:34.112+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:34.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:34 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:34.112+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:34.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:34 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:34.112+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:34.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:34 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:34.112+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:34.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:34 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:34.488+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:34.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:34 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:34.488+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:34.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:34 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:34.488+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:34.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:34 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:34.488+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:35.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:35 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:35.015+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:35.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:35 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:35.015+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:35.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:35 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:35.015+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:35.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:35 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:35.015+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.425467+0000 front 2024-05-03T17:06:08.425528+0000 (oldest deadline 2024-05-03T17:06:31.925623+0000) 2024-05-03T17:06:35.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:35 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:35.264+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:35.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:35 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:35.264+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:35.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:35 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:35.264+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:54.327170+0000 front 2024-05-03T17:05:54.326892+0000 (oldest deadline 2024-05-03T17:06:20.226641+0000) 2024-05-03T17:06:35.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:35 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:35.264+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:06.128784+0000 front 2024-05-03T17:06:06.128369+0000 (oldest deadline 2024-05-03T17:06:29.628344+0000) 2024-05-03T17:06:35.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:35 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:35.108+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:35.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:35 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:35.108+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:35.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:35 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:35.108+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:35.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:35 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:35.108+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:35.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:35 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:35.108+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:35.489 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:35 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:35.021+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:35.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:35 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:35.021+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:35.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:35 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:35.021+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:35.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:35 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:35.021+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:35.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:35 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:35.021+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:35.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:35 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:35.457+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:35.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:35 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:35.457+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:35.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:35 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:35.457+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:35.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:35 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:35.457+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:36.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:35 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:35.984+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:36.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:35 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:35.984+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:36.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:35 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:35.984+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:36.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:35 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:35.984+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.425467+0000 front 2024-05-03T17:06:08.425528+0000 (oldest deadline 2024-05-03T17:06:31.925623+0000) 2024-05-03T17:06:36.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:36 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:36.258+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:36.822533+0000 front 2024-05-03T17:05:36.822067+0000 (oldest deadline 2024-05-03T17:06:01.522306+0000) 2024-05-03T17:06:36.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:36 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:36.258+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:48.525545+0000 front 2024-05-03T17:05:48.525348+0000 (oldest deadline 2024-05-03T17:06:12.624937+0000) 2024-05-03T17:06:36.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:36 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:36.258+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:54.327170+0000 front 2024-05-03T17:05:54.326892+0000 (oldest deadline 2024-05-03T17:06:20.226641+0000) 2024-05-03T17:06:36.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:36 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7[50010]: 2024-05-03T17:06:36.258+0000 7f16e3600700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:06.128784+0000 front 2024-05-03T17:06:06.128369+0000 (oldest deadline 2024-05-03T17:06:29.628344+0000) 2024-05-03T17:06:36.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:36 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:36.132+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:36.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:36 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:36.132+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:36.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:36 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:36.132+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:36.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:36 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:36.132+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:36.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:36 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:36.132+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:36.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:35 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:35.988+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:36.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:35 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:35.988+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:36.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:35 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:35.988+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:36.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:35 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:35.988+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:36.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:35 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:35.989+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:36.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:36 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:36.439+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:36.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:36 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:36.439+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:36.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:36 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:36.439+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:36.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:36 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:36.439+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:37.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:36 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:36.986+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:37.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:36 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:36.986+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:37.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:36 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:36.986+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:37.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:36 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:36.986+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.425467+0000 front 2024-05-03T17:06:08.425528+0000 (oldest deadline 2024-05-03T17:06:31.925623+0000) 2024-05-03T17:06:37.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:37 smithi134 podman[67999]: 2024-05-03 17:06:37.283972129 +0000 UTC m=+5.580320046 container died 3022e26c5f4a6b785f0c11468e025303b7262a806fa0b52e564c030d178198ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T17:06:37.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:37 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:37.118+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:37.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:37 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:37.118+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:37.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:37 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:37.118+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:37.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:37 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:37.118+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:37.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:37 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:37.118+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:37.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:37 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:37.035+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:37.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:37 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:37.035+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:37.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:37 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:37.035+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:37.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:37 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:37.035+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:37.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:37 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:37.035+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:37.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:37 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:37.473+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:37.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:37 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:37.473+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:37.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:37 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:37.473+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:37.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:37 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:37.473+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:37.966 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:37 smithi134 podman[67999]: 2024-05-03 17:06:37.695124681 +0000 UTC m=+5.991472635 container cleanup 3022e26c5f4a6b785f0c11468e025303b7262a806fa0b52e564c030d178198ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-05-03T17:06:37.966 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:37 smithi134 bash[67999]: ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7 2024-05-03T17:06:38.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:37 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:37.972+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:38.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:37 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:37.972+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:38.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:37 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:37.972+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:38.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:37 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:37.972+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.425467+0000 front 2024-05-03T17:06:08.425528+0000 (oldest deadline 2024-05-03T17:06:31.925623+0000) 2024-05-03T17:06:38.466 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:37 smithi134 podman[68018]: 2024-05-03 17:06:37.987739777 +0000 UTC m=+0.689520786 container remove 3022e26c5f4a6b785f0c11468e025303b7262a806fa0b52e564c030d178198ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240430) 2024-05-03T17:06:38.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:38 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:38.161+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:38.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:38 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:38.161+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:38.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:38 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:38.161+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:38.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:38 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:38.161+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:38.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:38 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:38.161+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:38.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:38 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:38.024+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:38.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:38 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:38.024+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:38.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:38 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:38.024+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:38.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:38 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:38.024+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:38.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:38 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:38.024+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:38.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:38 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:38.486+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:38.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:38 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:38.486+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:38.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:38 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:38.486+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:38.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:38 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:38.486+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:39.103 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:38 smithi134 podman[68107]: 2024-05-03 17:06:38.796783056 +0000 UTC m=+0.128363647 container create 776c0345fa72563b276e9af765ac58837e08c6d6e23427a203a16ff7f64553d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-03T17:06:39.103 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:38 smithi134 podman[68107]: 2024-05-03 17:06:38.703972257 +0000 UTC m=+0.035552816 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T17:06:39.104 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:39 smithi134 podman[68107]: 2024-05-03 17:06:39.10256564 +0000 UTC m=+0.434146258 container init 776c0345fa72563b276e9af765ac58837e08c6d6e23427a203a16ff7f64553d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-05-03T17:06:39.240 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:38 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:38.982+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:39.240 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:38 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:38.982+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:39.240 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:38 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:38.982+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:39.240 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:38 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:38.982+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:39.241 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:38 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:38.982+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:39.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:38 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:38.971+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:39.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:38 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:38.971+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:39.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:38 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:38.971+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:39.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:38 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:38.971+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.425467+0000 front 2024-05-03T17:06:08.425528+0000 (oldest deadline 2024-05-03T17:06:31.925623+0000) 2024-05-03T17:06:39.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:39 smithi134 podman[68107]: 2024-05-03 17:06:39.114893018 +0000 UTC m=+0.446473589 container start 776c0345fa72563b276e9af765ac58837e08c6d6e23427a203a16ff7f64553d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-05-03T17:06:39.467 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:39 smithi134 podman[68107]: 2024-05-03 17:06:39.190658892 +0000 UTC m=+0.522239526 container attach 776c0345fa72563b276e9af765ac58837e08c6d6e23427a203a16ff7f64553d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T17:06:39.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:39 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:39.159+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:39.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:39 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:39.159+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:39.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:39 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:39.159+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:39.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:39 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:39.159+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:39.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:39 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:39.159+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:39.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:39 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:39.495+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:39.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:39 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:39.495+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:39.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:39 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:39.495+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:39.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:39 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:39.495+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:39.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:39 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:39.495+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:39.948 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 03 17:06:39 smithi134 podman[68107]: 2024-05-03 17:06:39.572107071 +0000 UTC m=+0.903687625 container died 776c0345fa72563b276e9af765ac58837e08c6d6e23427a203a16ff7f64553d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-03T17:06:39.961 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:39 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:39.940+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:39.961 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:39 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:39.940+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:39.961 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:39 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:39.940+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:39.961 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:39 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:39.940+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.425467+0000 front 2024-05-03T17:06:08.425528+0000 (oldest deadline 2024-05-03T17:06:31.925623+0000) 2024-05-03T17:06:39.962 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:39 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:39.940+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.029546+0000 front 2024-05-03T17:06:17.029679+0000 (oldest deadline 2024-05-03T17:06:39.929575+0000) 2024-05-03T17:06:40.216 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:40 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:40.188+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:40.217 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:40 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:40.188+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:40.217 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:40 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:40.188+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:40.217 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:40 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:40.188+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:40.217 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:40 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:40.188+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:40.337 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.7.service' 2024-05-03T17:06:40.439 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:06:40.439 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-03T17:06:40.440 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-03T17:06:40.440 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.8 2024-05-03T17:06:40.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:40 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:40.010+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:40.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:40 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:40.010+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:40.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:40 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:40.010+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:40.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:40 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:40.010+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:40.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:40 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:40.010+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:40.812 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:40 smithi146 systemd[1]: Stopping Ceph osd.8 for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:06:40.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:40 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:40.475+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:40.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:40 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:40.475+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:40.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:40 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:40.475+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:40.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:40 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:40.475+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:40.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:40 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:40.475+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:41.314 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:40 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:40.952+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:41.314 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:40 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:40.952+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:41.315 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:40 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:40.952+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:41.315 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:40 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:40.952+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.425467+0000 front 2024-05-03T17:06:08.425528+0000 (oldest deadline 2024-05-03T17:06:31.925623+0000) 2024-05-03T17:06:41.315 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:40 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:40.952+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.029546+0000 front 2024-05-03T17:06:17.029679+0000 (oldest deadline 2024-05-03T17:06:39.929575+0000) 2024-05-03T17:06:41.315 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:41 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:41.040+0000 7ff776400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:06:41.315 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:41 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:41.040+0000 7ff776400700 -1 osd.8 95 *** Got signal Terminated *** 2024-05-03T17:06:41.315 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:41 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:41.040+0000 7ff776400700 -1 osd.8 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T17:06:41.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:41 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:41.184+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:41.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:41 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:41.184+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:41.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:41 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:41.184+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:41.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:41 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:41.184+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:41.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:41 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:41.184+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:41.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:41 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:41.055+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:41.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:41 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:41.055+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:41.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:41 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:41.055+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:41.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:41 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:41.055+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:41.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:41 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:41.055+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:41.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:41 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:41.437+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:41.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:41 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:41.437+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:41.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:41 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:41.437+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:41.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:41 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:41.437+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:41.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:41 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:41.437+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:42.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:41 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:41.967+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:42.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:41 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:41.967+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:42.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:41 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:41.967+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:42.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:41 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:41.967+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.425467+0000 front 2024-05-03T17:06:08.425528+0000 (oldest deadline 2024-05-03T17:06:31.925623+0000) 2024-05-03T17:06:42.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:41 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:41.967+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.029546+0000 front 2024-05-03T17:06:17.029679+0000 (oldest deadline 2024-05-03T17:06:39.929575+0000) 2024-05-03T17:06:42.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:42 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:42.161+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:42.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:42 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:42.161+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:42.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:42 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:42.161+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:42.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:42 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:42.161+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:42.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:42 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:42.161+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:42.489 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:42 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:42.040+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:42.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:42 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:42.040+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:42.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:42 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:42.040+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:42.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:42 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:42.040+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:42.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:42 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:42.040+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:42.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:42 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:42.431+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:42.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:42 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:42.431+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:42.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:42 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:42.431+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:42.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:42 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:42.431+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:42.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:42 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:42.431+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:43.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:43 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:43.016+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:43.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:43 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:43.016+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:43.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:43 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:43.016+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:43.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:43 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:43.016+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.425467+0000 front 2024-05-03T17:06:08.425528+0000 (oldest deadline 2024-05-03T17:06:31.925623+0000) 2024-05-03T17:06:43.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:43 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:43.016+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.029546+0000 front 2024-05-03T17:06:17.029679+0000 (oldest deadline 2024-05-03T17:06:39.929575+0000) 2024-05-03T17:06:43.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:43 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:43.163+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:43.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:43 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:43.163+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:43.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:43 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:43.163+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:43.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:43 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:43.163+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:43.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:43 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:43.163+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:43.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:43 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:43.163+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:06:43.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:43 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:43.076+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:43.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:43 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:43.076+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:43.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:43 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:43.076+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:43.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:43 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:43.076+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:43.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:43 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:43.076+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:43.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:43 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:43.448+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:43.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:43 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:43.448+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:43.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:43 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:43.448+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:43.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:43 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:43.448+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:43.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:43 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:43.448+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:44.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:43 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:43.984+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:44.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:43 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:43.984+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:44.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:43 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:43.984+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:44.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:43 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:43.984+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.425467+0000 front 2024-05-03T17:06:08.425528+0000 (oldest deadline 2024-05-03T17:06:31.925623+0000) 2024-05-03T17:06:44.313 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:43 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:43.985+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.029546+0000 front 2024-05-03T17:06:17.029679+0000 (oldest deadline 2024-05-03T17:06:39.929575+0000) 2024-05-03T17:06:44.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:44 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:44.197+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:44.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:44 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:44.197+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:44.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:44 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:44.197+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:44.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:44 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:44.197+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:44.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:44 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:44.197+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:44.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:44 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:44.197+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:06:44.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:44 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:44.042+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:44.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:44 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:44.042+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:44.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:44 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:44.042+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:44.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:44 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:44.042+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:44.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:44 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:44.042+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:44.491 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:44 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:44.042+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.385333+0000 front 2024-05-03T17:06:17.385459+0000 (oldest deadline 2024-05-03T17:06:43.284877+0000) 2024-05-03T17:06:44.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:44 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:44.452+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:44.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:44 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:44.452+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:44.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:44 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:44.452+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:44.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:44 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:44.452+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:44.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:44 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:44.452+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:45.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:44 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:44.935+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:45.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:44 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:44.935+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:45.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:44 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:44.935+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:45.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:44 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:44.935+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.425467+0000 front 2024-05-03T17:06:08.425528+0000 (oldest deadline 2024-05-03T17:06:31.925623+0000) 2024-05-03T17:06:45.313 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:44 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:44.935+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.029546+0000 front 2024-05-03T17:06:17.029679+0000 (oldest deadline 2024-05-03T17:06:39.929575+0000) 2024-05-03T17:06:45.392 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:45 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:45.083+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:45.392 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:45 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:45.083+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:45.392 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:45 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:45.083+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:45.392 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:45 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:45.083+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:45.393 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:45 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:45.083+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:45.393 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:45 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:45.083+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.385333+0000 front 2024-05-03T17:06:17.385459+0000 (oldest deadline 2024-05-03T17:06:43.284877+0000) 2024-05-03T17:06:45.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:45 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:45.165+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:45.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:45 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:45.165+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:45.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:45 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:45.165+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:45.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:45 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:45.165+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:45.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:45 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:45.165+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:45.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:45 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:45.165+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:06:45.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:45 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:45.492+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:45.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:45 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:45.492+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:45.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:45 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:45.492+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:45.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:45 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:45.492+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:45.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:45 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:45.492+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:46.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:45 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:45.913+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.913879+0000 front 2024-05-03T17:05:39.914205+0000 (oldest deadline 2024-05-03T17:06:04.014117+0000) 2024-05-03T17:06:46.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:45 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:45.913+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:47.919848+0000 front 2024-05-03T17:05:47.919741+0000 (oldest deadline 2024-05-03T17:06:10.819795+0000) 2024-05-03T17:06:46.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:45 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:45.913+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.121782+0000 front 2024-05-03T17:05:56.121834+0000 (oldest deadline 2024-05-03T17:06:21.421983+0000) 2024-05-03T17:06:46.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:45 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:45.913+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.425467+0000 front 2024-05-03T17:06:08.425528+0000 (oldest deadline 2024-05-03T17:06:31.925623+0000) 2024-05-03T17:06:46.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:45 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8[50923]: 2024-05-03T17:06:45.913+0000 7ff771c00700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.029546+0000 front 2024-05-03T17:06:17.029679+0000 (oldest deadline 2024-05-03T17:06:39.929575+0000) 2024-05-03T17:06:46.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:46 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:46.167+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:46.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:46 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:46.167+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:46.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:46 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:46.167+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:46.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:46 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:46.167+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:46.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:46 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:46.167+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:46.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:46 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:46.167+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:06:46.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:46 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:46.085+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:46.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:46 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:46.085+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:46.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:46 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:46.085+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:46.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:46 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:46.085+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:46.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:46 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:46.085+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:46.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:46 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:46.085+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.385333+0000 front 2024-05-03T17:06:17.385459+0000 (oldest deadline 2024-05-03T17:06:43.284877+0000) 2024-05-03T17:06:46.812 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:46 smithi146 podman[69060]: 2024-05-03 17:06:46.537405173 +0000 UTC m=+5.642754563 container died 434f5f8898a1832ae241c1101a877c8d93d3ead7ef5eb64e080e339e67586881 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-05-03T17:06:46.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:46 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:46.515+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:46.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:46 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:46.515+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:46.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:46 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:46.515+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:46.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:46 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:46.515+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:46.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:46 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:46.515+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:47.240 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:47 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:47.114+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:47.240 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:47 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:47.114+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:47.240 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:47 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:47.114+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:47.241 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:47 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:47.114+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:47.241 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:47 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:47.114+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:47.241 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:47 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:47.114+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.385333+0000 front 2024-05-03T17:06:17.385459+0000 (oldest deadline 2024-05-03T17:06:43.284877+0000) 2024-05-03T17:06:47.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:47 smithi146 podman[69060]: 2024-05-03 17:06:47.059081241 +0000 UTC m=+6.164430649 container cleanup 434f5f8898a1832ae241c1101a877c8d93d3ead7ef5eb64e080e339e67586881 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-03T17:06:47.312 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:47 smithi146 bash[69060]: ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8 2024-05-03T17:06:47.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:47 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:47.151+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:47.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:47 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:47.151+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:47.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:47 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:47.151+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:47.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:47 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:47.151+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:47.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:47 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:47.151+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:47.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:47 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:47.151+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:06:47.811 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:47 smithi146 podman[69077]: 2024-05-03 17:06:47.318623426 +0000 UTC m=+0.768262895 container remove 434f5f8898a1832ae241c1101a877c8d93d3ead7ef5eb64e080e339e67586881 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240430) 2024-05-03T17:06:47.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:47 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:47.468+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:47.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:47 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:47.468+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:47.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:47 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:47.468+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:47.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:47 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:47.468+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:47.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:47 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:47.468+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:48.457 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:48 smithi146 podman[69165]: 2024-05-03 17:06:48.01055318 +0000 UTC m=+0.036618559 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T17:06:48.457 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:48 smithi146 podman[69165]: 2024-05-03 17:06:48.1196112 +0000 UTC m=+0.145676613 container create 45f85134fae2cc0715b9e6ca3f071e7a22f619a7b81a8bfa49d4c10e93c3194c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True) 2024-05-03T17:06:48.457 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:48 smithi146 podman[69165]: 2024-05-03 17:06:48.456402804 +0000 UTC m=+0.482468227 container init 45f85134fae2cc0715b9e6ca3f071e7a22f619a7b81a8bfa49d4c10e93c3194c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430) 2024-05-03T17:06:48.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:48 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:48.129+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:48.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:48 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:48.129+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:48.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:48 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:48.129+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:48.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:48 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:48.129+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:48.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:48 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:48.129+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:48.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:48 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:48.129+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:06:48.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:48 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:48.104+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:48.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:48 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:48.104+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:48.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:48 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:48.104+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:48.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:48 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:48.104+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:48.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:48 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:48.104+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:48.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:48 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:48.104+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.385333+0000 front 2024-05-03T17:06:17.385459+0000 (oldest deadline 2024-05-03T17:06:43.284877+0000) 2024-05-03T17:06:48.811 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:48 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:48.467+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:48.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:48 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:48.467+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:48.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:48 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:48.467+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:48.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:48 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:48.467+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:48.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:48 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:48.467+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:48.812 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:48 smithi146 podman[69165]: 2024-05-03 17:06:48.46778359 +0000 UTC m=+0.493848975 container start 45f85134fae2cc0715b9e6ca3f071e7a22f619a7b81a8bfa49d4c10e93c3194c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T17:06:48.813 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:48 smithi146 podman[69165]: 2024-05-03 17:06:48.571757488 +0000 UTC m=+0.597822948 container attach 45f85134fae2cc0715b9e6ca3f071e7a22f619a7b81a8bfa49d4c10e93c3194c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8-deactivate, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-03T17:06:49.246 INFO:journalctl@ceph.osd.8.smithi146.stdout:May 03 17:06:48 smithi146 podman[69165]: 2024-05-03 17:06:48.909379424 +0000 UTC m=+0.935444857 container died 45f85134fae2cc0715b9e6ca3f071e7a22f619a7b81a8bfa49d4c10e93c3194c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T17:06:49.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:49 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:49.115+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:49.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:49 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:49.115+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:49.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:49 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:49.115+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:49.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:49 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:49.115+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:49.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:49 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:49.115+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:49.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:49 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:49.115+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:06:49.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:49 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:49.115+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:27.048564+0000 front 2024-05-03T17:06:27.048781+0000 (oldest deadline 2024-05-03T17:06:48.748515+0000) 2024-05-03T17:06:49.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:49 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:49.093+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:49.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:49 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:49.093+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:49.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:49 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:49.093+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:49.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:49 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:49.093+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:49.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:49 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:49.093+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:49.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:49 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:49.093+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.385333+0000 front 2024-05-03T17:06:17.385459+0000 (oldest deadline 2024-05-03T17:06:43.284877+0000) 2024-05-03T17:06:49.643 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.8.service' 2024-05-03T17:06:49.746 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:06:49.746 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-03T17:06:49.746 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-03T17:06:49.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.9 2024-05-03T17:06:49.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:49 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:49.507+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:49.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:49 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:49.507+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:49.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:49 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:49.507+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:49.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:49 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:49.507+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:49.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:49 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:49.507+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:50.117 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:49 smithi081 systemd[1]: Stopping Ceph osd.9 for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:06:50.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:50 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:50.080+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:50.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:50 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:50.080+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:50.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:50 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:50.080+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:50.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:50 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:50.080+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:50.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:50 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:50.080+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:50.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:50 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:50.080+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:06:50.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:50 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:50.080+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:27.048564+0000 front 2024-05-03T17:06:27.048781+0000 (oldest deadline 2024-05-03T17:06:48.748515+0000) 2024-05-03T17:06:50.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:50 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:50.114+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:50.491 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:50 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:50.114+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:50.491 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:50 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:50.114+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:50.491 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:50 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:50.114+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:50.491 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:50 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:50.115+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:50.491 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:50 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:50.115+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.385333+0000 front 2024-05-03T17:06:17.385459+0000 (oldest deadline 2024-05-03T17:06:43.284877+0000) 2024-05-03T17:06:50.491 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:50 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:50.329+0000 7fe9c7000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:06:50.491 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:50 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:50.329+0000 7fe9c7000700 -1 osd.9 95 *** Got signal Terminated *** 2024-05-03T17:06:50.492 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:50 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:50.329+0000 7fe9c7000700 -1 osd.9 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T17:06:50.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:50 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:50.519+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:50.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:50 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:50.519+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:50.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:50 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:50.519+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:50.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:50 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:50.519+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:50.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:50 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:50.519+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:51.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:51 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:51.107+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:51.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:51 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:51.107+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:51.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:51 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:51.107+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:51.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:51 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:51.107+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:51.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:51 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:51.107+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:51.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:51 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:51.107+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:06:51.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:51 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:51.107+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:27.048564+0000 front 2024-05-03T17:06:27.048781+0000 (oldest deadline 2024-05-03T17:06:48.748515+0000) 2024-05-03T17:06:51.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:51 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:51.107+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:51.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:51 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:51.107+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:51.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:51 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:51.107+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:51.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:51 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:51.107+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:51.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:51 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:51.107+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:51.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:51 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:51.107+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.385333+0000 front 2024-05-03T17:06:17.385459+0000 (oldest deadline 2024-05-03T17:06:43.284877+0000) 2024-05-03T17:06:51.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:51 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:51.499+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:51.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:51 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:51.499+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:51.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:51 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:51.499+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:51.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:51 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:51.499+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:51.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:51 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:51.499+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:51.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:51 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:51.499+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:06:52.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:52 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:52.126+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:52.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:52 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:52.126+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:52.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:52 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:52.126+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:52.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:52 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:52.126+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:52.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:52 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:52.126+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:52.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:52 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:52.126+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:06:52.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:52 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:52.126+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:27.048564+0000 front 2024-05-03T17:06:27.048781+0000 (oldest deadline 2024-05-03T17:06:48.748515+0000) 2024-05-03T17:06:52.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:52 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:52.074+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:52.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:52 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:52.075+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:52.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:52 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:52.075+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:52.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:52 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:52.075+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:52.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:52 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:52.075+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:52.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:52 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:52.075+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.385333+0000 front 2024-05-03T17:06:17.385459+0000 (oldest deadline 2024-05-03T17:06:43.284877+0000) 2024-05-03T17:06:52.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:52 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:52.548+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:52.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:52 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:52.548+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:52.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:52 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:52.548+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:52.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:52 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:52.548+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:52.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:52 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:52.548+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:52.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:52 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:52.548+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:06:53.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:53 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:53.138+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:53.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:53 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:53.138+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:53.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:53 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:53.138+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:53.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:53 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:53.138+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:53.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:53 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:53.138+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:53.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:53 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:53.138+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:06:53.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:53 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:53.138+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:27.048564+0000 front 2024-05-03T17:06:27.048781+0000 (oldest deadline 2024-05-03T17:06:48.748515+0000) 2024-05-03T17:06:53.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:53 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:53.098+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:53.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:53 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:53.098+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:53.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:53 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:53.098+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:53.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:53 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:53.098+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:53.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:53 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:53.098+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:53.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:53 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:53.098+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.385333+0000 front 2024-05-03T17:06:17.385459+0000 (oldest deadline 2024-05-03T17:06:43.284877+0000) 2024-05-03T17:06:53.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:53 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:53.528+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:53.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:53 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:53.528+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:53.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:53 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:53.528+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:53.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:53 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:53.528+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:53.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:53 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:53.528+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:53.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:53 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:53.528+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:06:54.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:54.181+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:54.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:54.181+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:54.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:54.181+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:54.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:54.181+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:54.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:54.181+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:54.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:54.181+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:06:54.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:54 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:54.181+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:27.048564+0000 front 2024-05-03T17:06:27.048781+0000 (oldest deadline 2024-05-03T17:06:48.748515+0000) 2024-05-03T17:06:54.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:54.102+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:54.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:54.102+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:54.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:54.102+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:54.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:54.102+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:54.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:54.102+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:54.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:54 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:54.102+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.385333+0000 front 2024-05-03T17:06:17.385459+0000 (oldest deadline 2024-05-03T17:06:43.284877+0000) 2024-05-03T17:06:54.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:54.540+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:54.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:54.540+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:54.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:54.540+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:54.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:54.540+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:54.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:54.540+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:54.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:54 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:54.540+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:06:55.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:55 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:55.189+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:55.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:55 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:55.189+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:55.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:55 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:55.189+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:55.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:55 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:55.189+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:55.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:55 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:55.189+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:55.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:55 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:55.189+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:06:55.468 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:55 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:55.189+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:27.048564+0000 front 2024-05-03T17:06:27.048781+0000 (oldest deadline 2024-05-03T17:06:48.748515+0000) 2024-05-03T17:06:55.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:55 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:55.057+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:29.072280+0000 front 2024-05-03T17:05:29.072831+0000 (oldest deadline 2024-05-03T17:05:54.372411+0000) 2024-05-03T17:06:55.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:55 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:55.057+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:39.074459+0000 front 2024-05-03T17:05:39.074315+0000 (oldest deadline 2024-05-03T17:06:04.974393+0000) 2024-05-03T17:06:55.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:55 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:55.057+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:49.676382+0000 front 2024-05-03T17:05:49.676767+0000 (oldest deadline 2024-05-03T17:06:14.277123+0000) 2024-05-03T17:06:55.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:55 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:55.057+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:58.279860+0000 front 2024-05-03T17:05:58.279700+0000 (oldest deadline 2024-05-03T17:06:24.179673+0000) 2024-05-03T17:06:55.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:55 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:55.057+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:07.483015+0000 front 2024-05-03T17:06:07.483070+0000 (oldest deadline 2024-05-03T17:06:31.582786+0000) 2024-05-03T17:06:55.490 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:55 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9[61330]: 2024-05-03T17:06:55.057+0000 7fe9bd800700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.385333+0000 front 2024-05-03T17:06:17.385459+0000 (oldest deadline 2024-05-03T17:06:43.284877+0000) 2024-05-03T17:06:56.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:55 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:55.567+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:56.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:55 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:55.567+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:56.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:55 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:55.567+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:56.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:55 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:55.567+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:56.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:55 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:55.567+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:56.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:55 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:55.567+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:06:56.120 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:55 smithi081 podman[91727]: 2024-05-03 17:06:55.809864469 +0000 UTC m=+5.623685278 container died eda782d2b293196b49e57f60397bb9a6d94e2ddf6013a1f36506526ccab0178a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240430, GIT_CLEAN=True) 2024-05-03T17:06:56.444 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:56 smithi081 podman[91727]: 2024-05-03 17:06:56.231017374 +0000 UTC m=+6.044838208 container cleanup eda782d2b293196b49e57f60397bb9a6d94e2ddf6013a1f36506526ccab0178a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-05-03T17:06:56.444 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:56 smithi081 bash[91727]: ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9 2024-05-03T17:06:56.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:56 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:56.167+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:56.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:56 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:56.167+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:56.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:56 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:56.167+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:56.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:56 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:56.167+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:56.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:56 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:56.167+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:56.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:56 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:56.167+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:06:56.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:56 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:56.167+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:27.048564+0000 front 2024-05-03T17:06:27.048781+0000 (oldest deadline 2024-05-03T17:06:48.748515+0000) 2024-05-03T17:06:56.740 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:56 smithi081 podman[91747]: 2024-05-03 17:06:56.532569347 +0000 UTC m=+0.708720014 container remove eda782d2b293196b49e57f60397bb9a6d94e2ddf6013a1f36506526ccab0178a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-03T17:06:56.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:56 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:56.545+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:56.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:56 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:56.545+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:56.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:56 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:56.545+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:56.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:56 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:56.545+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:56.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:56 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:56.545+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:56.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:56 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:56.545+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:06:57.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:57 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:57.178+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:57.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:57 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:57.178+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:57.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:57 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:57.178+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:57.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:57 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:57.178+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:57.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:57 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:57.178+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:57.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:57 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:57.178+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:06:57.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:57 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:57.178+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:27.048564+0000 front 2024-05-03T17:06:27.048781+0000 (oldest deadline 2024-05-03T17:06:48.748515+0000) 2024-05-03T17:06:57.681 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:57 smithi081 podman[91836]: 2024-05-03 17:06:57.28266324 +0000 UTC m=+0.035652169 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T17:06:57.682 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:57 smithi081 podman[91836]: 2024-05-03 17:06:57.3968727 +0000 UTC m=+0.149861659 container create 5f1fefaa7b8b642ec8a7b9db773bcdec2f9c1f87b0b5c4fb23b6cb35892b6b6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9-deactivate, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-03T17:06:57.682 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:57 smithi081 podman[91836]: 2024-05-03 17:06:57.67972919 +0000 UTC m=+0.432718125 container init 5f1fefaa7b8b642ec8a7b9db773bcdec2f9c1f87b0b5c4fb23b6cb35892b6b6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD) 2024-05-03T17:06:57.990 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:57 smithi081 podman[91836]: 2024-05-03 17:06:57.690075916 +0000 UTC m=+0.443064844 container start 5f1fefaa7b8b642ec8a7b9db773bcdec2f9c1f87b0b5c4fb23b6cb35892b6b6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2) 2024-05-03T17:06:57.991 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:57 smithi081 podman[91836]: 2024-05-03 17:06:57.760764124 +0000 UTC m=+0.513753145 container attach 5f1fefaa7b8b642ec8a7b9db773bcdec2f9c1f87b0b5c4fb23b6cb35892b6b6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T17:06:58.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:57 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:57.586+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:58.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:57 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:57.586+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:58.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:57 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:57.586+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:58.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:57 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:57.586+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:58.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:57 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:57.586+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:58.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:57 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:57.586+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:06:58.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:58 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:58.201+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:58.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:58 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:58.201+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:58.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:58 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:58.201+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:58.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:58 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:58.201+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:58.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:58 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:58.201+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:58.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:58 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:58.201+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:06:58.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:58 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:58.201+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:27.048564+0000 front 2024-05-03T17:06:27.048781+0000 (oldest deadline 2024-05-03T17:06:48.748515+0000) 2024-05-03T17:06:58.476 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 03 17:06:58 smithi081 podman[91836]: 2024-05-03 17:06:58.139301365 +0000 UTC m=+0.892290336 container died 5f1fefaa7b8b642ec8a7b9db773bcdec2f9c1f87b0b5c4fb23b6cb35892b6b6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-05-03T17:06:58.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.9.service' 2024-05-03T17:06:59.007 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:06:59.008 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-03T17:06:59.008 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-03T17:06:59.008 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.10 2024-05-03T17:06:59.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:58 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:58.616+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:06:59.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:58 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:58.616+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:06:59.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:58 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:58.616+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:06:59.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:58 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:58.616+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:06:59.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:58 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:58.616+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:06:59.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:58 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:58.616+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:06:59.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:59 smithi134 systemd[1]: Stopping Ceph osd.10 for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:06:59.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:59 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:59.191+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:06:59.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:59 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:59.191+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:06:59.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:59 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:59.191+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:06:59.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:59 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:59.191+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:06:59.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:59 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:59.191+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:06:59.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:59 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:59.191+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:06:59.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:59 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:59.191+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:27.048564+0000 front 2024-05-03T17:06:27.048781+0000 (oldest deadline 2024-05-03T17:06:48.748515+0000) 2024-05-03T17:06:59.966 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:59 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:59.576+0000 7f0e76a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:06:59.966 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:59 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:59.576+0000 7f0e76a00700 -1 osd.10 95 *** Got signal Terminated *** 2024-05-03T17:06:59.967 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:06:59 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:06:59.576+0000 7f0e76a00700 -1 osd.10 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T17:07:00.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:59 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:59.666+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:07:00.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:59 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:59.666+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:07:00.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:59 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:59.666+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:07:00.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:59 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:59.666+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:07:00.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:59 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:59.666+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:07:00.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:59 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:59.666+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:07:00.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:06:59 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:06:59.666+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-03T17:06:35.488851+0000 front 2024-05-03T17:06:35.488912+0000 (oldest deadline 2024-05-03T17:06:58.988742+0000) 2024-05-03T17:07:00.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:00 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:00.189+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:07:00.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:00 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:00.189+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:07:00.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:00 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:00.189+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:07:00.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:00 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:00.189+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:07:00.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:00 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:00.189+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:07:00.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:00 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:00.189+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:07:00.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:00 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:00.189+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:27.048564+0000 front 2024-05-03T17:06:27.048781+0000 (oldest deadline 2024-05-03T17:06:48.748515+0000) 2024-05-03T17:07:01.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:00 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:00.704+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:07:01.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:00 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:00.704+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:07:01.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:00 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:00.704+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:07:01.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:00 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:00.704+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:07:01.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:00 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:00.704+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:07:01.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:00 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:00.704+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:07:01.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:00 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:00.704+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-03T17:06:35.488851+0000 front 2024-05-03T17:06:35.488912+0000 (oldest deadline 2024-05-03T17:06:58.988742+0000) 2024-05-03T17:07:01.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:01 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:01.227+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:07:01.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:01 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:01.227+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:07:01.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:01 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:01.227+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:07:01.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:01 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:01.227+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:07:01.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:01 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:01.227+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:07:01.718 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:01 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:01.227+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:07:01.718 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:01 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:01.227+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:27.048564+0000 front 2024-05-03T17:06:27.048781+0000 (oldest deadline 2024-05-03T17:06:48.748515+0000) 2024-05-03T17:07:02.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:01 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:01.735+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:07:02.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:01 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:01.735+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:07:02.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:01 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:01.735+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:07:02.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:01 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:01.735+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:07:02.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:01 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:01.735+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:07:02.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:01 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:01.736+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:07:02.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:01 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:01.736+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-03T17:06:35.488851+0000 front 2024-05-03T17:06:35.488912+0000 (oldest deadline 2024-05-03T17:06:58.988742+0000) 2024-05-03T17:07:02.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:02 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:02.206+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:07:02.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:02 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:02.206+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:07:02.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:02 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:02.206+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:07:02.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:02 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:02.206+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:07:02.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:02 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:02.206+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:07:02.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:02 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:02.206+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:07:02.467 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:02 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:02.206+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:27.048564+0000 front 2024-05-03T17:06:27.048781+0000 (oldest deadline 2024-05-03T17:06:48.748515+0000) 2024-05-03T17:07:03.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:02 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:02.691+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:07:03.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:02 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:02.691+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:07:03.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:02 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:02.691+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:07:03.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:02 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:02.691+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:07:03.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:02 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:02.691+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:07:03.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:02 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:02.691+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:07:03.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:02 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:02.691+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-03T17:06:35.488851+0000 front 2024-05-03T17:06:35.488912+0000 (oldest deadline 2024-05-03T17:06:58.988742+0000) 2024-05-03T17:07:03.716 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:03 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:03.237+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:07:03.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:03 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:03.237+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:07:03.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:03 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:03.237+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:07:03.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:03 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:03.237+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:07:03.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:03 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:03.237+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:07:03.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:03 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:03.237+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:07:03.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:03 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:03.237+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:27.048564+0000 front 2024-05-03T17:06:27.048781+0000 (oldest deadline 2024-05-03T17:06:48.748515+0000) 2024-05-03T17:07:04.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:03 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:03.694+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:07:04.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:03 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:03.694+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:07:04.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:03 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:03.694+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:07:04.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:03 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:03.694+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:07:04.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:03 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:03.694+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:07:04.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:03 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:03.694+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:07:04.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:03 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:03.694+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-03T17:06:35.488851+0000 front 2024-05-03T17:06:35.488912+0000 (oldest deadline 2024-05-03T17:06:58.988742+0000) 2024-05-03T17:07:04.716 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:04 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:04.278+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:28.732247+0000 front 2024-05-03T17:05:28.732035+0000 (oldest deadline 2024-05-03T17:05:53.431717+0000) 2024-05-03T17:07:04.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:04 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:04.278+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-03T17:05:38.634579+0000 front 2024-05-03T17:05:38.634655+0000 (oldest deadline 2024-05-03T17:06:02.635561+0000) 2024-05-03T17:07:04.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:04 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:04.278+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:44.937634+0000 front 2024-05-03T17:05:44.938032+0000 (oldest deadline 2024-05-03T17:06:10.237154+0000) 2024-05-03T17:07:04.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:04 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:04.278+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:57.240142+0000 front 2024-05-03T17:05:57.240339+0000 (oldest deadline 2024-05-03T17:06:25.441110+0000) 2024-05-03T17:07:04.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:04 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:04.278+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:05.442009+0000 front 2024-05-03T17:06:05.442040+0000 (oldest deadline 2024-05-03T17:06:29.542038+0000) 2024-05-03T17:07:04.717 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:04 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:04.278+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:17.145425+0000 front 2024-05-03T17:06:17.145250+0000 (oldest deadline 2024-05-03T17:06:42.946531+0000) 2024-05-03T17:07:04.718 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:04 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10[57032]: 2024-05-03T17:07:04.278+0000 7f0e72200700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:27.048564+0000 front 2024-05-03T17:06:27.048781+0000 (oldest deadline 2024-05-03T17:06:48.748515+0000) 2024-05-03T17:07:05.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:04 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:04.729+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:07:05.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:04 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:04.729+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:07:05.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:04 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:04.729+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:07:05.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:04 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:04.729+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:07:05.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:04 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:04.729+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:07:05.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:04 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:04.729+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:07:05.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:04 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:04.729+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-03T17:06:35.488851+0000 front 2024-05-03T17:06:35.488912+0000 (oldest deadline 2024-05-03T17:06:58.988742+0000) 2024-05-03T17:07:05.209 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:04 smithi134 podman[68225]: 2024-05-03 17:07:04.929147348 +0000 UTC m=+5.491270907 container died 262febe5a5b5633efe873376022a6b4b19773971507e291bfd691ca653a441bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T17:07:05.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:05 smithi134 podman[68225]: 2024-05-03 17:07:05.328371527 +0000 UTC m=+5.890495134 container cleanup 262febe5a5b5633efe873376022a6b4b19773971507e291bfd691ca653a441bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True) 2024-05-03T17:07:05.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:05 smithi134 bash[68225]: ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10 2024-05-03T17:07:05.966 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:05 smithi134 podman[68242]: 2024-05-03 17:07:05.55435753 +0000 UTC m=+0.609390194 container remove 262febe5a5b5633efe873376022a6b4b19773971507e291bfd691ca653a441bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-03T17:07:06.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:05 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:05.717+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:07:06.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:05 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:05.717+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:07:06.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:05 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:05.717+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:07:06.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:05 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:05.717+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:07:06.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:05 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:05.717+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:07:06.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:05 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:05.717+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:07:06.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:05 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:05.717+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-03T17:06:35.488851+0000 front 2024-05-03T17:06:35.488912+0000 (oldest deadline 2024-05-03T17:06:58.988742+0000) 2024-05-03T17:07:06.684 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:06 smithi134 podman[68331]: 2024-05-03 17:07:06.289320024 +0000 UTC m=+0.041816853 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T17:07:06.685 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:06 smithi134 podman[68331]: 2024-05-03 17:07:06.396660366 +0000 UTC m=+0.149157187 container create 99c6e975ff48711ce7f8b3f55b50002fcdbe9ac7caefa22d8ba678940f85af36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-03T17:07:06.685 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:06 smithi134 podman[68331]: 2024-05-03 17:07:06.683555443 +0000 UTC m=+0.436052295 container init 99c6e975ff48711ce7f8b3f55b50002fcdbe9ac7caefa22d8ba678940f85af36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD) 2024-05-03T17:07:06.966 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:06 smithi134 podman[68331]: 2024-05-03 17:07:06.694498134 +0000 UTC m=+0.446994949 container start 99c6e975ff48711ce7f8b3f55b50002fcdbe9ac7caefa22d8ba678940f85af36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS) 2024-05-03T17:07:06.967 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:06 smithi134 podman[68331]: 2024-05-03 17:07:06.757065091 +0000 UTC m=+0.509561990 container attach 99c6e975ff48711ce7f8b3f55b50002fcdbe9ac7caefa22d8ba678940f85af36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10-deactivate, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2) 2024-05-03T17:07:07.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:06 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:06.748+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:07:07.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:06 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:06.748+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:07:07.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:06 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:06.748+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:07:07.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:06 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:06.748+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:07:07.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:06 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:06.748+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:07:07.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:06 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:06.748+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:07:07.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:06 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:06.748+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-03T17:06:35.488851+0000 front 2024-05-03T17:06:35.488912+0000 (oldest deadline 2024-05-03T17:06:58.988742+0000) 2024-05-03T17:07:07.466 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 03 17:07:07 smithi134 podman[68331]: 2024-05-03 17:07:07.138243757 +0000 UTC m=+0.890740578 container died 99c6e975ff48711ce7f8b3f55b50002fcdbe9ac7caefa22d8ba678940f85af36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-10-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-03T17:07:07.838 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.10.service' 2024-05-03T17:07:07.948 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:07:07.949 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-03T17:07:07.949 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-03T17:07:07.949 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.11 2024-05-03T17:07:08.024 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:07 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:07.759+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:07:08.025 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:07 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:07.759+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:07:08.025 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:07 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:07.759+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:07:08.025 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:07 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:07.759+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:07:08.025 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:07 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:07.759+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:07:08.025 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:07 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:07.759+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:07:08.025 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:07 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:07.759+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-03T17:06:35.488851+0000 front 2024-05-03T17:06:35.488912+0000 (oldest deadline 2024-05-03T17:06:58.988742+0000) 2024-05-03T17:07:08.311 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:08 smithi146 systemd[1]: Stopping Ceph osd.11 for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:07:08.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:08 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:08.507+0000 7fbc51600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:07:08.812 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:08 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:08.507+0000 7fbc51600700 -1 osd.11 95 *** Got signal Terminated *** 2024-05-03T17:07:08.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:08 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:08.507+0000 7fbc51600700 -1 osd.11 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T17:07:08.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:08 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:08.713+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:07:08.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:08 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:08.713+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:07:08.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:08 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:08.713+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:07:08.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:08 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:08.713+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:07:08.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:08 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:08.713+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:07:08.813 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:08 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:08.713+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:07:08.814 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:08 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:08.713+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-03T17:06:35.488851+0000 front 2024-05-03T17:06:35.488912+0000 (oldest deadline 2024-05-03T17:06:58.988742+0000) 2024-05-03T17:07:10.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:09 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:09.757+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:07:10.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:09 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:09.757+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:07:10.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:09 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:09.757+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:07:10.064 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:09 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:09.757+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:07:10.064 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:09 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:09.757+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:07:10.064 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:09 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:09.757+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:07:10.064 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:09 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:09.757+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-03T17:06:35.488851+0000 front 2024-05-03T17:06:35.488912+0000 (oldest deadline 2024-05-03T17:06:58.988742+0000) 2024-05-03T17:07:10.065 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:09 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:09.757+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6820 osd.8 since back 2024-05-03T17:06:42.391368+0000 front 2024-05-03T17:06:42.391477+0000 (oldest deadline 2024-05-03T17:07:09.392162+0000) 2024-05-03T17:07:11.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:10 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:10.768+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:07:11.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:10 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:10.768+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:07:11.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:10 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:10.768+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:07:11.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:10 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:10.768+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:07:11.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:10 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:10.768+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:07:11.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:10 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:10.768+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:07:11.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:10 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:10.768+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-03T17:06:35.488851+0000 front 2024-05-03T17:06:35.488912+0000 (oldest deadline 2024-05-03T17:06:58.988742+0000) 2024-05-03T17:07:11.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:10 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:10.768+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6820 osd.8 since back 2024-05-03T17:06:42.391368+0000 front 2024-05-03T17:06:42.391477+0000 (oldest deadline 2024-05-03T17:07:09.392162+0000) 2024-05-03T17:07:12.312 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:11 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:11.815+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:07:12.312 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:11 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:11.815+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:07:12.313 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:11 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:11.815+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:07:12.313 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:11 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:11.815+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:07:12.313 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:11 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:11.815+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:07:12.313 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:11 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:11.815+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:07:12.313 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:11 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:11.815+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-03T17:06:35.488851+0000 front 2024-05-03T17:06:35.488912+0000 (oldest deadline 2024-05-03T17:06:58.988742+0000) 2024-05-03T17:07:12.313 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:11 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:11.815+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6820 osd.8 since back 2024-05-03T17:06:42.391368+0000 front 2024-05-03T17:06:42.391477+0000 (oldest deadline 2024-05-03T17:07:09.392162+0000) 2024-05-03T17:07:13.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:12 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:12.795+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-03T17:05:31.066834+0000 front 2024-05-03T17:05:31.067336+0000 (oldest deadline 2024-05-03T17:05:53.966763+0000) 2024-05-03T17:07:13.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:12 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:12.795+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6804 osd.2 since back 2024-05-03T17:05:46.270814+0000 front 2024-05-03T17:05:46.271128+0000 (oldest deadline 2024-05-03T17:06:12.171218+0000) 2024-05-03T17:07:13.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:12 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:12.795+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-03T17:05:56.273550+0000 front 2024-05-03T17:05:56.273515+0000 (oldest deadline 2024-05-03T17:06:22.173618+0000) 2024-05-03T17:07:13.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:12 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:12.795+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-03T17:06:08.379002+0000 front 2024-05-03T17:06:08.378650+0000 (oldest deadline 2024-05-03T17:06:30.579544+0000) 2024-05-03T17:07:13.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:12 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:12.795+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6812 osd.5 since back 2024-05-03T17:06:15.881695+0000 front 2024-05-03T17:06:15.881881+0000 (oldest deadline 2024-05-03T17:06:39.381794+0000) 2024-05-03T17:07:13.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:12 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:12.795+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-03T17:06:25.586594+0000 front 2024-05-03T17:06:25.586530+0000 (oldest deadline 2024-05-03T17:06:51.486340+0000) 2024-05-03T17:07:13.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:12 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:12.795+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-03T17:06:35.488851+0000 front 2024-05-03T17:06:35.488912+0000 (oldest deadline 2024-05-03T17:06:58.988742+0000) 2024-05-03T17:07:13.063 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:12 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11[57727]: 2024-05-03T17:07:12.795+0000 7fbc4ce00700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.146:6820 osd.8 since back 2024-05-03T17:06:42.391368+0000 front 2024-05-03T17:06:42.391477+0000 (oldest deadline 2024-05-03T17:07:09.392162+0000) 2024-05-03T17:07:14.182 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:13 smithi146 podman[69269]: 2024-05-03 17:07:13.855699942 +0000 UTC m=+5.488895566 container died f885b91ed7be262b043bbd50867294cf490ee56669fd46508da5e5e619876d77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-03T17:07:14.536 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:14 smithi146 podman[69269]: 2024-05-03 17:07:14.301329813 +0000 UTC m=+5.934525465 container cleanup f885b91ed7be262b043bbd50867294cf490ee56669fd46508da5e5e619876d77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430) 2024-05-03T17:07:14.536 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:14 smithi146 bash[69269]: ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11 2024-05-03T17:07:14.811 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:14 smithi146 podman[69287]: 2024-05-03 17:07:14.535284434 +0000 UTC m=+0.671794586 container remove f885b91ed7be262b043bbd50867294cf490ee56669fd46508da5e5e619876d77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-05-03T17:07:15.640 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:15 smithi146 podman[69379]: 2024-05-03 17:07:15.275223009 +0000 UTC m=+0.036388596 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T17:07:15.640 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:15 smithi146 podman[69379]: 2024-05-03 17:07:15.369274879 +0000 UTC m=+0.130440508 container create 4d9ae9e3d214051e07ef8d194fd00ee639fd7b8785bb16c7ea01ddaf8d75a954 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T17:07:15.641 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:15 smithi146 podman[69379]: 2024-05-03 17:07:15.639220187 +0000 UTC m=+0.400385816 container init 4d9ae9e3d214051e07ef8d194fd00ee639fd7b8785bb16c7ea01ddaf8d75a954 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T17:07:16.061 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:15 smithi146 podman[69379]: 2024-05-03 17:07:15.650894994 +0000 UTC m=+0.412060646 container start 4d9ae9e3d214051e07ef8d194fd00ee639fd7b8785bb16c7ea01ddaf8d75a954 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-03T17:07:16.062 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:15 smithi146 podman[69379]: 2024-05-03 17:07:15.738085491 +0000 UTC m=+0.499251163 container attach 4d9ae9e3d214051e07ef8d194fd00ee639fd7b8785bb16c7ea01ddaf8d75a954 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-03T17:07:16.386 INFO:journalctl@ceph.osd.11.smithi146.stdout:May 03 17:07:16 smithi146 podman[69379]: 2024-05-03 17:07:16.100179426 +0000 UTC m=+0.861345068 container died 4d9ae9e3d214051e07ef8d194fd00ee639fd7b8785bb16c7ea01ddaf8d75a954 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-osd-11-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-03T17:07:16.742 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@osd.11.service' 2024-05-03T17:07:16.830 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:07:16.830 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-03T17:07:16.830 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-03T17:07:16.831 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.a 2024-05-03T17:07:17.239 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 17:07:16 smithi081 systemd[1]: Stopping Ceph mds.a for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:07:17.602 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 17:07:17 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-a[68361]: 2024-05-03T17:07:17.381+0000 7fd1bfc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:07:17.602 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 17:07:17 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-a[68361]: 2024-05-03T17:07:17.381+0000 7fd1bfc00700 -1 mds.a *** got signal Terminated *** 2024-05-03T17:07:19.097 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 17:07:18 smithi081 podman[91953]: 2024-05-03 17:07:18.787173755 +0000 UTC m=+1.535560080 container died ddddc0371d22bc94b001c3e3ee7c5abb4d075135f3055d579a198e068c6ed8e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-a, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T17:07:19.460 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 17:07:19 smithi081 podman[91953]: 2024-05-03 17:07:19.191272998 +0000 UTC m=+1.939659353 container cleanup ddddc0371d22bc94b001c3e3ee7c5abb4d075135f3055d579a198e068c6ed8e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T17:07:19.461 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 17:07:19 smithi081 bash[91953]: ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-a 2024-05-03T17:07:19.739 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 03 17:07:19 smithi081 podman[91979]: 2024-05-03 17:07:19.459091306 +0000 UTC m=+0.653256229 container remove ddddc0371d22bc94b001c3e3ee7c5abb4d075135f3055d579a198e068c6ed8e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-a, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD) 2024-05-03T17:07:19.782 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.a.service' 2024-05-03T17:07:19.887 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:07:19.887 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-03T17:07:19.887 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-03T17:07:19.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.d 2024-05-03T17:07:20.490 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 03 17:07:20 smithi081 systemd[1]: Stopping Ceph mds.d for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:07:20.989 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 03 17:07:20 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-d[66961]: 2024-05-03T17:07:20.511+0000 7f8cce000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:07:20.990 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 03 17:07:20 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-d[66961]: 2024-05-03T17:07:20.511+0000 7f8cce000700 -1 mds.d *** got signal Terminated *** 2024-05-03T17:07:24.392 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 03 17:07:24 smithi081 podman[92084]: 2024-05-03 17:07:24.080301965 +0000 UTC m=+3.709432179 container died cbbb5c0207c08ceda76c063015badeaabefc96a64c1497dae2f6bb9aefae7933 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-d, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=) 2024-05-03T17:07:24.688 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 03 17:07:24 smithi081 podman[92084]: 2024-05-03 17:07:24.511638254 +0000 UTC m=+4.140768502 container cleanup cbbb5c0207c08ceda76c063015badeaabefc96a64c1497dae2f6bb9aefae7933 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-d, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T17:07:24.688 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 03 17:07:24 smithi081 bash[92084]: ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-d 2024-05-03T17:07:24.989 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 03 17:07:24 smithi081 podman[92098]: 2024-05-03 17:07:24.687616751 +0000 UTC m=+0.587151105 container remove cbbb5c0207c08ceda76c063015badeaabefc96a64c1497dae2f6bb9aefae7933 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T17:07:25.136 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.d.service' 2024-05-03T17:07:25.234 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:07:25.235 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-03T17:07:25.235 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-03T17:07:25.235 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.g 2024-05-03T17:07:25.489 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 03 17:07:25 smithi081 systemd[1]: Stopping Ceph mds.g for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:07:26.239 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 03 17:07:25 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-g[67939]: 2024-05-03T17:07:25.805+0000 7ff28b000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:07:26.240 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 03 17:07:25 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-g[67939]: 2024-05-03T17:07:25.805+0000 7ff28b000700 -1 mds.g *** got signal Terminated *** 2024-05-03T17:07:27.095 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 03 17:07:26 smithi081 podman[92205]: 2024-05-03 17:07:26.78277391 +0000 UTC m=+1.113692212 container stop 3bdb1f3b5babb64386034d0233f8de7dbc0f46f20e46305e2a2c884998b24bc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0) 2024-05-03T17:07:27.096 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 03 17:07:26 smithi081 podman[92205]: 2024-05-03 17:07:26.808799084 +0000 UTC m=+1.139717387 container died 3bdb1f3b5babb64386034d0233f8de7dbc0f46f20e46305e2a2c884998b24bc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-g, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-05-03T17:07:27.484 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 03 17:07:27 smithi081 podman[92205]: 2024-05-03 17:07:27.260214529 +0000 UTC m=+1.591132858 container cleanup 3bdb1f3b5babb64386034d0233f8de7dbc0f46f20e46305e2a2c884998b24bc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-g, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-03T17:07:27.484 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 03 17:07:27 smithi081 bash[92205]: ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-g 2024-05-03T17:07:27.739 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 03 17:07:27 smithi081 podman[92219]: 2024-05-03 17:07:27.483077939 +0000 UTC m=+0.678693038 container remove 3bdb1f3b5babb64386034d0233f8de7dbc0f46f20e46305e2a2c884998b24bc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-g, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T17:07:27.949 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.g.service' 2024-05-03T17:07:28.050 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:07:28.050 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-03T17:07:28.051 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-03T17:07:28.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.j 2024-05-03T17:07:28.239 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 03 17:07:28 smithi081 systemd[1]: Stopping Ceph mds.j for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:07:28.917 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 03 17:07:28 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-j[66537]: 2024-05-03T17:07:28.641+0000 7f7413200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:07:28.917 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 03 17:07:28 smithi081 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-j[66537]: 2024-05-03T17:07:28.641+0000 7f7413200700 -1 mds.j *** got signal Terminated *** 2024-05-03T17:07:31.683 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 03 17:07:31 smithi081 podman[92325]: 2024-05-03 17:07:31.328964923 +0000 UTC m=+2.812068795 container died 2f4da5fe397260b3fda03a516311d34a7efb6265000736bfa828d279e6737fb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430) 2024-05-03T17:07:31.990 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 03 17:07:31 smithi081 podman[92325]: 2024-05-03 17:07:31.832366052 +0000 UTC m=+3.315469958 container cleanup 2f4da5fe397260b3fda03a516311d34a7efb6265000736bfa828d279e6737fb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-j, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-03T17:07:31.990 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 03 17:07:31 smithi081 bash[92325]: ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-j 2024-05-03T17:07:32.431 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 03 17:07:32 smithi081 podman[92350]: 2024-05-03 17:07:32.003382916 +0000 UTC m=+0.662997156 container remove 2f4da5fe397260b3fda03a516311d34a7efb6265000736bfa828d279e6737fb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-03T17:07:32.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.j.service' 2024-05-03T17:07:32.580 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:07:32.580 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-03T17:07:32.580 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-03T17:07:32.580 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.b 2024-05-03T17:07:32.966 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 17:07:32 smithi134 systemd[1]: Stopping Ceph mds.b for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:07:33.466 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 17:07:33 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-b[62229]: 2024-05-03T17:07:33.192+0000 7f43a2800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:07:33.466 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 17:07:33 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-b[62229]: 2024-05-03T17:07:33.192+0000 7f43a2800700 -1 mds.b *** got signal Terminated *** 2024-05-03T17:07:34.966 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 17:07:34 smithi134 podman[68437]: 2024-05-03 17:07:34.838918805 +0000 UTC m=+1.795376123 container died c36d4e01671296f3ff5719f9ab941e895b06a61dad76823ef5e5a568c4b3a640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-03T17:07:35.466 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 17:07:35 smithi134 podman[68437]: 2024-05-03 17:07:35.234888013 +0000 UTC m=+2.191345350 container cleanup c36d4e01671296f3ff5719f9ab941e895b06a61dad76823ef5e5a568c4b3a640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-05-03T17:07:35.466 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 17:07:35 smithi134 bash[68437]: ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-b 2024-05-03T17:07:35.843 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 03 17:07:35 smithi134 podman[68461]: 2024-05-03 17:07:35.471382456 +0000 UTC m=+0.620449976 container remove c36d4e01671296f3ff5719f9ab941e895b06a61dad76823ef5e5a568c4b3a640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-03T17:07:35.884 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.b.service' 2024-05-03T17:07:35.983 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:07:35.983 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-03T17:07:35.983 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-03T17:07:35.984 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.e 2024-05-03T17:07:36.466 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 03 17:07:36 smithi134 systemd[1]: Stopping Ceph mds.e for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:07:36.966 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 03 17:07:36 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-e[61608]: 2024-05-03T17:07:36.553+0000 7f6d59400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:07:36.966 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 03 17:07:36 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-e[61608]: 2024-05-03T17:07:36.553+0000 7f6d59400700 -1 mds.e *** got signal Terminated *** 2024-05-03T17:07:39.172 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 03 17:07:38 smithi134 podman[68569]: 2024-05-03 17:07:38.831224169 +0000 UTC m=+2.422241868 container died d3615a15fbb57b1c8b7ddf64d4b4f7d29330fa6095f41df3b710def3a252d363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-e, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=) 2024-05-03T17:07:39.173 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 03 17:07:39 smithi134 podman[68569]: 2024-05-03 17:07:39.17125224 +0000 UTC m=+2.762269961 container cleanup d3615a15fbb57b1c8b7ddf64d4b4f7d29330fa6095f41df3b710def3a252d363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-e, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-03T17:07:39.466 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 03 17:07:39 smithi134 bash[68569]: ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-e 2024-05-03T17:07:39.466 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 03 17:07:39 smithi134 podman[68582]: 2024-05-03 17:07:39.38079699 +0000 UTC m=+0.531407832 container remove d3615a15fbb57b1c8b7ddf64d4b4f7d29330fa6095f41df3b710def3a252d363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T17:07:39.916 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.e.service' 2024-05-03T17:07:40.019 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:07:40.019 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-03T17:07:40.019 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-03T17:07:40.020 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.h 2024-05-03T17:07:40.465 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 17:07:40 smithi134 systemd[1]: Stopping Ceph mds.h for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:07:40.966 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 17:07:40 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-h[61911]: 2024-05-03T17:07:40.705+0000 7f65a5e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:07:40.966 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 17:07:40 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-h[61911]: 2024-05-03T17:07:40.705+0000 7f65a5e00700 -1 mds.h *** got signal Terminated *** 2024-05-03T17:07:43.105 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 17:07:42 smithi134 podman[68692]: 2024-05-03 17:07:42.841273831 +0000 UTC m=+2.362407668 container died b7eedcd07fe7418f5e5ef0574409bcf75fc804b1a7d967beb4ffe4c60b7431f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, ceph=True, org.label-schema.vendor=CentOS) 2024-05-03T17:07:43.393 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 17:07:43 smithi134 podman[68692]: 2024-05-03 17:07:43.208262939 +0000 UTC m=+2.729396816 container cleanup b7eedcd07fe7418f5e5ef0574409bcf75fc804b1a7d967beb4ffe4c60b7431f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-h, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True) 2024-05-03T17:07:43.394 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 17:07:43 smithi134 bash[68692]: ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-h 2024-05-03T17:07:43.716 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 03 17:07:43 smithi134 podman[68706]: 2024-05-03 17:07:43.392574378 +0000 UTC m=+0.530842462 container remove b7eedcd07fe7418f5e5ef0574409bcf75fc804b1a7d967beb4ffe4c60b7431f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-h, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T17:07:43.897 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.h.service' 2024-05-03T17:07:43.997 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:07:43.998 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-03T17:07:43.998 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-03T17:07:43.998 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.k 2024-05-03T17:07:44.465 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 03 17:07:44 smithi134 systemd[1]: Stopping Ceph mds.k for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:07:44.966 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 03 17:07:44 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-k[61299]: 2024-05-03T17:07:44.593+0000 7eff5fc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:07:44.966 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 03 17:07:44 smithi134 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-k[61299]: 2024-05-03T17:07:44.593+0000 7eff5fc00700 -1 mds.k *** got signal Terminated *** 2024-05-03T17:07:47.135 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 03 17:07:46 smithi134 podman[68813]: 2024-05-03 17:07:46.850760741 +0000 UTC m=+2.386480443 container died c9754eadb06ba2fdc7a6aea30cff9f1f324077264641b6cd8de91d5b11186c94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-05-03T17:07:47.466 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 03 17:07:47 smithi134 podman[68813]: 2024-05-03 17:07:47.244776967 +0000 UTC m=+2.780496669 container cleanup c9754eadb06ba2fdc7a6aea30cff9f1f324077264641b6cd8de91d5b11186c94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-03T17:07:47.466 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 03 17:07:47 smithi134 bash[68813]: ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-k 2024-05-03T17:07:47.802 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 03 17:07:47 smithi134 podman[68828]: 2024-05-03 17:07:47.537286677 +0000 UTC m=+0.675099095 container remove c9754eadb06ba2fdc7a6aea30cff9f1f324077264641b6cd8de91d5b11186c94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-k, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T17:07:47.830 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.k.service' 2024-05-03T17:07:47.928 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:07:47.929 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-03T17:07:47.929 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-03T17:07:47.929 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.c 2024-05-03T17:07:48.312 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 17:07:48 smithi146 systemd[1]: Stopping Ceph mds.c for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:07:48.668 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 17:07:48 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-c[63033]: 2024-05-03T17:07:48.504+0000 7f8d0c800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:07:48.668 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 17:07:48 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-c[63033]: 2024-05-03T17:07:48.504+0000 7f8d0c800700 -1 mds.c *** got signal Terminated *** 2024-05-03T17:07:51.295 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 17:07:50 smithi146 podman[69495]: 2024-05-03 17:07:50.835530335 +0000 UTC m=+2.465690765 container died 847115f495deaee97ac688cce6ad68deda98f350343cbe774afb68f9d793855c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-c, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T17:07:51.561 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 17:07:51 smithi146 podman[69495]: 2024-05-03 17:07:51.431587535 +0000 UTC m=+3.061747990 container cleanup 847115f495deaee97ac688cce6ad68deda98f350343cbe774afb68f9d793855c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-05-03T17:07:51.562 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 17:07:51 smithi146 bash[69495]: ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-c 2024-05-03T17:07:52.062 INFO:journalctl@ceph.mds.c.smithi146.stdout:May 03 17:07:51 smithi146 podman[69520]: 2024-05-03 17:07:51.674242764 +0000 UTC m=+0.772685233 container remove 847115f495deaee97ac688cce6ad68deda98f350343cbe774afb68f9d793855c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-c, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-03T17:07:52.118 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.c.service' 2024-05-03T17:07:52.219 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:07:52.219 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-03T17:07:52.220 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-03T17:07:52.220 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.f 2024-05-03T17:07:52.561 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 17:07:52 smithi146 systemd[1]: Stopping Ceph mds.f for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:07:53.061 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 17:07:52 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-f[62724]: 2024-05-03T17:07:52.767+0000 7fcaa6c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:07:53.062 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 17:07:52 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-f[62724]: 2024-05-03T17:07:52.767+0000 7fcaa6c00700 -1 mds.f *** got signal Terminated *** 2024-05-03T17:07:55.166 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 17:07:54 smithi146 podman[69627]: 2024-05-03 17:07:54.839426482 +0000 UTC m=+2.198758004 container died b3f71a4c2b5f5d50107fd659d1d0bcf7cb7bb65a8656c7a00cc07092dbdc9aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2) 2024-05-03T17:07:55.512 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 17:07:55 smithi146 podman[69627]: 2024-05-03 17:07:55.285506777 +0000 UTC m=+2.644838345 container cleanup b3f71a4c2b5f5d50107fd659d1d0bcf7cb7bb65a8656c7a00cc07092dbdc9aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-f, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-03T17:07:55.512 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 17:07:55 smithi146 bash[69627]: ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-f 2024-05-03T17:07:55.811 INFO:journalctl@ceph.mds.f.smithi146.stdout:May 03 17:07:55 smithi146 podman[69641]: 2024-05-03 17:07:55.511307419 +0000 UTC m=+0.650558131 container remove b3f71a4c2b5f5d50107fd659d1d0bcf7cb7bb65a8656c7a00cc07092dbdc9aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-05-03T17:07:56.054 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.f.service' 2024-05-03T17:07:56.162 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:07:56.163 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-03T17:07:56.163 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-03T17:07:56.163 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.i 2024-05-03T17:07:56.755 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 17:07:56 smithi146 systemd[1]: Stopping Ceph mds.i for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:07:57.061 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 17:07:56 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-i[63336]: 2024-05-03T17:07:56.752+0000 7f6c78800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:07:57.062 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 17:07:56 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-i[63336]: 2024-05-03T17:07:56.752+0000 7f6c78800700 -1 mds.i *** got signal Terminated *** 2024-05-03T17:07:59.085 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 17:07:58 smithi146 podman[69747]: 2024-05-03 17:07:58.82358267 +0000 UTC m=+2.196094063 container died d32a27fdb6570463e206e1d1a55012844d92ead0bd8d6cdcea762d1fc2236ddc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-03T17:07:59.365 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 17:07:59 smithi146 podman[69747]: 2024-05-03 17:07:59.20478263 +0000 UTC m=+2.577294056 container cleanup d32a27fdb6570463e206e1d1a55012844d92ead0bd8d6cdcea762d1fc2236ddc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-i, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-05-03T17:07:59.365 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 17:07:59 smithi146 bash[69747]: ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-i 2024-05-03T17:07:59.811 INFO:journalctl@ceph.mds.i.smithi146.stdout:May 03 17:07:59 smithi146 podman[69761]: 2024-05-03 17:07:59.364023727 +0000 UTC m=+0.526318507 container remove d32a27fdb6570463e206e1d1a55012844d92ead0bd8d6cdcea762d1fc2236ddc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-i, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T17:07:59.865 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.i.service' 2024-05-03T17:07:59.970 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:07:59.970 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-03T17:07:59.970 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-03T17:07:59.971 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.l 2024-05-03T17:08:00.561 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 17:08:00 smithi146 systemd[1]: Stopping Ceph mds.l for 8988869e-096a-11ef-bc97-c7b262605968... 2024-05-03T17:08:01.062 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 17:08:00 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-l[62403]: 2024-05-03T17:08:00.572+0000 7f0443200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T17:08:01.062 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 17:08:00 smithi146 ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-l[62403]: 2024-05-03T17:08:00.572+0000 7f0443200700 -1 mds.l *** got signal Terminated *** 2024-05-03T17:08:03.105 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 17:08:02 smithi146 podman[69867]: 2024-05-03 17:08:02.821607641 +0000 UTC m=+2.377668802 container died de57b2e8ac3fdd4eb7b51cb55040c0eae022d6f7bcd274a6a638a713e4c0dbab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-l, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-03T17:08:03.366 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 17:08:03 smithi146 podman[69867]: 2024-05-03 17:08:03.224907685 +0000 UTC m=+2.780968856 container cleanup de57b2e8ac3fdd4eb7b51cb55040c0eae022d6f7bcd274a6a638a713e4c0dbab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-l, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-03T17:08:03.366 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 17:08:03 smithi146 bash[69867]: ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-l 2024-05-03T17:08:03.812 INFO:journalctl@ceph.mds.l.smithi146.stdout:May 03 17:08:03 smithi146 podman[69881]: 2024-05-03 17:08:03.450919288 +0000 UTC m=+0.609666623 container remove de57b2e8ac3fdd4eb7b51cb55040c0eae022d6f7bcd274a6a638a713e4c0dbab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-8988869e-096a-11ef-bc97-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-05-03T17:08:03.944 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8988869e-096a-11ef-bc97-c7b262605968@mds.l.service' 2024-05-03T17:08:04.038 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T17:08:04.038 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-03T17:08:04.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8988869e-096a-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-03T17:08:04.357 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T17:08:09.040 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8988869e-096a-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-03T17:08:09.358 INFO:teuthology.orchestra.run.smithi134.stdout:Deleting cluster with fsid: 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T17:08:14.078 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8988869e-096a-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-03T17:08:14.395 INFO:teuthology.orchestra.run.smithi146.stdout:Deleting cluster with fsid: 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T17:08:19.341 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-03T17:08:19.434 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-03T17:08:19.524 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-03T17:08:19.616 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-03T17:08:19.618 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687374/remote/smithi081/crash 2024-05-03T17:08:19.619 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/crash -- . 2024-05-03T17:08:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:tar: /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-03T17:08:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:tar: Error is not recoverable: exiting now 2024-05-03T17:08:19.716 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687374/remote/smithi134/crash 2024-05-03T17:08:19.717 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/crash -- . 2024-05-03T17:08:19.810 INFO:teuthology.orchestra.run.smithi134.stderr:tar: /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-03T17:08:19.810 INFO:teuthology.orchestra.run.smithi134.stderr:tar: Error is not recoverable: exiting now 2024-05-03T17:08:19.815 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687374/remote/smithi146/crash 2024-05-03T17:08:19.816 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/crash -- . 2024-05-03T17:08:19.931 INFO:teuthology.orchestra.run.smithi146.stderr:tar: /var/lib/ceph/8988869e-096a-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-03T17:08:19.931 INFO:teuthology.orchestra.run.smithi146.stderr:tar: Error is not recoverable: exiting now 2024-05-03T17:08:19.936 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-03T17:08:19.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-05-03T17:08:20.045 INFO:tasks.cephadm:Compressing logs... 2024-05-03T17:08:20.045 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-03T17:08:20.049 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-03T17:08:20.056 DEBUG:teuthology.orchestra.run.smithi146:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-03T17:08:20.110 INFO:teuthology.orchestra.run.smithi081.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-05-03T17:08:20.111 INFO:teuthology.orchestra.run.smithi081.stderr:: No such file or directory 2024-05-03T17:08:20.111 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.log 2024-05-03T17:08:20.112 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-03T17:08:20.113 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.g.log 2024-05-03T17:08:20.114 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.j.log 2024-05-03T17:08:20.116 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.3.log 2024-05-03T17:08:20.116 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-03T17:08:20.117 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.0.log 2024-05-03T17:08:20.117 INFO:teuthology.orchestra.run.smithi081.stderr: 90.3% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-03T17:08:20.118 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mgr.x.log 2024-05-03T17:08:20.119 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mon.a.log 2024-05-03T17:08:20.121 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.6.log 2024-05-03T17:08:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mon.a.log: /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-03T17:08:20.126 INFO:teuthology.orchestra.run.smithi081.stderr: 94.5% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.j.log.gz 2024-05-03T17:08:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.a.log 2024-05-03T17:08:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose --/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.cephadm.log: /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-03T17:08:20.129 INFO:teuthology.orchestra.run.smithi081.stderr: 83.3%/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.a.log: 96.8% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-05-03T17:08:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.d.log 2024-05-03T17:08:20.132 INFO:teuthology.orchestra.run.smithi134.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-03T17:08:20.132 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.log 2024-05-03T17:08:20.132 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-03T17:08:20.133 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.7.log 2024-05-03T17:08:20.134 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-volume.log: -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-03T17:08:20.134 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.b.log 2024-05-03T17:08:20.136 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.9.log 2024-05-03T17:08:20.136 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.4.log 2024-05-03T17:08:20.136 INFO:teuthology.orchestra.run.smithi134.stderr: 89.1% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-03T17:08:20.137 INFO:teuthology.orchestra.run.smithi146.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.log 2024-05-03T17:08:20.137 INFO:teuthology.orchestra.run.smithi146.stderr:: No such file or directory 2024-05-03T17:08:20.137 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.2.log 2024-05-03T17:08:20.138 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.1.log 2024-05-03T17:08:20.139 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.f.log 2024-05-03T17:08:20.139 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.4.log: 90.5% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-03T17:08:20.139 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mgr.y.log 2024-05-03T17:08:20.141 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.h.log 2024-05-03T17:08:20.141 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-03T17:08:20.141 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.5.log 2024-05-03T17:08:20.142 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.d.log: /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-03T17:08:20.142 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.audit.log: 89.1% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-03T17:08:20.143 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.c.log 2024-05-03T17:08:20.143 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.10.log 2024-05-03T17:08:20.144 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-03T17:08:20.144 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mon.c.log 2024-05-03T17:08:20.145 INFO:teuthology.orchestra.run.smithi146.stderr: 90.5% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-03T17:08:20.145 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mgr.z.log 2024-05-03T17:08:20.146 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.10.log: /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.e.log 2024-05-03T17:08:20.146 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.i.log 2024-05-03T17:08:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-05-03T17:08:20.149 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.e.log: 83.4% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-03T17:08:20.150 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-03T17:08:20.151 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mgr.z.log: /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-03T17:08:20.152 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mon.b.log 2024-05-03T17:08:20.153 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.11.log 2024-05-03T17:08:20.153 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/cephadm.log: 94.5%/var/log/ceph/ceph-client.admin.log: -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.d.log.gz 2024-05-03T17:08:20.154 INFO:teuthology.orchestra.run.smithi134.stderr: 93.2% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mgr.y.log.gz 2024-05-03T17:08:20.155 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.k.log 2024-05-03T17:08:20.157 INFO:teuthology.orchestra.run.smithi081.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-05-03T17:08:20.158 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.cephadm.log: 93.3% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mgr.z.log.gz 2024-05-03T17:08:20.158 INFO:teuthology.orchestra.run.smithi146.stderr: 83.3% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-03T17:08:20.159 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.8.log 2024-05-03T17:08:20.159 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-03T17:08:20.160 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-03T17:08:20.162 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.l.log 2024-05-03T17:08:20.163 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mon.b.log: /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-03T17:08:20.169 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-volume.log: /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-03T17:08:20.169 INFO:teuthology.orchestra.run.smithi081.stderr: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-03T17:08:20.172 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/cephadm.log: 91.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-03T17:08:20.181 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.l.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-03T17:08:20.188 INFO:teuthology.orchestra.run.smithi134.stderr: 90.9% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-03T17:08:20.215 INFO:teuthology.orchestra.run.smithi146.stderr: 90.9% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-03T17:08:20.216 INFO:teuthology.orchestra.run.smithi081.stderr: 94.6% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.g.log.gz 2024-05-03T17:08:20.223 INFO:teuthology.orchestra.run.smithi134.stderr: 94.0% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.h.log.gz 2024-05-03T17:08:20.229 INFO:teuthology.orchestra.run.smithi081.stderr: 94.6% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.a.log.gz 2024-05-03T17:08:20.238 INFO:teuthology.orchestra.run.smithi146.stderr: 94.7% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.f.log.gz 2024-05-03T17:08:20.244 INFO:teuthology.orchestra.run.smithi134.stderr: 94.0% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.e.log.gz 2024-05-03T17:08:20.251 INFO:teuthology.orchestra.run.smithi146.stderr: 94.5% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.c.log.gz 2024-05-03T17:08:20.265 INFO:teuthology.orchestra.run.smithi134.stderr: 94.0% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.k.log.gz 2024-05-03T17:08:20.275 INFO:teuthology.orchestra.run.smithi146.stderr: 94.0% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.i.log.gz 2024-05-03T17:08:20.310 INFO:teuthology.orchestra.run.smithi146.stderr: 94.6% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.l.log.gz 2024-05-03T17:08:20.403 INFO:teuthology.orchestra.run.smithi134.stderr: 93.9% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mds.b.log.gz 2024-05-03T17:08:20.434 INFO:teuthology.orchestra.run.smithi081.stderr: 89.9% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mgr.x.log.gz 2024-05-03T17:08:20.612 INFO:teuthology.orchestra.run.smithi134.stderr: 92.0% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mon.b.log.gz 2024-05-03T17:08:20.703 INFO:teuthology.orchestra.run.smithi146.stderr: 91.9% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mon.c.log.gz 2024-05-03T17:08:21.074 INFO:teuthology.orchestra.run.smithi146.stderr: 92.6% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.11.log.gz 2024-05-03T17:08:21.133 INFO:teuthology.orchestra.run.smithi134.stderr: 92.3% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.1.log.gz 2024-05-03T17:08:21.184 INFO:teuthology.orchestra.run.smithi146.stderr: 92.2% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.8.log.gz 2024-05-03T17:08:21.197 INFO:teuthology.orchestra.run.smithi134.stderr: 92.2% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.7.log.gz 2024-05-03T17:08:21.365 INFO:teuthology.orchestra.run.smithi081.stderr: 90.4% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-mon.a.log.gz 2024-05-03T17:08:21.420 INFO:teuthology.orchestra.run.smithi081.stderr: 92.6% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.0.log.gz 2024-05-03T17:08:21.508 INFO:teuthology.orchestra.run.smithi134.stderr: 92.3% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.4.log.gz 2024-05-03T17:08:21.525 INFO:teuthology.orchestra.run.smithi081.stderr: 92.2% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.6.log.gz 2024-05-03T17:08:21.653 INFO:teuthology.orchestra.run.smithi081.stderr: 92.9% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.9.log.gz 2024-05-03T17:08:21.697 INFO:teuthology.orchestra.run.smithi081.stderr: 93.1% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.3.log.gz 2024-05-03T17:08:21.700 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-05-03T17:08:21.700 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m1.617s 2024-05-03T17:08:21.701 INFO:teuthology.orchestra.run.smithi081.stderr:user 0m7.043s 2024-05-03T17:08:21.701 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m0.632s 2024-05-03T17:08:21.724 INFO:teuthology.orchestra.run.smithi134.stderr: 92.4% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.10.log.gz 2024-05-03T17:08:21.729 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-05-03T17:08:21.729 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m1.628s 2024-05-03T17:08:21.730 INFO:teuthology.orchestra.run.smithi134.stderr:user 0m5.516s 2024-05-03T17:08:21.730 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m0.541s 2024-05-03T17:08:21.896 INFO:teuthology.orchestra.run.smithi146.stderr: 93.0% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.2.log.gz 2024-05-03T17:08:22.176 INFO:teuthology.orchestra.run.smithi146.stderr: 92.9% -- replaced with /var/log/ceph/8988869e-096a-11ef-bc97-c7b262605968/ceph-osd.5.log.gz 2024-05-03T17:08:22.181 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-05-03T17:08:22.181 INFO:teuthology.orchestra.run.smithi146.stderr:real 0m2.071s 2024-05-03T17:08:22.181 INFO:teuthology.orchestra.run.smithi146.stderr:user 0m6.109s 2024-05-03T17:08:22.181 INFO:teuthology.orchestra.run.smithi146.stderr:sys 0m0.582s 2024-05-03T17:08:22.183 INFO:tasks.cephadm:Archiving logs... 2024-05-03T17:08:22.183 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687374/remote/smithi081/log 2024-05-03T17:08:22.184 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-03T17:08:23.292 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687374/remote/smithi134/log 2024-05-03T17:08:23.292 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-03T17:08:24.161 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687374/remote/smithi146/log 2024-05-03T17:08:24.162 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-03T17:08:25.064 INFO:tasks.cephadm:Removing cluster... 2024-05-03T17:08:25.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8988869e-096a-11ef-bc97-c7b262605968 --force 2024-05-03T17:08:25.383 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T17:08:26.014 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8988869e-096a-11ef-bc97-c7b262605968 --force 2024-05-03T17:08:26.325 INFO:teuthology.orchestra.run.smithi134.stdout:Deleting cluster with fsid: 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T17:08:26.950 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8988869e-096a-11ef-bc97-c7b262605968 --force 2024-05-03T17:08:27.267 INFO:teuthology.orchestra.run.smithi146.stdout:Deleting cluster with fsid: 8988869e-096a-11ef-bc97-c7b262605968 2024-05-03T17:08:27.922 INFO:tasks.cephadm:Removing cephadm ... 2024-05-03T17:08:27.922 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-03T17:08:27.980 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-03T17:08:28.038 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-03T17:08:28.096 INFO:tasks.cephadm:Teardown complete 2024-05-03T17:08:28.097 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-03T17:08:28.107 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-03T17:08:28.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-03T17:08:28.115 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-03T17:08:28.123 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-03T17:08:28.285 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-03T17:08:28.294 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-03T17:08:28.294 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-03T17:08:28.302 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-03T17:08:28.310 DEBUG:teuthology.orchestra.run.smithi146:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-03T17:08:28.350 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-05-03T17:08:28.356 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-05-03T17:08:28.360 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-03T17:08:28.360 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-05-03T17:08:28.360 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv01.front.sepia.ceph.com 3 6 377 48 +403us[ +392us] +/- 69ms 2024-05-03T17:08:28.360 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 113 -545us[ -565us] +/- 62ms 2024-05-03T17:08:28.360 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 +200us[ +200us] +/- 69ms 2024-05-03T17:08:28.360 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T17:08:28.363 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: ntpq: command not found 2024-05-03T17:08:28.366 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-03T17:08:28.366 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-05-03T17:08:28.366 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 46 +410us[ +410us] +/- 69ms 2024-05-03T17:08:28.366 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv02.front.sepia.ceph.com 3 6 377 47 -535us[ -544us] +/- 63ms 2024-05-03T17:08:28.366 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +205us[ +196us] +/- 69ms 2024-05-03T17:08:28.366 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T17:08:28.372 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-03T17:08:28.372 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2024-05-03T17:08:28.372 INFO:teuthology.orchestra.run.smithi146.stdout:^* hv01.front.sepia.ceph.com 3 6 377 48 +410us[ +431us] +/- 69ms 2024-05-03T17:08:28.372 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 47 -535us[ -535us] +/- 63ms 2024-05-03T17:08:28.372 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 114 +206us[ +225us] +/- 68ms 2024-05-03T17:08:28.372 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T17:08:28.373 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-03T17:08:28.382 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-03T17:08:28.382 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-03T17:08:28.415 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-03T17:08:28.623 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-03T17:08:28.820 DEBUG:teuthology.orchestra.run.smithi146:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-03T17:08:29.014 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-03T17:08:29.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T17:08:29.109 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-03T17:08:29.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T17:08:29.199 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-03T17:08:29.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T17:08:29.290 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-03T17:08:29.301 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-03T17:08:29.349 INFO:teuthology.task.internal:Duration was 2720.254364 seconds 2024-05-03T17:08:29.349 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-03T17:08:29.398 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-03T17:08:29.398 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-03T17:08:29.407 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-03T17:08:29.415 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-03T17:08:29.528 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-03T17:08:29.539 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-03T17:08:29.551 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-03T17:08:30.159 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-03T17:08:30.160 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-05-03T17:08:30.160 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-03T17:08:30.233 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-05-03T17:08:30.234 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-03T17:08:30.308 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi146.front.sepia.ceph.com 2024-05-03T17:08:30.308 DEBUG:teuthology.orchestra.run.smithi146:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-03T17:08:30.368 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-03T17:08:30.369 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-03T17:08:30.377 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-03T17:08:30.385 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-03T17:08:30.469 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-03T17:08:30.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-03T17:08:30.475 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-03T17:08:30.481 DEBUG:teuthology.orchestra.run.smithi146:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-03T17:08:31.153 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-03T17:08:31.165 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-03T17:08:31.165 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-03T17:08:31.248 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-03T17:08:31.338 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-03T17:08:31.430 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-03T17:08:31.441 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-03T17:08:31.449 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-03T17:08:31.456 DEBUG:teuthology.orchestra.run.smithi146:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-03T17:08:31.542 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-05-03T17:08:31.551 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-05-03T17:08:31.556 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = core 2024-05-03T17:08:31.606 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-03T17:08:31.659 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T17:08:31.659 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-03T17:08:31.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T17:08:31.715 DEBUG:teuthology.orchestra.run.smithi146:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-03T17:08:31.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T17:08:31.769 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-03T17:08:31.780 INFO:teuthology.task.internal:Transferring archived files... 2024-05-03T17:08:31.781 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687374/remote/smithi081 2024-05-03T17:08:31.781 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-03T17:08:31.883 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687374/remote/smithi134 2024-05-03T17:08:31.883 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-03T17:08:31.981 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687374/remote/smithi146 2024-05-03T17:08:31.981 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-03T17:08:32.073 INFO:teuthology.task.internal:Removing archive directory... 2024-05-03T17:08:32.073 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-03T17:08:32.081 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-03T17:08:32.089 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-03T17:08:32.144 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-03T17:08:32.156 INFO:teuthology.task.internal:Not uploading archives. 2024-05-03T17:08:32.157 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-03T17:08:32.208 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-03T17:08:32.208 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-03T17:08:32.216 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-03T17:08:32.224 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-03T17:08:32.267 INFO:teuthology.orchestra.run.smithi081.stdout: 393243 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 3 17:08 /home/ubuntu/cephtest 2024-05-03T17:08:32.270 INFO:teuthology.orchestra.run.smithi134.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 3 17:08 /home/ubuntu/cephtest 2024-05-03T17:08:32.282 INFO:teuthology.orchestra.run.smithi146.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 3 17:08 /home/ubuntu/cephtest 2024-05-03T17:08:32.285 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-03T17:08:32.296 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-03T17:08:32.375 INFO:teuthology.nuke:Checking targets against current locks 2024-05-03T17:08:32.399 DEBUG:teuthology.nuke:shortname: smithi081 2024-05-03T17:08:32.400 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-03T17:08:32.420 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687374', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-03 16:14:05.382537', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJZ6FdJN/cxQ5MKeTV+PaoSj/YASSLnUoe9r0XsLLyspJggfqzhg8Vb9AKeZrmaeBJxSa/R6PyvaafT1FbVaF08='} 2024-05-03T17:08:32.424 DEBUG:teuthology.nuke:shortname: smithi134 2024-05-03T17:08:32.425 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-03T17:08:32.446 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687374', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-03 16:14:05.384839', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI22p8p89Zf4Kq+S4EWyJQW5Qh8VyQqCiTQob+SO5MJtzAuAXHeAi+45eZ5zqzWnLSl+wSSp2yI+XknDmk0X9xw='} 2024-05-03T17:08:32.450 DEBUG:teuthology.nuke:shortname: smithi146 2024-05-03T17:08:32.450 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-03T17:08:32.475 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687374', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-03 16:14:05.383799', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOJ9ViaEeEGhkMhYgWxwgHuSc05P5AzSeN9EHAsG9CdOowf+KH2BgU9sYCXXO4xYypajb/lJ1V+jzW8SWQYkOD0='} 2024-05-03T17:08:32.485 INFO:teuthology.orchestra.console.smithi081:Power off 2024-05-03T17:08:32.486 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-03T17:08:32.504 INFO:teuthology.orchestra.console.smithi134:Power off 2024-05-03T17:08:32.505 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-03T17:08:32.520 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2024-05-03T17:08:32.521 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T17:08:32.529 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2024-05-03T17:08:32.530 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T17:08:32.543 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2024-05-03T17:08:32.556 INFO:teuthology.orchestra.console.smithi146:Power off 2024-05-03T17:08:32.556 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-03T17:08:32.565 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-05-03T17:08:32.578 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2024-05-03T17:08:32.578 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T17:08:32.600 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2024-05-03T17:08:36.544 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T17:08:36.566 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T17:08:36.601 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T17:08:36.656 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2024-05-03T17:08:36.678 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-05-03T17:08:36.713 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2024-05-03T17:08:40.659 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T17:08:40.678 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T17:08:40.713 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T17:08:40.770 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2024-05-03T17:08:40.789 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-05-03T17:08:40.826 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2024-05-03T17:08:40.872 INFO:teuthology.orchestra.console.smithi081:Power off completed 2024-05-03T17:08:44.790 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T17:08:44.827 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T17:08:44.901 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2024-05-03T17:08:44.937 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2024-05-03T17:08:45.003 INFO:teuthology.orchestra.console.smithi134:Power off completed 2024-05-03T17:08:45.039 INFO:teuthology.orchestra.console.smithi146:Power off completed 2024-05-03T17:08:45.145 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/iozone}} duration: 2720.2543642520905 failure_reason: 'Command failed on smithi081 with status 110: "sudo TESTDIR=/home/ubuntu/cephtest bash -c ''ceph fs subvolumegroup pin cephfs qa random 0.10''"' flavor: default mon.a-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 mon.b-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 mon.c-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=08ba44f2d7fd446f849e62a54562ba9e status: fail success: false 2024-05-03T17:08:45.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-03T17:08:45.229 INFO:teuthology.run:FAIL